Open Source RAG running LLMs locally with Ollama

Weaviate • Vector Database
Weaviate • Vector Database
20,595
0
Published 2024-05-16
We've taken Verba, our open-source Retrieval Augmented Generation (RAG) app, to the next level with the newly released version 1.0. Run LLMs fully free and open with the new Ollama model integration, completely customize the UI, and enjoy many other feature updates like cached conversation, better logging and full transparency. Philip, Edward, and Victoria will take you through all the updates, show you how to set it up locally and help you get started using advanced RAG on your own data in just a couple minutes.

GitHub: github.com/weaviate/verba
Demo: verba.weaviate.io/

Join Leonie, Femke, Philip, Edward, Ajit and Victoria at Weaviate - we're hiring: weaviate.io/company/careers

And remember - all your vector embeddings are belong to you:
   • All Your Vector Embeddings Are Belong...  

Thanks to the Merantix AI Campus for hosting us in Berlin!
www.merantix-aicampus.com/

▬▬▬▬▬▬▬▬▬▬▬▬ CONNECT WITH US ▬▬▬▬▬▬▬▬▬▬▬▬
Visit weaviate.io
Star us on GitHub github.com/weaviate/weaviate
Stay updated and subscribe to our newsletter: newsletter.weaviate.io/
Try out Weaviate Cloud Services for free here: console.weaviate.cloud/
Got a questions?
Forum: forum.weaviate.io/
Slack: weaviate.io/slack
Connect with us on
Twitter: twitter.com/weaviate_io
LinkedIn: www.linkedin.com/company/weaviate-io/

Music:
Nebulosity - Brendon Moeller
Aubergene - Brendon Moeller

00:00 - Introduction
01:17 - Ollama Integration
01:53 - Customization
03:14 - RAG in Healthcare
04:54 - RAG in Weaviate
06:20 - Installation
08:54 - Outro
09:19 - Easter Egg
All Comments (21)
  • @iandanforth
    Very exciting! Thanks for all the hard work. (and fun Easter eggs)
  • @JohnPamplin
    Your "All Your Base Are Belong To Us" ending just earned a subscription from me. WHAT YOU SAY!
  • @AlangHsu
    Thank you for the open-source project. It's great.
  • @kapkanfps3694
    Might have to give a try, the ending is hilarious nostalgic 😂
  • @Hits-Sandbox
    Wow, Victoria, is a natural in front of the Camera, perfect presentation and body language movement just right for the level of presentation required. It almost looks like she went to school for acting, NLP and Micro Expression presentation for marketing.
  • @saulyarhi675
    This is beautiful. I'm working with 5 classmates (electromechanical and software engineering college) on a proyect, we developed a tiny robot able to chat with patients as a co therapist, using a raspberry pi and a LLM. But the hallucinations are way too dangerous here, so i suggested to my team we start implementing RAG. Generating and "validating" the psychology database is really, really, really time consuming, it's hard, tricky and it takes a long time to have good quality examples, but we are pretty sure it's gonna be 100% worth it. I just had knowledge of Ollama and i would love to try out Verba in our prototype, so people in need can start getting attention and we can right away start recollecting data from the final model already deployed. I would love to collaborate with you guys, I'm such an enthusiast of opensource communities and corporations, and I loved the concept you evoke so much. <3
  • @mohz832
    Why the layout of the installed version via pip is not the same as your demo? Also, how can we use PDF files without an API key from Unstructured? I believe this is still a showstopper for most of us.
  • @stebansb
    hey, this is awesome. Also love the end of the video, brings back memories!
  • @MrAnkitnakra
    Very helpful , I am able to set up on local host , however not able to ingest data, trying to upload a PDF
  • @christenjacquottet9799
    Is it more recommended to break down your markdown blogs into separate files rather than one big file to ingest? I tried with one big file and didn’t get accurate results
  • @JenuelDev
    is their an API where I can use to upload data? rather than uploading it in the admin ui. and also is their a way to access chat through api as well so that I can use the chat inside any website or apps?
  • @Pregidth
    This is very cool! Thank you! Can I distribute just the chat interface without the configuration behind?
  • @rodericksweet6546
    This is exactly what I have been looking for. However, I install it and none of the variables seem to populate the application. At lease none are showing.
  • @blueedu4958
    all your base are belong to us! Brilliant 🙂😍😎😎😎