Πηγαίνετε εκτός σύνδεσης με την εφαρμογή Player FM !
Use Long Context or RAG?
Manage episode 460390358 series 3496315
In this one, I discuss the dilemma between using retrieval-based generation and the newer "long context models".
Long context models, like the Gemini suite of models, allow us to send up to millions of tokens (thousands of text pages), whereas retrieval (RAG)-based systems allow us to search through as much (if not more) content and retrieve only the necessary bits to send the LLM for improved answers.
Both have advantages and disadvantages. This short episode will help you better understand when to use each.
Build Your First Scalable Product with LLMs: https://academy.towardsai.net/courses/beginner-to-advanced-llm-dev?ref=1f9b29
Master LLMs and Get Industry-ready Now: https://academy.towardsai.net/?ref=1f9b29
Our ebook: https://academy.towardsai.net/courses/buildingllmsforproduction?ref=1f9b29
38 επεισόδια
Manage episode 460390358 series 3496315
In this one, I discuss the dilemma between using retrieval-based generation and the newer "long context models".
Long context models, like the Gemini suite of models, allow us to send up to millions of tokens (thousands of text pages), whereas retrieval (RAG)-based systems allow us to search through as much (if not more) content and retrieve only the necessary bits to send the LLM for improved answers.
Both have advantages and disadvantages. This short episode will help you better understand when to use each.
Build Your First Scalable Product with LLMs: https://academy.towardsai.net/courses/beginner-to-advanced-llm-dev?ref=1f9b29
Master LLMs and Get Industry-ready Now: https://academy.towardsai.net/?ref=1f9b29
Our ebook: https://academy.towardsai.net/courses/buildingllmsforproduction?ref=1f9b29
38 επεισόδια
Όλα τα επεισόδια
×1 AI and Education: AI's Role in Education with Luis Serrano 1:14:53
1 From PhD to AI Innovation: Learn How to Build Products That Change the World 1:03:03
1 The Future of Art: AI, Creativity, and Human Co-Evolution - A Talk with Mariam Brian 1:16:55
1 The Role of Data in Advancing AI: Insights from Expert Jerome Pasquero 1:07:06
1 Navigating the Future: AI's Impact on Autonomous Vehicles and Beyond with Jérémy Cohen 1:20:39
1 Jerry Liu on the Future of AI: LlamaIndex, LLMs, RAG, Prompting and more ! What's AI Podcast Episode 25 58:50
1 AI Startups: Decoding Market Signals, Pivoting & Assessing Risks with Greg Coquillo (What's AI #24) 1:11:40
Καλώς ήλθατε στο Player FM!
Το FM Player σαρώνει τον ιστό για podcasts υψηλής ποιότητας για να απολαύσετε αυτή τη στιγμή. Είναι η καλύτερη εφαρμογή podcast και λειτουργεί σε Android, iPhone και στον ιστό. Εγγραφή για συγχρονισμό συνδρομών σε όλες τις συσκευές.