When Do You Use Fine-Tuning Vs. Retrieval Augmented Generation (RAG)? (Guest: Harpreet Sahota)

when it comes to fine tuning the questions you need to be asking yourself is okay do I want a model that needs to have deep domain understanding or specificity in a particular topic if yes maybe go with fine tuning if you need consistent or predictable behavior in the pattern of responses then go with fine-tuning if you got a ton of domain specific data that you can use to tune a model so that model can make better decisions or produce more uh consist an output beyond what you can do with prompting or few shot examples then you might need fine tuning uh and rag you would use rag retrieval augmented generation if you have a use case where an llm needs access to real time current data and knowledge information all that

Channel: Intelligence Briefing

Views: 6,829

Keywords: AI, Artificial Intelligence, Data Science, Developer, Fine-Tuning, Gen AI, Generative AI, Large Language Model, ML, Machine Learning, Model, RAG, Retrieval Augmented Generation, large language models, rag architecture, rag explained

Id: dvTEKuBbi4U

Length: 0min 52sec (52 seconds)

Published: Sat Oct 28 2023