6.1 How to evaluate a RAG system: methods and metrics скачать в хорошем качестве

6.1 How to evaluate a RAG system: methods and metrics

00:03 Intro 00:24 What is RAG? 01:03 How to evaluate RAG? Look at both sides. 01:34 Evaluating retrieval quality: ground truth-based evals. 02:23 Evaluating retrieval quality: labeling relevance. 02:55 Evaluating retrieval quality: LLM-labeled relevance / context quality judge. 03:55 Evaluating generation quality: ground truth-based evals. 04:36 Using synthetic data to create the test dataset. 05:10 Evaluating generation quality: faithfulness, completeness, etc. 06:09 Stress-testing RAG. 06:42 Recap COURSE PLAYLIST Full playlist:    • Course: LLM evaluation for builders   Instructor: Elena Samuylova, CEO Evidently AI. LINKS Ranking metrics https://www.evidentlyai.com/ranking-m... RAG evaluation https://www.evidentlyai.com/blog/open... EVIDENTLY Sign up for Evidently Cloud https://www.evidentlyai.com/register Support Evidently on GitHub https://github.com/evidentlyai/evidently