Optimizing Retrieval Agents with Shirley Wu - Weaviate Podcast скачать в хорошем качестве

Optimizing Retrieval Agents with Shirley Wu - Weaviate Podcast

Hey everyone! Thank you so much for watching the 115th episode of the Weaviate Podcast featuring Shirley Wu from Stanford University! We explore the innovative Avatar Optimizer—a novel framework that leverages contrastive reasoning to refine LLM agent prompts for optimal tool usage. Shirley explains how this self-improving system evolves through iterative feedback by contrasting positive and negative examples, enabling agents to handle complex tasks more effectively. We also dive into the STaRK Benchmark, a comprehensive testbed designed to evaluate retrieval systems on semi-structured knowledge bases. The discussion highlights the challenges of unifying textual and relational retrieval, exploring concepts such as multi-vector embeddings, relational graphs, and dynamic data modeling. Learn how these approaches help overcome information loss, enhance precision, and enable scalable, context-aware retrieval in diverse domains—from product recommendations to precision medicine. Whether you’re interested in advanced prompt optimization, multi-agent system design, or the future of human-centered language models, this episode offers a wealth of insights and a forward-looking perspective on integrating sophisticated AI techniques into real-world applications. Links: AvaTaR: https://arxiv.org/abs/2406.11200 STaRK: https://arxiv.org/abs/2404.13207 Learn more about Shirley Wu: https://cs.stanford.edu/~shirwu/ Chapters 0:00 Welcome Shirely! 0:30 What is the state of AI? 2:18 Graph Data Models and GraphRAG 8:22 Unifying Textual and Relational Retrieval 10:50 Multi-Vector Retrieval 15:55 Embeddings and Properties 21:58 PrimeKG 27:25 AvaTaR: LLM Tool Use Optimization 41:40 Complex Retrieval 46:28 Agent Memory and DSPy 55:00 Future Directions for AI