Keynote - LLM Monitoring & Observability скачать в хорошем качестве

Keynote - LLM Monitoring & Observability

Jason Lopatecki is CEO and Co-Founder of Arize AI. In this keynote, he outlines a vision for LLM monitoring and observability and covers everything from LLM traces and spans to LLM evals, prompt testing and iteration, RAG search and retrieval, and fine-tuning. He covers the wide array of LLM use cases — like chatbots, structured data extraction, summarization, Q&A assistants, web scraping, code generation, and tagging and labeling — before outlining supported LLM span types. He then previews an exciting launch around LLM evals. This talk was originally delivered at “From Toy To Production: Building LLM-Powered Systems that Work in the Real World,” an event in New York City dedicated to scaling LLM-powered systems from experimental stages to real-world production environments. Get updates from Arize on future events: https://arize.com/community/ Learn more about LLMOps best practices in our course covering LLM evaluation, guardrails, building your own chatbot, chains and agents, and more: https://arize.com/blog-course/introdu...