Haystack EU 2025: Smart Recall: Enhance Local LLM Conversations w/ Embedding-Aware Context Retrieval скачать в хорошем качестве

Haystack EU 2025: Smart Recall: Enhance Local LLM Conversations w/ Embedding-Aware Context Retrieval

More: https://haystackconf.com/eu2025/talk-11/ Speaker: Lucas Jeanniot How can you make your local LLM feel less forgetful? This session will introduce a practical service architecture for improving contextual continuity in chat applications using locally stored conversation history. We’ll walk through a Python-based approach that dynamically retrieves and rewrites prior turns based on semantic similarity which leverages embeddings, token limits, and summarisation to provide relevant memory windows to your model. Attendees will learn how to structure past interactions, filter for importance, and integrate efficient recall mechanisms to ensure local LLMs stay coherent, concise, and contextually aware. Haystack is an event by OpenSource Connections. Website: https://opensourceconnections.com/ Mail: hello@o19s.com Mastodon: https://fosstodon.org/@o19s Linkedin:   / opensource-connections