Haystack EU 2025: Marek Galovic – Billion-scale hybrid retrieval in a single query скачать в хорошем качестве

Haystack EU 2025: Marek Galovic – Billion-scale hybrid retrieval in a single query

More: https://haystackconf.com/eu2025/talk-3/ Vector databases became the de facto solution for embedding-based retrieval, which reveals its limits as users realize that similarity is not relevance. As a workaround, current solutions offer “hybrid retrieval” implemented as separate queries on disjoint indexes with late fusion of partial results based on rank or scores. In this talk, we present a fundamentally different model for billion‑scale hybrid retrieval, built from the ground up to address these challenges. Our storage format and query engine were designed to unify dense & sparse vectors, keywords, filters, and user‑defined scoring functions into a single distributed query, without relying on separate indexes and late fusion. This approach gives us a flexible query language that enables search practitioners to optimize relevance in their respective domains without having to manage and sync multiple data stores. Haystack is an event by OpenSource Connections. Website: https://opensourceconnections.com/ Mail: hello@o19s.com Mastodon: https://fosstodon.org/@o19s Linkedin:   / opensource-connections