Evgeniya Sukhodolskaya – miniCOIL: Sparse Neural Retrieval Done Right скачать в хорошем качестве

Evgeniya Sukhodolskaya – miniCOIL: Sparse Neural Retrieval Done Right

More: https://2025.berlinbuzzwords.de/sessi... Speaker: Evgeniya Sukhodolskaya In this talk, we present miniCOIL — our attempt to make a sparse neural retrieval model as it should be — combining the benefits of dense and lexical retrieval without propagating their drawbacks. We will share how to design and train a lightweight model that is performant on out-of-domain data and demonstrate its capabilities. Production search solutions often need the benefits of exact matching and semantic similarity — who wouldn’t want to have it all? The most famous to-go approach is hybrid search, which combines old but gold lexical methods with dense retrieval models. Hybrid search is famous for a reason; however, due to its dual component nature, taking the best of both worlds, it also takes the worst — propagates all the intricacies of vector search (heavy vectors, capricious indexes) and limitations of lexical approaches (low recall). A less famous solution is sparse neural retrieval — models, which make exact matching semantically aware, can distinguish “a fruit bat” and “a baseball bat”. You might know sparse neural retrieval for SPLADE, a leader in sparse neural benchmarks & a heavy model creating not-so-sparse vectors with its query/document extension mechanisms. Sparse neural retrieval seems pitch-perfect from afar: inverted indices and semantical understanding combined. It’s perhaps overlooked since many attempts to make it lightweight & performant on out-of-domain data failed. miniCOIL is our shot to give sparse neural retrieval more deserved attention — a lightweight model understanding words’ meaning within the context, performant on out-of-domain datasets and easy to adapt to custom data. In this talk, after an introduction in the context of sparse neural retrieval, we will show the architecture behind miniCOIL and demonstrate its capabilities. ### Follow us on Social Media and join the Community! Mastodon: https://floss.social/@BerlinBuzzwords LinkedIn:   / berlin-buzzwords   Website: https://berlinbuzzwords.de Mail: [email protected] Berlin Buzzwords is an event by Plain Schwarz – https://plainschwarz.com