Fast KV Compaction via Attention Matching (Feb 2026) скачать в хорошем качестве

Fast KV Compaction via Attention Matching (Feb 2026)

Title: Fast KV Compaction via Attention Matching (Feb 2026) Link: http://arxiv.org/abs/2602.16284v1 Date: February 2026 Summary: This paper introduces Attention Matching (AM), a framework for fast latent-space KV cache compaction in large language models. By optimizing compacted keys and values to reproduce attention outputs and preserve attention mass on reference queries, AM achieves high compaction ratios (up to 50x) with minimal quality loss. The approach decomposes into subproblems with efficient closed-form solutions, making it orders of magnitude faster than previous gradient-based optimization methods while outperforming token-selection heuristics. Key Topics: KV Cache Compaction Attention Matching Long-Context Language Models Latent Space Optimization Memory Efficiency Nonuniform Budget Allocation Chapters: 00:00 - Introduction and Paper Overview 01:23 - The KV Cache Bottleneck 02:22 - Limitations of Current Solutions 04:36 - Defining Attention Matching 05:28 - Preserving Attention Mass 07:00 - Generating Reference Queries 07:58 - Selecting Compact Keys 09:13 - Solving Linear Equations 10:29 - Analyzing Attention Head Sensitivity 11:56 - Optimizing Memory Budgets 12:43 - Evaluating Performance Benchmarks 14:48 - Handling Massive Documents 16:13 - Scaling Long-Horizon Agents 18:13 - Future of Native Compaction Stock video credits: Google DeepMind - https://www.pexels.com/@googledeepmind José Alfredo Munguía Lira - https://www.pexels.com/@rectorretro Silviu Din - https://www.pexels.com/@silviu-din-16... Soumya - https://www.pexels.com/@soumya-1446957 Pressmaster - https://www.pexels.com/@pressmaster Nino Souza - https://www.pexels.com/@ninosouza Yaroslav Shuraev - https://www.pexels.com/@yaroslav-shuraev Bedrijfsfilmspecialist.nl - https://www.pexels.com/@bedrijfsfilms... Tom Fisk - https://www.pexels.com/@tomfisk fauxels - https://www.pexels.com/@fauxels olia danilevich - https://www.pexels.com/@olia-danilevich StefWithAnF - https://www.pexels.com/@stefwithanf-1... Caleb Oquendo - https://www.pexels.com/@caleboquendo Tima Miroshnichenko - https://www.pexels.com/@tima-miroshni... Charlie Mounsey - https://www.pexels.com/@charlie-mouns... cottonbro studio - https://www.pexels.com/@cottonbro Mikhail Nilov - https://www.pexels.com/@mikhail-nilov KATRIN BOLOVTSOVA - https://www.pexels.com/@ekaterina-bol... Colin Jones - https://www.pexels.com/@larchmedia Dan Cristian Pădureț - https://www.pexels.com/@paduret crazy motions - https://www.pexels.com/@crazy-motions... @svetjekolem - https://www.pexels.com/@svetjekolem Oleg Gamulinskii - https://www.pexels.com/@oleg-gamulins... Adis Resic - https://www.pexels.com/@adis-resic-29... Engin Akyurt - https://www.pexels.com/@enginakyurt Ketut Subiyanto - https://www.pexels.com/@ketut-subiyanto tunnel motions - https://www.pexels.com/@tunnelmotions Stas Knop - https://www.pexels.com/@stasknop KoolShooters - https://www.pexels.com/@koolshooters Pixabay - https://www.pexels.com/@pixabay Max Fischer - https://www.pexels.com/@max-fischer Trippy Lagoon - https://www.pexels.com/@trippy-lagoon... MART PRODUCTION - https://www.pexels.com/@mart-production Danil Shostak - https://www.pexels.com/@danil-shostak... Colors Motion Graphics - https://www.pexels.com/@colors-motion... Pavel Danilyuk - https://www.pexels.com/@pavel-danilyuk Marie Palmier - https://www.pexels.com/@marie-palmier...