6 Years of AI Progress: ModernBERT Finally Replaces BERT скачать в хорошем качестве

6 Years of AI Progress: ModernBERT Finally Replaces BERT

After six years, we finally have a worthy replacement for BERT! Meet ModernBERT, the state-of-the-art encoder-only model that outshines its predecessors with larger context, improved downstream performance, and blazing-fast speeds. Designed as a drop-in upgrade for BERT-like models, ModernBERT is a great choice for retrieval, classification, and code-related applications. ⭐ SUPPORT ⭐ ────────────────── Subscribe! Patreon:   / nohypeai   🎥  CHAPTERS ────────────────── 00:00 - Encoders and Decoders 00:46 - RAG 02:35 - ModernBERT 03:13 - Training Data 04:12 - Context Length 05:11 - Attention Mechanism 06:43 - ModernBERT Example 📊 PAPERS ────────────────── 👉 Smarter, Better, Faster, Longer - https://arxiv.org/pdf/2412.13663 👉 Harnessing the Power of LLMs in Practice - https://arxiv.org/pdf/2304.13712 👉 BERT - https://arxiv.org/pdf/1810.04805 👉 FlashAttention - https://arxiv.org/pdf/2205.14135 👉 RAG - https://arxiv.org/pdf/2005.11401 👉 RAG Survey - https://arxiv.org/pdf/2312.10997 📖 USEFUL LINKS ────────────────── 👉 ModernBERT on HuggingFace: https://huggingface.co/blog/modernbert 👉 Meta’s RAG blog post: https://ai.meta.com/blog/retrieval-au... 👉 ModernBERT documentation: https://huggingface.co/docs/transform... 👉 ModernBERT-large: https://huggingface.co/answerdotai/Mo... 👉 ModernBERT-base: https://huggingface.co/answerdotai/Mo... 👨‍🔬 JUPYTER DOC ────────────────── 👉 Coming soon! #ai #llm #bert #rag #research