SmolLM: The Rise of Smol Models скачать в хорошем качестве

SmolLM: The Rise of Smol Models

Loubna Ben Allal, Research Engineer, Lead, Hugging Face, SmolLM About the Speaker: Loubna Ben Allal is a Research Engineer in the Science team at Hugging Face, where she leads the training of small language models (SmolLMs) and their data curation. Previously, she worked on large language models for code and was a core member of the BigCode team behind The Stack datasets and StarCoder models for code generation. Abstract: On-device language models are revolutionizing AI by making advanced models accessible in resource-constrained environments. In this talk, we will explore the rise of small models and how they are reshaping the AI landscape, moving beyond the era of scaling to ever-larger models. We will also cover SmolLM, a series of compact yet powerful LLMs, focusing on data curation, and ways to leverage these models for on-device applications.