Mastering LLMs: Fine-Tuning, DeepSpeed, and PyTorch Lightning скачать в хорошем качестве

Mastering LLMs: Fine-Tuning, DeepSpeed, and PyTorch Lightning

This comprehensive session focuses on the tools and techniques required to manage Large Language Models (LLMs) and complex workflows. Francesco Fiusco from NCC Sweden introduces PyTorch Lightning as a high-level framework to automate and organise research code. Geert Jan Bex from NCC Belgium then provides a deep dive into the world of LLMs and specific fine-tuning methodologies. Finally, Riccardo Scheda from NCC Italy demonstrates how to leverage HuggingFace Accelerate and DeepSpeed to achieve extreme memory efficiency and training speed. CASTIEL 2 has received funding from the European High-Performance Computing Joint Undertaking (JU) under grant agreement No 101102047. The JU receives support from the European Union‘s Digital Europe Programme and Germany, Italy, Spain, France, Belgium, Austria, Estonia.