Transformers as Interacting Particle Systems | Borjan Geshkovski (INRIA) скачать в хорошем качестве

Transformers as Interacting Particle Systems | Borjan Geshkovski (INRIA)

Transformers as Interacting Particle Systems: Small Time Steps, Low Temperature and Long Time Asymptotics Speaker: Borjan Geshkovski, INRIA Abstract: This talk presents an interacting particle perspective of Transformers, popularized by several authors, and discusses the limits of small time steps, low temperature, and long time horizons. This framework provides a mathematical lens for understanding the dynamics of attention-based architectures. About the workshop: This talk was presented at "Mathematical Foundations of Machine Learning: PDEs, Probability, and Dynamics," held at the Centre de Recerca Matemàtica (CRM) in Barcelona, January 7-9, 2026. About the speaker: Borjan Geshkovski is a researcher at INRIA working on the mathematical analysis of neural networks and machine learning systems using tools from partial differential equations and dynamical systems. More information: https://www.crm.cat/mathematical-foun... #MachineLearning #Mathematics #AI #DeepLearning #NeuralNetworks #TheoreticalML #DataScience #AppliedMathematics #Research #AcademicTalk #CRM #Barcelona #MathematicalFoundations #ArtificialIntelligence