[camera] Day 10 afternoon - JSALT 2025 - Introduction to Multimodal Large Language Models II скачать в хорошем качестве

[camera] Day 10 afternoon - JSALT 2025 - Introduction to Multimodal Large Language Models II

Continuation of the Introduction to Multimodal Large Language Models I (https://youtube.com/live/9bzyaCwUVwA) presented by the workshop research group working on "Advancing Expert-Level Reasoning and Understanding in Large Audio Language Models". Tutorial held by: Alicia Lozano-Diez [Universidad Autónoma de Madrid] and Ramani Duraiswami [University of Maryland] LINKS: Part I https://githubtocolab.com/ferugit/JSA... Part II https://github.com/jsalt2025/af2 Outline: Laboratory (Python notebook Exercises) Simple examples Trying out AF2 and AF3 Trying out MMAU-Pro Preparing AQA data Simple training Bio: Alicia Lozano-Diez received the double degree in Computer Science Engineering and Mathematics from Universidad Autónoma de Madrid (UAM), Spain, in 2012, and the postgraduate Master in Research and Innovation in Information and Communications Technologies (I2-TIC) from the same University in 2013. Since 2012, she has been with the Audias research group at UAM. During her Ph.D., in 2015 and 2017, she joined for 4 and 2 months research internships the Speech group (Speech@FIT) at Brno University of Technology (BUT, Brno, Czech Republic). In the 2016 summer, she interned at SRI International (STAR Lab, California, USA). Her research is mainly focused on deep neural networks (DNN) based systems for automatic language and speaker recognition. She finished her Ph.D. in 2018 and got an assistant professor position at the UAM, continuing her research at the Audias group. In 2019, she got the H2020 Marie Curie funding for the project “Robust End-To-End SPEAKER recognition based on deep learning and attention models” and joined the Speech@FIT (BUT) for almost two years as a post-doc researcher. Ramani Duraiswami is Professor and Associate Chair (for Graduate Studies) at the Department of Computer Science, and in UMIACS, at the University of Maryland. Prof. Duraiswami got his B. Tech. at IIT Bombay, and his Ph.D. at The Johns Hopkins University. After spending a few years working in industry, he joined the University of Maryland, where he established the Perceptual Interfaces and Reality Lab. He has broad research interests, including both algorithm development (for machine learning, statistics, wave propagation and scattering, the fast multipole method), and systems development/applications (spatial audio capture rendering and personalization; computer vision, acoustics). He has published over 280 peer-reviewed archival papers, co-authored a book, has several issued patents, and according to Google Scholar has an h-index of 64 (in 2023). Some of his research has been spun out into a startup, VisiSonics, whose technology is in millions of devices. A particular theme of Prof. Duraiswami’s recent research has been combining machine learning with scientific simulation, and the understanding the interaction of waves with objects - electromagnetic, acoustic, and visual. Prof. Duraiswami has affiliate appointments in UMIACS, ECE, AMSC, MRC and NACS.