ELLIS Unit Stuttgart - Distinguished Lecture Series - Talk by Hilde Kühne скачать в хорошем качестве

ELLIS Unit Stuttgart - Distinguished Lecture Series - Talk by Hilde Kühne

"Advances in Self-Supervised Multimodal Learning". Talk by Prof. Dr. Hilde Kahn from University of Tübingen. April 2, 2025. The field of multimodal learning has witnessed significant progress in recent years, mainly enabled by advances in contrastive and autoregressive learning techniques. This scientific talk aims to present the latest developments in this domain, focusing on the following areas: I will quickly recap the concept of embedding space learning, which involves mapping multimodal input data, such as images, text, and video, into a shared feature space. Based on that, I will discuss the abilities of vision-language models that can arise from this, namely the concept of spatial and spatial-temporal grounding, which involves localizing objects and actions in images and videos. Finally, the talk will close with an outlook toward the challenges and future directions in multimodal learning, including the learning of multimodal structures to improve the efficiency and scalability of future systems. ellis-stuttgart.eu