The Mathematics of Multisensory Experiences: From Musical Instruments to Accessible Virtual Worlds скачать в хорошем качестве

The Mathematics of Multisensory Experiences: From Musical Instruments to Accessible Virtual Worlds

The Mathematics of Multisensory Experiences: From Musical Instruments to Accessible Virtual Worlds Prof. Stefania Serafin Aalborg University - Sonic Interaction Design Mathematics offers powerful tools to model how we hear, feel, and interact with the world. In this talk, I will explore how physical modeling, signal processing, and computational acoustics can describe the dynamics of sound and touch—from the vibration of a violin string to the reverberation of a virtual room. These models not only enable the synthesis of realistic musical instruments and everyday soundscapes, but also form the basis of multisensory interfaces that enhance perception, communication, and inclusion. Drawing from projects at the Multisensory Experience Lab, I will illustrate how numerical methods and perceptual modeling converge in applications ranging from embodied music interaction to auditory training and hearing rehabilitation. Finally, I will discuss how these mathematical foundations are evolving toward human-centered AI systems that adapt to individual sensory profiles—supporting accessibility, empathy, and creativity in virtual and augmented environments.