SANE2024 | Chris Donahue - The expanding horizons of generative music AI research скачать в хорошем качестве

SANE2024 | Chris Donahue - The expanding horizons of generative music AI research

Chris Donahue, Assistant Professor in the Computer Science Department at CMU and part-time research scientist at Google DeepMind, presents his work on generative music AI at the SANE 2024 workshop at Google, Cambridge, MA, on October 17, 2024. More info on the SANE workshop series: http://www.saneworkshop.org/ Abstract: In the span of less than two years, music AI has suddenly leapt out of the research lab and into the real world. This development heralds both profound opportunities and profound risks, and is already redefining relationships between diverse stakeholders including musicians, listeners, the music and tech industries, policymakers, and even researchers. We face a pressing question as researchers: how should our work adapt to meet the rapidly expanding horizons of music AI? In this talk, I will discuss some of my lab’s recent work, which attempts to take a holistic view of music AI research from the core technology (ML), to its presentation to users (HCI), and all the way to broader societal considerations. In particular, I will introduce our work on SingSong and Music ControlNet, which aim to improve the controllability of core generative modeling methods. I will also share our recent work on Hookpad Aria, a “Copilot” for musicians used by thousands of songwriters, and our goals in using Aria to better understand the nature of human-AI music co-creation. Finally, I will present some of our ongoing and future work on in-the-wild evaluation, and highlight many other emerging technical research problems that could bring clarity to some of the broader societal questions surrounding music AI.