Ubicoustics: Plug-and-Play Acoustic Activity Recognition скачать в хорошем качестве

Ubicoustics: Plug-and-Play Acoustic Activity Recognition

Learn more: http://www.gierad.com/projects/ubicou... Despite sound being a rich source of information, computing devices with microphones do not leverage audio to glean useful insights about their physical and social context. In this project, we present a novel, real-time, sound-based activity recognition system. We start by taking an existing, state-of-the-art sound labeling model, which we then tune to classes of interest by drawing data from professional sound effect libraries traditionally used in the entertainment industry. These well-labeled and high-quality sounds are the perfect atomic unit for data augmentation, including amplitude, reverb, and mixing, allowing us to exponentially grow our tuning data in realistic ways. We quantify the performance of our approach across a range of environments and device categories and show that microphone-equipped computing devices already have the requisite capability to unlock real-time activity recognition comparable to human accuracy.