Smart sound systems

Explore the main research directions currently pursued at Smart Sound Lab. With the recent rising of live streaming services such as YouTube, outdoor recording is frequently observed in public. In particular, multichannel recording outdoor is commonly utilized to provide immersive audio to an audience beyond the screen. However, since outdoor recording inevitably entails ambient noise, ambient noise must be suppressed to make the desired speech heard well. Recently, with the emergence of Apple's spatial audio technology and Meta's AR/VR devices, technologies that render virtual audio as if it were actually present in the real world are gaining traction. Virtual audio for AR/VR devices is played through headphones. However, it is challenging to provide a sense of reality and spatiality, through audio played via headphones. Estimating indoor geometries is a crucial step in creating realistic digital twins of indoor spaces. Traditionally, methods to determine indoor geometries relied on vision-based techniques. However, creating an accurate digital twin becomes challenging when the camera-captured indoor image has hidden areas in the scene. Anomalous sound detection enhances maintenance efficiency in industries by early detecting equipment malfunctions, ensuring swift responses to security incidents, aiding in accident prevention in transportation, and contributing to noise management and emergency response in urban environments. Imagine yourself in a bustling café, eager to hear your friend's speech amid the mixture of music, keyboard clatter, and ambient noise. Your brain effortlessly filters through these sounds, focusing solely on your friend's speech, aided by clues like their appearance and direction. What if we could train a deep learning model to do the same? Our r