English
Related papers

Related papers: Multi-agent Auditory Scene Analysis

200 papers

Acoustic scene classification (ASC) is one of the most popular problems in the field of machine listening. The objective of this problem is to classify an audio clip into one of the predefined scenes using only the audio data. This problem…

One of the biggest challenges of acoustic scene classification (ASC) is to find proper features to better represent and characterize environmental sounds. Environmental sounds generally involve more sound sources while exhibiting less…

Sound · Computer Science 2019-04-11 Hongwei Song , Jiqing Han , Shiwen Deng

As humans, we hear sound every second of our life. The sound we hear is often affected by the acoustics of the environment surrounding us. For example, a spacious hall leads to more reverberation. Room Impulse Responses (RIR) are commonly…

Artificial Intelligence · Computer Science 2023-10-10 Yinfeng Yu , Changan Chen , Lele Cao , Fangkai Yang , Fuchun Sun

We study device-addressed speech detection under pre-ASR edge deployment constraints, where systems must decide whether to forward audio before transcription under strict latency and compute limits. We show that, in multi-speaker…

Sound · Computer Science 2026-04-10 David Joohun Kim , Daniyal Anjum , Bonny Banerjee , Omar Abbasi

Large audio-language models have made rapid progress in recognizing what is present in an audio clip, but spatial audio-language understanding still lacks a clear task interface. A model must also decide where sound events occur, which…

Sound · Computer Science 2026-05-12 Yuhuan You , Lai Wei , Xihong Wu , Tianshu Qu

Cinematic Audio Source Separation (CASS) aims to decompose mixed film audio into speech, music, and sound effects, enabling applications like dubbing and remastering. Existing CASS approaches are audio-only, overlooking the inherent…

Multimedia · Computer Science 2026-03-30 Kang Zhang , Suyeon Lee , Arda Senocak , Joon Son Chung

Acoustic scene classification systems using deep neural networks classify given recordings into pre-defined classes. In this study, we propose a novel scheme for acoustic scene classification which adopts an audio tagging system inspired by…

Audio and Speech Processing · Electrical Eng. & Systems 2020-04-21 Jee-weon Jung , Hye-jin Shim , Ju-ho Kim , Seung-bin Kim , Ha-Jin Yu

Many speech enhancement methods try to learn the relationship between noisy and clean speech, obtained using an acoustic room simulator. We point out several limitations of enhancement methods relying on clean speech targets; the goal of…

Computation and Language · Computer Science 2018-12-26 Geonmin Kim , Hwaran Lee , Bo-Kyeong Kim , Sang-Hoon Oh , Soo-Young Lee

Acoustic scene classification (ASC) and sound event detection (SED) are fundamental tasks in environmental sound analysis, and many methods based on deep learning have been proposed. Considering that information on acoustic scenes and sound…

Sound · Computer Science 2022-04-06 Keisuke Imoto , Yuka Komatsu , Shunsuke Tsubaki , Tatsuya Komatsu

We explore active audio-visual separation for dynamic sound sources, where an embodied agent moves intelligently in a 3D environment to continuously isolate the time-varying audio stream being emitted by an object of interest. The agent…

Computer Vision and Pattern Recognition · Computer Science 2022-07-26 Sagnik Majumder , Kristen Grauman

Sustaining coherent, role-aware communication across multi-agent systems remains a foundational challenge in AI. Current frameworks often lack explicit mechanisms for speaker responsibility, leading to context drift, alignment instability,…

Artificial Intelligence · Computer Science 2025-06-03 Khe-Han Toh , Hong-Kuan Teo

Acoustic Scene Classification (ASC) is a fundamental problem in computational audition, which seeks to classify environments based on the distinctive acoustic features. In the ASC task of the APSIPA ASC 2025 Grand Challenge, the organizers…

Sound · Computer Science 2025-08-26 Bochao Sun , Dong Wang , ZhanLong Yang , Jun Yang , Han Yin

The angular spectrum approach (ASA)---a fast, frequency domain method for calculation of the acoustic field---enables passive source localization and modeling forward propagation in homogeneous media with high computational efficiency. Here…

Signal Processing · Electrical Eng. & Systems 2020-12-02 Scott Schoen , Costas D. Arvanitis

Source seeking is an important topic in robotic research, especially considering sound-based sensors since they allow the agents to locate a target even in critical conditions where it is not possible to establish a direct line of sight. In…

As we interact with the world, for example when we communicate with our colleagues in a large open space or meeting room, we continuously analyse the surrounding environment and, in particular, localise and recognise acoustic events. While…

Sound · Computer Science 2019-04-02 Pawel Swietojanski , Ondrej Miksik

This paper addresses the issue of active speaker detection (ASD) in noisy environments and formulates a robust active speaker detection (rASD) problem. Existing ASD approaches leverage both audio and visual modalities, but non-speech sounds…

Multimedia · Computer Science 2024-04-02 Siva Sai Nagender Vasireddy , Chenxu Zhang , Xiaohu Guo , Yapeng Tian

Sound event detection (SED) and Acoustic scene classification (ASC) are two widely researched audio tasks that constitute an important part of research on acoustic scene analysis. Considering shared information between sound events and…

Sound · Computer Science 2022-09-14 Daniel Aleksander Krause , Annamaria Mesaros

The ability to localize and track acoustic events is a fundamental prerequisite for equipping machines with the ability to be aware of and engage with humans in their surrounding environment. However, in realistic scenarios, audio signals…

Audio and Speech Processing · Electrical Eng. & Systems 2020-10-22 Christine Evers , Heinrich Loellmann , Heinrich Mellmann , Alexander Schmidt , Hendrik Barfuss , Patrick Naylor , Walter Kellermann

Acoustic scene classification (ASC) and sound event detection (SED) are major topics in environmental sound analysis. Considering that acoustic scenes and sound events are closely related to each other, the joint analysis of acoustic scenes…

Sound · Computer Science 2022-06-22 Kayo Nada , Keisuke Imoto , Takao Tsuchiya

We consider a setting in which $N$ agents aim to speedup a common Stochastic Approximation (SA) problem by acting in parallel and communicating with a central server. We assume that the up-link transmissions to the server are subject to…

Artificial Intelligence · Computer Science 2024-08-05 Nicolò Dal Fabbro , Arman Adibi , H. Vincent Poor , Sanjeev R. Kulkarni , Aritra Mitra , George J. Pappas