English
Related papers

Related papers: Spatial mixup: Directional loudness modification a…

200 papers

This paper proposes a novel formulation of prototypical loss with mixup for speaker verification. Mixup is a simple yet efficient data augmentation technique that fabricates a weighted combination of random data point and label pairs for…

Audio and Speech Processing · Electrical Eng. & Systems 2022-07-13 Xin Zhang , Minho Jin , Roger Cheng , Ruirui Li , Eunjung Han , Andreas Stolcke

As deeper and more complex models are developed for the task of sound event localization and detection (SELD), the demand for annotated spatial audio data continues to increase. Annotating field recordings with 360$^{\circ}$ video takes…

Audio and Speech Processing · Electrical Eng. & Systems 2023-09-08 Christopher Ick , Brian McFee

Spatial audio signal enhancement aims to reduce interfering source contributions while preserving the desired sound field with its spatial cues. Existing methods generally rely on impractical assumptions (e.g. accurate estimations of…

Audio and Speech Processing · Electrical Eng. & Systems 2025-09-03 Huawei Zhang , Jihui Zhang , Huiyuan Sun , Prasanga Samarasinghe

This technical report presents our submission to Task 3 of the DCASE 2025 Challenge: Stereo Sound Event Localization and Detection (SELD) in Regular Video Content. We address the audio-only task in this report and introduce several key…

Audio and Speech Processing · Electrical Eng. & Systems 2025-07-02 Jun-Wei Yeow , Ee-Leng Tan , Santi Peksi , Woon-Seng Gan

Audio tagging has attracted increasing attention since last decade and has various potential applications in many fields. The objective of audio tagging is to predict the labels of an audio clip. Recently deep learning methods have been…

Sound · Computer Science 2018-08-14 Shengyun Wei , Kele Xu , Dezhi Wang , Feifan Liao , Huaimin Wang , Qiuqiang Kong

Data augmentation is a valuable tool for the design of deep learning systems to overcome data limitations and stabilize the training process. Especially in the medical domain, where the collection of large-scale data sets is challenging and…

Machine Learning · Computer Science 2025-02-11 Mane Margaryan , Matthias Seibold , Indu Joshi , Mazda Farshad , Philipp Fürnstahl , Nassir Navab

Data augmentation plays a crucial role in enhancing the robustness and performance of machine learning models across various domains. In this study, we introduce a novel mixed-sample data augmentation method called RandoMix. RandoMix is…

Computer Vision and Pattern Recognition · Computer Science 2023-12-01 Xiaoliang Liu , Furao Shen , Jian Zhao , Changhai Nie

This report presents our systems submitted to the audio-only and audio-visual tracks of the DCASE2025 Task 3 Challenge: Stereo Sound Event Localization and Detection (SELD) in Regular Video Content. SELD is a complex task that combines…

Audio and Speech Processing · Electrical Eng. & Systems 2025-07-08 Davide Berghi , Philip J. B. Jackson

Humans can robustly recognize and localize objects by integrating visual and auditory cues. While machines are able to do the same now with images, less work has been done with sounds. This work develops an approach for dense semantic…

Computer Vision and Pattern Recognition · Computer Science 2020-03-10 Arun Balajee Vasudevan , Dengxin Dai , Luc Van Gool

Data augmentation refers to the process of applying a series of transformations or expansions to original data to generate new samples, thereby increasing the diversity and quantity of the data, effectively improving the performance and…

Computer Vision and Pattern Recognition · Computer Science 2024-06-11 Hao Zhang , Shuaijie Zhang , Renbin Zou

Multi-channel speech enhancement extracts speech using multiple microphones that capture spatial cues. Effectively utilizing directional information is key for multi-channel enhancement. Deep learning shows great potential on multi-channel…

Sound · Computer Science 2023-09-21 Jiahui Pan , Pengjie Shen , Hui Zhang , Xueliang Zhang

Data augmentation (DA) has played a pivotal role in the success of deep speaker recognition. Current DA techniques primarily focus on speaker-preserving augmentation, which does not change the speaker trait of the speech and does not create…

Sound · Computer Science 2024-06-12 Zhenyu Zhou , Shibiao Xu , Shi Yin , Lantian Li , Dong Wang

While the spatial directivity of multichannel speech enhancement algorithms improves with the number of microphones, fitting large capture arrays into real-world edge devices is typically limited by physical constraints. To overcome this…

Audio and Speech Processing · Electrical Eng. & Systems 2026-05-08 Dongheon Lee , Ashutosh Pandey , Sanjeel Parekh , Daniel Wong , Jacob Donley , Buye Xu , Juan Azcarreta

Multi-channel acoustic signal processing is a well-established and powerful tool to exploit the spatial diversity between a target signal and non-target or noise sources for signal enhancement. However, the textbook solutions for optimal…

Audio and Speech Processing · Electrical Eng. & Systems 2025-01-14 Reinhold Haeb-Umbach , Tomohiro Nakatani , Marc Delcroix , Christoph Boeddeker , Tsubasa Ochiai

Sound Event Localization and Detection (SELD) is crucial in spatial audio processing, enabling systems to detect sound events and estimate their 3D directions. Existing SELD methods use single- or dual-branch architectures: single-branch…

Sound · Computer Science 2025-07-31 Hogeon Yu

In this paper, we introduce spatial attention for refining the information in multi-direction neural beamformer for far-field automatic speech recognition. Previous approaches of neural beamformers with multiple look directions, such as the…

Audio and Speech Processing · Electrical Eng. & Systems 2020-03-10 Weipeng He , Lu Lu , Biqiao Zhang , Jay Mahadeokar , Kaustubh Kalgaonkar , Christian Fuegen

In this study, we address the multimodal task of stereo sound event localization and detection with source distance estimation (3D SELD) in regular video content. 3D SELD is a complex task that combines temporal event classification with…

Audio and Speech Processing · Electrical Eng. & Systems 2025-09-09 Davide Berghi , Philip J. B. Jackson

Modern machine learning models for audio tasks often exhibit superior performance on English and other well-resourced languages, primarily due to the abundance of available training data. This disparity leads to an unfair performance gap…

Computation and Language · Computer Science 2025-11-26 Wesley Bian , Xiaofeng Lin , Guang Cheng

This report presents the dataset and baseline of Task 3 of the DCASE2021 Challenge on Sound Event Localization and Detection (SELD). The dataset is based on emulation of real recordings of static or moving sound events under real conditions…

Audio and Speech Processing · Electrical Eng. & Systems 2021-07-06 Archontis Politis , Sharath Adavanne , Daniel Krause , Antoine Deleforge , Prerak Srivastava , Tuomas Virtanen

Labeling semantic segmentation datasets is a costly and laborious process if compared with tasks like image classification and object detection. This is especially true for remote sensing applications that not only work with extremely high…

Computer Vision and Pattern Recognition · Computer Science 2021-08-27 Matheus Barros Pereira , Jefersson Alex dos Santos