English
Related papers

Related papers: Synthetic data enables context-aware bioacoustic s…

200 papers

Annotating time boundaries of sound events is labor-intensive, limiting the scalability of strongly supervised learning in audio detection. To reduce annotation costs, weakly-supervised learning with only clip-level labels has been widely…

Sound · Computer Science 2025-10-30 Keisuke Imoto

Bioacoustic sensors, sometimes known as autonomous recording units (ARUs), can record sounds of wildlife over long periods of time in scalable and minimally invasive ways. Deriving per-species abundance estimates from these sensors requires…

Current state-of-the-art automatic speech recognition systems are trained to work in specific `domains', defined based on factors like application, sampling rate and codec. When such recognizers are used in conditions that do not match the…

This work proposes a data driven learning model for the synthesis of keystroke biometric data. The proposed method is compared with two statistical approaches based on Universal and User-dependent models. These approaches are validated on…

Due to the limitation of strong-labeled sound event detection data set, using synthetic data to improve the sound event detection system performance has been a new research focus. In this paper, we try to exploit the usage of synthetic data…

Sound · Computer Science 2020-11-03 Yuxin Huang , Liwei Lin , Xiangdong Wang , Hong Liu , Yueliang Qian , Min Liu , Kazushige Ouchi

We study few-shot acoustic event detection (AED) in this paper. Few-shot learning enables detection of new events with very limited labeled data. Compared to other research areas like computer vision, few-shot learning for audio recognition…

Machine Learning · Computer Science 2020-02-24 Bowen Shi , Ming Sun , Krishna C. Puvvada , Chieh-Chi Kao , Spyros Matsoukas , Chao Wang

Acoustic event detection is essential for content analysis and description of multimedia recordings. The majority of current literature on the topic learns the detectors through fully-supervised techniques employing strongly labeled data.…

Sound · Computer Science 2016-07-07 Anurag Kumar , Bhiksha Raj

Data synthesis and augmentation are essential for Sound Event Detection (SED) due to the scarcity of temporally labeled data. While augmentation methods like SpecAugment and Mix-up can enhance model performance, they remain constrained by…

Audio and Speech Processing · Electrical Eng. & Systems 2025-09-24 Jiarui Hai , Mounya Elhilali

Synthetic datasets are widely used for training urban scene recognition models, but even highly realistic renderings show a noticeable gap to real imagery. This gap is particularly pronounced when adapting to a specific target domain, such…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Denis Zavadski , Damjan Kalšan , Tim Küchler , Haebom Lee , Stefan Roth , Carsten Rother

The problem of synthetic speech detection has enjoyed considerable attention, with recent methods achieving low error rates across several established benchmarks. However, to what extent can low error rates on academic benchmarks translate…

Audio and Speech Processing · Electrical Eng. & Systems 2025-05-23 Ashi Garg , Zexin Cai , Lin Zhang , Henry Li Xinyuan , Leibny Paola García-Perera , Kevin Duh , Sanjeev Khudanpur , Matthew Wiesner , Nicholas Andrews

This paper presents our work of training acoustic event detection (AED) models using unlabeled dataset. Recent acoustic event detectors are based on large-scale neural networks, which are typically trained with huge amounts of labeled data.…

Audio and Speech Processing · Electrical Eng. & Systems 2019-05-01 Bowen Shi , Ming Sun , Chieh-Chi Kao , Viktor Rozgic , Spyros Matsoukas , Chao Wang

We propose a novel setting for learning, where the input domain is the image of a map defined on the product of two sets, one of which completely determines the labels. We derive a new risk bound for this setting that decomposes into a bias…

Machine Learning · Computer Science 2021-12-08 Charles Jin , Martin Rinard

Speech separation seeks to isolate individual speech signals from a multi-talk speech mixture. Despite much progress, a system well-trained on synthetic data often experiences performance degradation on out-of-domain data, such as…

Sound · Computer Science 2025-03-18 Wupeng Wang , Zexu Pan , Jingru Lin , Shuai Wang , Haizhou Li

In this paper, we propose three methods for generating synthetic samples to train and evaluate multimodal large language models capable of processing both text and speech inputs. Addressing the scarcity of samples containing both…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-21 Vahid Noroozi , Zhehuai Chen , Somshubra Majumdar , Steve Huang , Jagadeesh Balam , Boris Ginsburg

Few-shot learning is a type of classification through which predictions are made based on a limited number of samples for each class. This type of classification is sometimes referred to as a meta-learning problem, in which the model learns…

Audio and Speech Processing · Electrical Eng. & Systems 2022-11-02 Leah Chowenhill , Gaurav Satyanath , Shubhranshu Singh , Madhav Mahendra Wagh

Long-context audio reasoning is underserved in both training data and evaluation. Existing benchmarks target short-context tasks, and the open-ended generation tasks most relevant to long-context reasoning pose well-known challenges for…

Accurate classification of clinical text often requires fine-tuning pre-trained language models, a process that is costly and time-consuming due to the need for high-quality data and expert annotators. Synthetic data generation offers an…

Computation and Language · Computer Science 2025-01-28 Ivan Lopez , Fateme Nateghi Haredasht , Kaitlin Caoili , Jonathan H Chen , Akshay Chaudhari

Deep learning methods typically require vast amounts of training data to reach their full potential. While some publicly available datasets exists, domain specific data always needs to be collected and manually labeled, an expensive, time…

Computer Vision and Pattern Recognition · Computer Science 2019-02-27 Stefan Hinterstoisser , Olivier Pauly , Hauke Heibel , Martina Marek , Martin Bokeloh

The use of synthetic speech as data augmentation is gaining increasing popularity in fields such as automatic speech recognition and speech classification tasks. Despite novel text-to-speech systems with voice cloning capabilities, that…

Sound · Computer Science 2024-09-20 Sebastião Quintas , Isabelle Ferrané , Thomas Pellegrini

Computational engine sound modeling is central to the automotive audio industry, particularly for active sound design, virtual prototyping, and emerging data-driven engine sound synthesis methods. These applications require large volumes of…

Sound · Computer Science 2026-03-10 Robin Doerfler , Lonce Wyse