English
Related papers

Related papers: Synthetic data enables context-aware bioacoustic s…

200 papers

A growing issue within conservation bioacoustics is the task of analysing the vast amount of data generated from the use of passive acoustic monitoring devices. In this paper, we present an alternative AI model which has the potential to…

Machine Learning · Computer Science 2025-08-20 Andrew Gascoyne , Wendy Lomas

Sound event detection is an important facet of audio tagging that aims to identify sounds of interest and define both the sound category and time boundaries for each sound event in a continuous recording. With advances in deep neural…

Sound · Computer Science 2024-12-31 Sangwook Park , David K. Han , Mounya Elhilali

This paper presents a residential audio dataset to support sound event detection research for smart home applications aimed at promoting wellbeing for older adults. The dataset is constructed by deploying audio recording systems in the…

Sound · Computer Science 2024-10-07 Gabriel Bibbó , Thomas Deacon , Arshdeep Singh , Mark D. Plumbley

The performance of machine learning algorithms is known to be negatively affected by possible mismatches between training (source) and test (target) data distributions. In fact, this problem emerges whenever an acoustic scene classification…

Audio and Speech Processing · Electrical Eng. & Systems 2020-05-04 Alessandro Ilic Mezza , Emanuël A. P. Habets , Meinard Müller , Augusto Sarti

The increasing realism of synthetic speech generated by advanced text-to-speech (TTS) models, coupled with post-processing and laundering techniques, presents a significant challenge for audio forensic detection. In this paper, we introduce…

We present Synthio, a novel approach for augmenting small-scale audio classification datasets with synthetic data. Our goal is to improve audio classification accuracy with limited labeled data. Traditional data augmentation techniques,…

Audio and Speech Processing · Electrical Eng. & Systems 2025-03-13 Sreyan Ghosh , Sonal Kumar , Zhifeng Kong , Rafael Valle , Bryan Catanzaro , Dinesh Manocha

Whisper, despite being trained on 680K hours of web-scaled audio data, faces difficulty in recognising rare words like domain-specific terms, with a solution being contextual biasing through prompting. To improve upon this method, in this…

Audio and Speech Processing · Electrical Eng. & Systems 2025-02-19 Yash Jogi , Vaibhav Aggarwal , Shabari S Nair , Yash Verma , Aayush Kubba

Acoustic environments affect acoustic characteristics of sound to be recognized by physically interacting with sound wave propagation. Thus, training acoustic models for audio and speech tasks requires regularization on various acoustic…

Audio and Speech Processing · Electrical Eng. & Systems 2022-02-08 Hyeonuk Nam , Seong-Hu Kim , Yong-Hwa Park

Object recognition and object pose estimation in robotic grasping continue to be significant challenges, since building a labelled dataset can be time consuming and financially costly in terms of data collection and annotation. In this…

Computer Vision and Pattern Recognition · Computer Science 2024-01-25 Dongmyoung Lee , Wei Chen , Nicolas Rojas

Thanks to recent advances in deep learning, sophisticated generation tools exist, nowadays, that produce extremely realistic synthetic speech. However, malicious uses of such tools are possible and likely, posing a serious threat to our…

Sound · Computer Science 2022-09-29 Alessandro Pianese , Davide Cozzolino , Giovanni Poggi , Luisa Verdoliva

Polyphonic Sound Event Detection (SED) in real-world recordings is a challenging task because of the dynamic polyphony level, intensity, and duration of sound events. Current polyphonic SED systems fail to model the temporal structure of…

Audio and Speech Processing · Electrical Eng. & Systems 2019-08-02 Arjun Pankajakshan , Helen L. Bear , Emmanouil Benetos

Many datasets have been designed to further the development of fake audio detection. However, fake utterances in previous datasets are mostly generated by altering timbre, prosody, linguistic content or channel noise of original audio.…

In the last couple of years, weakly labeled learning has turned out to be an exciting approach for audio event detection. In this work, we introduce webly labeled learning for sound events which aims to remove human supervision altogether…

Sound · Computer Science 2019-07-16 Anurag Kumar , Ankit Shah , Bhiksha Raj , Alex Hauptmann

Many methods of sound event detection (SED) based on machine learning regard a segmented time frame as one data sample to model training. However, the sound durations of sound events vary greatly depending on the sound event class, e.g.,…

We demonstrate substantial performance gains in zero-shot dialogue state tracking (DST) by enhancing training data diversity through synthetic data generation. Existing DST datasets are severely limited in the number of application domains…

Computation and Language · Computer Science 2024-06-14 James D. Finch , Jinho D. Choi

Detection of common events and scenes from audio is useful for extracting and understanding human contexts in daily life. Prior studies have shown that leveraging knowledge from a relevant domain is beneficial for a target acoustic event…

We present a method for synthesizing naturally looking images of multiple people interacting in a specific scenario. These images benefit from the advantages of synthetic data: being fully controllable and fully annotated with any type of…

Computer Vision and Pattern Recognition · Computer Science 2020-06-04 Igor Kviatkovsky , Nadav Bhonker , Gerard Medioni

Generative models have become a powerful tool for synthesizing training data in computer vision tasks. Current approaches solely focus on aligning generated images with the target dataset distribution. As a result, they capture only the…

Computer Vision and Pattern Recognition · Computer Science 2026-01-08 Zerun Wang , Jiafeng Mao , Xueting Wang , Toshihiko Yamasaki

Event detection (ED) aims at detecting event trigger words in sentences and classifying them into specific event types. In real-world applications, ED typically does not have sufficient labelled data, thus can be formulated as a few-shot…

Computation and Language · Computer Science 2021-06-01 Shirong Shen , Tongtong Wu , Guilin Qi , Yuan-Fang Li , Gholamreza Haffari , Sheng Bi

Text-to-audio (TTA) systems have recently demonstrated strong performance in synthesizing monaural audio from text. However, the task of generating binaural spatial audio from text, which provides a more immersive auditory experience by…

Audio and Speech Processing · Electrical Eng. & Systems 2025-02-18 Linfeng Feng , Lei Zhao , Boyu Zhu , Xiao-Lei Zhang , Xuelong Li