English
Related papers

Related papers: PSLA: Improving Audio Tagging with Pretraining, Sa…

200 papers

Audio classification is the task of identifying the sound categories that are associated with a given audio signal. This paper presents an investigation on large-scale audio classification based on the recently released AudioSet database.…

Sound · Computer Science 2018-10-31 Yuzhong Wu , Tan Lee

Recent advancements in foundation models have sparked interest in respiratory audio foundation models. However, the effectiveness of applying conventional pre-training schemes to datasets that are small-sized and lack diversity has not been…

Audio and Speech Processing · Electrical Eng. & Systems 2025-05-22 Daisuke Niizumi , Daiki Takeuchi , Masahiro Yasuda , Binh Thien Nguyen , Yasunori Ohishi , Noboru Harada

This paper investigates the classification of the Audio Set dataset. Audio Set is a large scale weakly labelled dataset of sound clips. Previous work used multiple instance learning (MIL) to classify weakly labelled data. In MIL, a bag…

Sound · Computer Science 2019-12-10 Qiuqiang Kong , Yong Xu , Wenwu Wang , Mark D. Plumbley

Certain environmental noises have been associated with negative developmental outcomes for infants and young children. Though classifying or tagging sound events in a domestic environment is an active research area, previous studies focused…

High quality labeled datasets have allowed deep learning to achieve impressive results on many sound analysis tasks. Yet, it is labor-intensive to accurately annotate large amount of audio data, and the dataset may contain noisy labels in…

Audio and Speech Processing · Electrical Eng. & Systems 2020-07-17 Boqing Zhu , Kele Xu , Qiuqiang Kong , Huaimin Wang , Yuxing Peng

The massive growth of self-supervised learning (SSL) has been witnessed in language, vision, speech, and audio domains over the past few years. While discrete label prediction is widely adopted for other modalities, the state-of-the-art…

Audio and Speech Processing · Electrical Eng. & Systems 2022-12-20 Sanyuan Chen , Yu Wu , Chengyi Wang , Shujie Liu , Daniel Tompkins , Zhuo Chen , Furu Wei

In this work, we provide a broad comparative analysis of strategies for pre-training audio understanding models for several tasks in the music domain, including labelling of genre, era, origin, mood, instrumentation, key, pitch, vocal…

Audio recognition in specialized areas such as birdsong and submarine acoustics faces challenges in large-scale pre-training due to the limitations in available samples imposed by sampling environments and specificity requirements. While…

Sound · Computer Science 2023-09-26 Xiang Li , Junhao Chen , Chao Li , Hongwu Lv

Large pre-trained models have demonstrated dominant performances in multiple areas, where the consistency between pre-training and fine-tuning is the key to success. However, few works reported satisfactory results of pre-trained models for…

Sound · Computer Science 2024-06-18 Anbai Jiang , Bing Han , Zhiqiang Lv , Yufeng Deng , Wei-Qiang Zhang , Xie Chen , Yanmin Qian , Jia Liu , Pingyi Fan

Combining multiple machine learning models into an ensemble is known to provide superior performance levels compared to the individual components forming the ensemble. This is because models can complement each other in taking better…

Sound · Computer Science 2021-06-09 Nicolae-Catalin Ristea , Radu Tudor Ionescu

Large Audio Language Models (LALMs) have emerged as powerful tools for speech-related tasks but remain underexplored for fine-tuning, especially with limited speech data. To bridge this gap, we systematically examine how different…

Sound · Computer Science 2026-01-22 Youngwon Choi , Jaeyoon Jung , Hyeonyu Kim , Huu-Kim Nguyen , Hwayeon Kim

Detecting spoofing attempts of automatic speaker verification (ASV) systems is challenging, especially when using only one modeling approach. For robustness, we use both deep neural networks and traditional machine learning models and…

Audio and Speech Processing · Electrical Eng. & Systems 2019-07-05 Bhusan Chettri , Daniel Stoller , Veronica Morfi , Marco A. Martínez Ramírez , Emmanouil Benetos , Bob L. Sturm

Currently available benchmarks for few-shot learning (machine learning with few training examples) are limited in the domains they cover, primarily focusing on image classification. This work aims to alleviate this reliance on image-based…

Sound · Computer Science 2022-04-12 Calum Heggan , Sam Budgett , Timothy Hospedales , Mehrdad Yaghoobi

In this paper, we describe our contribution to Task 2 of the DCASE 2018 Audio Challenge. While it has become ubiquitous to utilize an ensemble of machine learning methods for classification tasks to obtain better predictive performance, the…

Sound · Computer Science 2018-11-28 Marcel Lederle , Benjamin Wilhelm

This paper introduces an active learning (AL) framework for anomalous sound detection (ASD) in machine condition monitoring system. Typically, ASD models are trained solely on normal samples due to the scarcity of anomalous data, leading to…

Sound · Computer Science 2024-08-13 Tuan Vu Ho , Kota Dohi , Yohei Kawaguchi

Improper or erroneous labelling can pose a hindrance to reliable generalization for supervised learning. This can have negative consequences, especially for critical fields such as healthcare. We propose an effective new approach for…

Machine Learning · Computer Science 2021-11-16 Konstantinos Nikolaidis , Thomas Plagemann , Stein Kristiansen , Vera Goebel , Mohan Kankanhalli

Audio-Language Models (ALMs) have demonstrated remarkable performance in zero-shot audio classification. In this paper, we introduce PAT (Parameter-free Audio-Text aligner), a simple and training-free method aimed at boosting the zero-shot…

Sound · Computer Science 2024-10-22 Ashish Seth , Ramaneswaran Selvakumar , Sonal Kumar , Sreyan Ghosh , Dinesh Manocha

Audio generation has achieved remarkable progress with the advance of sophisticated generative models, such as diffusion models (DMs) and autoregressive (AR) models. However, due to the naturally significant sequence length of audio, the…

Sound · Computer Science 2024-12-18 Kai Qiu , Xiang Li , Hao Chen , Jie Sun , Jinglu Wang , Zhe Lin , Marios Savvides , Bhiksha Raj

While audio quality is a key performance metric for various audio processing tasks, including generative modeling, its objective measurement remains a challenge. Audio-Language Models (ALMs) are pre-trained on audio-text pairs that may…

Audio and Speech Processing · Electrical Eng. & Systems 2024-02-02 Soham Deshmukh , Dareen Alharthi , Benjamin Elizalde , Hannes Gamper , Mahmoud Al Ismail , Rita Singh , Bhiksha Raj , Huaming Wang

We propose Text-Aligned Speech Tokens with Multiple Layer-Aggregation (TASLA), which is a text-aligned speech tokenization framework that aims to address the problem that under a low-frame-rate and text-aligned regime, single-source speech…

Sound · Computer Science 2025-10-17 Ming-Hao Hsu , Liang-Hsuan Tseng , Hung-yi Lee , Zhizheng Wu