English
Related papers

Related papers: AudioProtoPNet: An interpretable deep learning mod…

200 papers

Audio deepfakes are increasingly in-differentiable from organic speech, often fooling both authentication systems and human listeners. While many techniques use low-level audio features or optimization black-box model training, focusing on…

Sound · Computer Science 2025-02-21 Kevin Warren , Daniel Olszewski , Seth Layton , Kevin Butler , Carrie Gates , Patrick Traynor

This paper proposes a deep learning framework for classification of BBC television programmes using audio. The audio is firstly transformed into spectrograms, which are fed into a pre-trained convolutional Neural Network (CNN), obtaining…

Sound · Computer Science 2022-02-14 Lam Pham , Chris Baume , Qiuqiang Kong , Tassadaq Hussain , Wenwu Wang , Mark Plumbley

Recent progress in network-based audio event classification has shown the benefit of pre-training models on visual data such as ImageNet. While this process allows knowledge transfer across different domains, training a model on large-scale…

Sound · Computer Science 2021-05-21 Sascha Hornauer , Ke Li , Stella X. Yu , Shabnam Ghaffarzadegan , Liu Ren

Distant speech recognition is a challenge, particularly due to the corruption of speech signals by reverberation caused by large distances between the speaker and microphone. In order to cope with a wide range of reverberations in…

Computation and Language · Computer Science 2016-08-18 Jeehye Lee , Myungin Lee , Joon-Hyuk Chang

Monitoring wildlife abundance across space and time is an essential task to study their population dynamics and inform effective management. Acoustic recording units are a promising technology for efficiently monitoring bird populations and…

Applications · Statistics 2021-05-07 Jeffrey W. Doser , Andrew O. Finley , Aaron S. Weed , Elise F. Zipkin

Deep neural networks (DNNs) are now a central component of nearly all state-of-the-art speech recognition systems. Building neural network acoustic models requires several design decisions including network architecture, size, and training…

Computation and Language · Computer Science 2015-01-21 Andrew L. Maas , Peng Qi , Ziang Xie , Awni Y. Hannun , Christopher T. Lengerich , Daniel Jurafsky , Andrew Y. Ng

Many biological monitoring projects rely on acoustic detection of birds. Despite increasingly large datasets, this detection is often manual or semi-automatic, requiring manual tuning/postprocessing. We review the state of the art in…

Sound · Computer Science 2024-02-01 Dan Stowell , Mike Wood , Yannis Stylianou , Hervé Glotin

Speech data has rich acoustic and paralinguistic information with important cues for understanding a speaker's tone, emotion, and intent, yet traditional large language models such as BERT do not incorporate this information. There has been…

Computation and Language · Computer Science 2023-11-14 Fatema Hasan , Yulong Li , James Foulds , Shimei Pan , Bishwaranjan Bhattacharjee

Many recent works on deep speaker embeddings train their feature extraction networks on large classification tasks, distinguishing between all speakers in a training set. Empirically, this has been shown to produce speaker-discriminative…

Sound · Computer Science 2020-02-04 Chau Luu , Peter Bell , Steve Renals

This study aims to develop a deep learning system for an accessibility device for the deaf or hearing impaired. The device will accurately localize and identify sound sources in real time. This study will fill an important gap in current…

Machine Learning · Computer Science 2025-07-22 Jiayu , Liu

Obtaining data to train robust artificial intelligence (AI)-based models for species classification can be challenging, particularly for rare species. Data augmentation can boost classification accuracy by increasing the diversity of…

Sound · Computer Science 2025-12-16 Anthony Gibbons , Emma King , Ian Donohue , Andrew Parnell

In computational bioacoustics, deep learning models are composed of feature extractors and classifiers. The feature extractors generate vector representations of the input sound segments, called embeddings, which can be input to a…

Machine Learning · Computer Science 2025-04-10 Vincent S. Kather , Burooj Ghani , Dan Stowell

As unmanned aerial vehicles (UAVs) become increasingly prevalent in both consumer and defense applications, the need for reliable, modality-specific classification systems grows in urgency. This paper addresses the challenge of data…

Machine Learning · Computer Science 2025-08-15 Andrew P. Berg , Qian Zhang , Mia Y. Wang

Transformer-based models attain excellent results and generalize well when trained on sufficient amounts of data. However, constrained by the limited data available in the audio domain, most transformer-based models for audio tasks are…

Sound · Computer Science 2022-04-28 Dading Chong , Helin Wang , Peilin Zhou , Qingcheng Zeng

Depression is a common and serious mood disorder that negatively affects the patient's capacity of functioning normally in daily tasks. Speech is proven to be a vigorous tool in depression diagnosis. Research in psychiatry concentrated on…

Sound · Computer Science 2020-11-05 Muhammad Muzammel , Hanan Salam , Yann Hoffmann , Mohamed Chetouani , Alice Othmani

This study introduces a WaveNet-based deep learning model designed to automate the classification of intracranial electroencephalography (iEEG) signals into physiological activity, pathological (epileptic) activity, power-line noise, and…

Machine Learning · Computer Science 2026-01-14 Casper van Laar , Khubaib Ahmed

In this paper, we propose an efficient and reproducible deep learning model for musical onset detection (MOD). We first review the state-of-the-art deep learning models for MOD, and identify their shortcomings and challenges: (i) the lack…

Sound · Computer Science 2018-06-20 Rong Gong , Xavier Serra

Deep learning techniques have shown promising results in the automatic classification of respiratory sounds. However, accurately distinguishing these sounds in real-world noisy conditions remains challenging for clinical deployment. In…

Audio and Speech Processing · Electrical Eng. & Systems 2025-05-01 Jing-Tong Tzeng , Jeng-Lin Li , Huan-Yu Chen , Chun-Hsiang Huang , Chi-Hsin Chen , Cheng-Yi Fan , Edward Pei-Chuan Huang , Chi-Chun Lee

The DeepFilterNet (DFN) architecture was recently proposed as a deep learning model suited for hearing aid devices. Despite its competitive performance on numerous benchmarks, it still follows a `one-size-fits-all' approach, which aims to…

Advances in deep learning have resulted in state-of-the-art performance for many audio classification tasks but, unlike humans, these systems traditionally require large amounts of data to make accurate predictions. Not every person or…

Audio and Speech Processing · Electrical Eng. & Systems 2020-12-04 Piper Wolters , Chris Careaga , Brian Hutchinson , Lauren Phillips