English
Related papers

Related papers: ASDA: Audio Spectrogram Differential Attention Mec…

200 papers

We apply topological data analysis (TDA) to speech classification problems and to the introspection of a pretrained speech model, HuBERT. To this end, we introduce a number of topological and algebraic features derived from Transformer…

In this paper, we present a bias and sustainability focused investigation of Automatic Speech Recognition (ASR) systems, namely Whisper and Massively Multilingual Speech (MMS), which have achieved state-of-the-art (SOTA) performances.…

Computation and Language · Computer Science 2025-03-04 Ajinkya Kulkarni , Atharva Kulkarni , Miguel Couceiro , Isabel Trancoso

The growing use of information hiding in network streaming media for covert communication poses a significant security threat, necessitating the development of robust detection technologies. However, existing steganalysis methods for…

Cryptography and Security · Computer Science 2026-05-22 Pengcheng Zhou , Pianran Guo , Shuhua Chen , Mengqin Zhao , Zhongliang Yang , Linna Zhou

Anomalous sound detection (ASD) benchmarks typically assume that the identity of the monitored machine is known at test time and that recordings are evaluated in a machine-wise manner. However, in realistic monitoring scenarios with…

Audio and Speech Processing · Electrical Eng. & Systems 2026-05-14 Kevin Wilkinghoff , Keisuke Imoto , Zheng-Hua Tan

Respiratory sound classification is hindered by the limited size, high noise levels, and severe class imbalance of benchmark datasets like ICBHI 2017. While Transformer-based models offer powerful feature extraction capabilities, they are…

Audio and Speech Processing · Electrical Eng. & Systems 2025-12-30 Atakan Işık , Selin Vulga Işık , Ahmet Feridun Işık , Mahşuk Taylan

Audiovisual active speaker detection (ASD) is conventionally performed by modelling the temporal synchronisation of acoustic and visual speech cues. In egocentric recordings, however, the efficacy of synchronisation-based methods is…

Multimedia · Computer Science 2025-06-24 Jason Clarke , Yoshihiko Gotoh , Stefan Goetze

Automatic speech recognition (ASR) is widely used in consumer electronics. ASR greatly improves the utility and accessibility of technology, but usually the output is only word sequences without punctuation. This can result in ambiguity in…

Computation and Language · Computer Science 2021-02-23 Andrew Silva , Barry-John Theobald , Nicholas Apostoloff

In the past decade, convolutional neural networks (CNNs) have been widely adopted as the main building block for end-to-end audio classification models, which aim to learn a direct mapping from audio spectrograms to corresponding labels. To…

Sound · Computer Science 2021-07-12 Yuan Gong , Yu-An Chung , James Glass

Most existing multi-source domain adaptation (MSDA) methods minimize the distance between multiple source-target domain pairs via feature distribution alignment, an approach borrowed from the single source setting. However, with diverse…

Computer Vision and Pattern Recognition · Computer Science 2021-11-09 Zhongying Deng , Kaiyang Zhou , Yongxin Yang , Tao Xiang

This paper describes a submission to the Environment-Aware Speech and Sound Deepfake Detection Challenge (ESDD2) 2026, which addresses component-level deepfake detection using the CompSpoofV2 dataset, where speech and environmental sounds…

Sound · Computer Science 2026-05-06 Khalid Zaman , Qixuan Huang , Muhammad Uzair , Masashi Unoki

Speech Emotion Recognition (SER) plays a key role in advancing human-computer interaction. Attention mechanisms have become the dominant approach for modeling emotional speech due to their ability to capture long-range dependencies and…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-17 Marc Casals-Salvador , Federico Costa , Rodolfo Zevallos , Javier Hernando

Many speech enhancement methods try to learn the relationship between noisy and clean speech, obtained using an acoustic room simulator. We point out several limitations of enhancement methods relying on clean speech targets; the goal of…

Computation and Language · Computer Science 2018-12-26 Geonmin Kim , Hwaran Lee , Bo-Kyeong Kim , Sang-Hoon Oh , Soo-Young Lee

Although mask-based beamforming is a powerful speech enhancement approach, it often requires manual parameter tuning to handle moving speakers. Recently, this approach was augmented with an attention-based spatial covariance matrix…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-18 Marvin Tammen , Tsubasa Ochiai , Marc Delcroix , Tomohiro Nakatani , Shoko Araki , Simon Doclo

Machine anomalous sound detection (ASD) has emerged as one of the most promising applications in the Industrial Internet of Things (IIoT) due to its unprecedented efficacy in mitigating risks of malfunctions and promoting production…

Sound · Computer Science 2024-08-28 Anbai Jiang , Yuchen Shi , Pingyi Fan , Wei-Qiang Zhang , Jia Liu

We introduce Robust Filter Attention (RFA), a formulation of self-attention as a robust state estimator. Each token is treated as a noisy observation of a latent trajectory governed by a linear stochastic differential equation (SDE), and…

Machine Learning · Computer Science 2026-05-26 Peter Racioppo

Connecting large libraries of digitized audio recordings to their corresponding sheet music images has long been a motivation for researchers to develop new cross-modal retrieval systems. In recent years, retrieval systems based on…

Information Retrieval · Computer Science 2019-06-27 Stefan Balke , Matthias Dorfer , Luis Carvalho , Andreas Arzt , Gerhard Widmer

Self-attention models have been successfully applied in end-to-end speech recognition systems, which greatly improve the performance of recognition accuracy. However, such attention-based models cannot be used in online speech recognition,…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-24 Jian Luo , Jianzong Wang , Ning Cheng , Jing Xiao

In many real-world applications, the mismatch between distributions of training data (source) and test data (target) significantly degrades the performance of machine learning algorithms. In speech data, causes of this mismatch include…

Sound · Computer Science 2022-03-15 Rosanna Turrisi , Leonardo Badino

End-to-end approaches for automatic speech recognition (ASR) benefit from directly modeling the probability of the word sequence given the input audio stream in a single neural network. However, compared to conventional ASR systems, these…

Audio and Speech Processing · Electrical Eng. & Systems 2020-02-19 Ankur Gandhe , Ariya Rastrow

Autism Spectrum Disorders (ASD) describe a heterogeneous set of conditions classified as neurodevelopmental disorders. Although the mechanisms underlying ASD are not yet fully understood, more recent literature focused on multiple genetics…

Signal Processing · Electrical Eng. & Systems 2025-01-31 Jessica Vacca , Natascia Brondino , Fabio Dell'Acqua , Anna Vizziello , Pietro Savazzi