English
Related papers

Related papers: Interpretable Temporal Class Activation Representa…

200 papers

The assessment of children at risk of autism typically involves a clinician observing, taking notes, and rating children's behaviors. A machine learning model that can label adult and child audio may largely save labor in coding children's…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-07 Jialu Li , Mark Hasegawa-Johnson , Karrie Karahalios

This paper describes our proposed integration system for the spoofing-aware speaker verification challenge. It consists of a robust spoofing-aware verification system that use the speaker verification and antispoofing embeddings extracted…

Audio and Speech Processing · Electrical Eng. & Systems 2022-04-05 Juan M. Martín-Doñas , Iván G. Torre , Aitor Álvarez , Joaquin Arellano

Speech-based depression detection tools could aid early screening. Here, we propose an interpretable speech foundation model approach to enhance the clinical applicability of such tools. We introduce a speech-level Audio Spectrogram…

Sound · Computer Science 2026-03-26 Qingkun Deng , Saturnino Luz , Sofia de la Fuente Garcia

We address speaker-aware anti-spoofing, where prior knowledge of the target speaker is incorporated into a voice spoofing countermeasure (CM). In contrast to the frequently used speaker-independent solutions, we train the CM in a…

Sound · Computer Science 2023-06-09 Xuechen Liu , Md Sahidullah , Kong Aik Lee , Tomi Kinnunen

Auditory attention decoding (AAD) is a technique used to identify and amplify the talker that a listener is focused on in a noisy environment. This is done by comparing the listener's brainwaves to a representation of all the sound sources…

Audio and Speech Processing · Electrical Eng. & Systems 2023-02-14 Cong Han , Vishal Choudhari , Yinghao Aaron Li , Nima Mesgarani

Spoken language recognition (SLR) is the task of automatically identifying the language present in a speech signal. Existing SLR models are either too computationally expensive or too large to run effectively on devices with limited…

Computation and Language · Computer Science 2023-06-06 Oriol Nieto , Zeyu Jin , Franck Dernoncourt , Justin Salamon

An attacker may use a variety of techniques to fool an automatic speaker verification system into accepting them as a genuine user. Anti-spoofing methods meanwhile aim to make the system robust against such attacks. The ASVspoof 2017…

Audio and Speech Processing · Electrical Eng. & Systems 2018-11-01 Cheng-I Lai , Alberto Abad , Korin Richmond , Junichi Yamagishi , Najim Dehak , Simon King

Inspite the emerging importance of Speech Emotion Recognition (SER), the state-of-the-art accuracy is quite low and needs improvement to make commercial applications of SER viable. A key underlying reason for the low accuracy is the…

Sound · Computer Science 2020-03-24 Siddique Latif , Rajib Rana , Sara Khalifa , Raja Jurdak , Julien Epps , Björn W. Schuller

Synthetic voice and splicing audio clips have been generated to spoof Internet users and artificial intelligence (AI) technologies such as voice authentication. Existing research work treats spoofing countermeasures as a binary…

Audio and Speech Processing · Electrical Eng. & Systems 2022-11-30 Lei Wang , Benedict Yeoh , Jun Wah Ng

Automatic speaker verification (ASV) systems are often affected by spoofing attacks. Recent transformer-based models have improved anti-spoofing performance by learning strong feature representations. However, these models usually need high…

Audio and Speech Processing · Electrical Eng. & Systems 2025-07-14 Yang Xiao , Ting Dang , Rohan Kumar Das

Self-supervised learned models have been found to be very effective for certain speech tasks such as automatic speech recognition, speaker identification, keyword spotting and others. While the features are undeniably useful in speech…

Audio and Speech Processing · Electrical Eng. & Systems 2024-03-05 Ravi Shankar , Ke Tan , Buye Xu , Anurag Kumar

This paper presents SpecWav-Attack, an adversarial model for detecting speakers in anonymized speech. It leverages Wav2Vec2 for feature extraction and incorporates spectrogram resizing and incremental training for improved performance.…

Sound · Computer Science 2025-05-16 Yuqi Li , Yuanzhong Zheng , Zhongtian Guo , Yaoxuan Wang , Jianjun Yin , Haojun Fei

Speaker identification systems in a real-world scenario are tasked to identify a speaker amongst a set of enrolled speakers given just a few samples for each enrolled speaker. This paper demonstrates the effectiveness of meta-learning and…

Audio and Speech Processing · Electrical Eng. & Systems 2022-07-25 Ashutosh Chaubey , Sparsh Sinha , Susmita Ghose

Current leading mispronunciation detection and diagnosis (MDD) systems achieve promising performance via end-to-end phoneme recognition. One challenge of such end-to-end solutions is the scarcity of human-annotated phonemes on natural L2…

Audio and Speech Processing · Electrical Eng. & Systems 2022-07-13 Mu Yang , Kevin Hirschi , Stephen D. Looney , Okim Kang , John H. L. Hansen

Existing speech emotion recognition (SER) methods commonly suffer from the lack of high-quality large-scale corpus, partly due to the complex, psychological nature of emotion which makes accurate labeling difficult and time consuming.…

Sound · Computer Science 2025-09-30 Haoyu Song , Ian McLoughlin , Qing Gu , Nan Jiang , Yan Song

This study is focused on understanding and quantifying the change in phoneme and prosody information encoded in the Self-Supervised Learning (SSL) model, brought by an accent identification (AID) fine-tuning task. This problem is addressed…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-13 Mu Yang , Ram C. M. C. Shekar , Okim Kang , John H. L. Hansen

Evaluating L2 speech intelligibility is crucial for effective computer-assisted language learning (CALL). Conventional ASR-based methods often focus on native-likeness, which may fail to capture the actual intelligibility perceived by human…

Audio and Speech Processing · Electrical Eng. & Systems 2025-06-02 Haopeng Geng , Daisuke Saito , Nobuaki Minematsu

Speaker representation learning is crucial for voice recognition systems, with recent advances in self-supervised approaches reducing dependency on labeled data. Current two-stage iterative frameworks, while effective, suffer from…

Audio and Speech Processing · Electrical Eng. & Systems 2025-06-03 Danwei Cai , Zexin Cai , Ze Li , Ming Li

Pre-trained acoustic representations such as wav2vec and DeCoAR have attained impressive word error rates (WER) for speech recognition benchmarks, particularly when labeled data is limited. But little is known about what phonetic properties…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-16 Danni Ma , Neville Ryant , Mark Liberman

The rapid advancement of spoofing algorithms necessitates the development of robust detection methods capable of accurately identifying emerging fake audio. Traditional approaches, such as finetuning on new datasets containing these novel…

Sound · Computer Science 2023-06-16 Xiaohui Zhang , Jiangyan Yi , Jianhua Tao , Chenlong Wang , Le Xu , Ruibo Fu