English
Related papers

Related papers: Integrated Spoofing-Robust Automatic Speaker Verif…

200 papers

Speaker-attributed automatic speech recognition (SA-ASR) aims to transcribe speech while assigning transcripts to the corresponding speakers accurately. Existing methods often rely on complex modular systems or require extensive fine-tuning…

Computation and Language · Computer Science 2025-01-16 Thai-Binh Nguyen , Alexander Waibel

Voice authentication has become an integral part in security-critical operations, such as bank transactions and call center conversations. The vulnerability of automatic speaker verification systems (ASVs) to spoofing attacks instigated the…

Cryptography and Security · Computer Science 2021-08-02 Andre Kassis , Urs Hengartner

Audio-visual automatic speech recognition (AV-ASR) models are very effective at reducing word error rates on noisy speech, but require large amounts of transcribed AV training data. Recently, audio-visual self-supervised learning (SSL)…

Sound · Computer Science 2023-12-18 Avner May , Dmitriy Serdyuk , Ankit Parag Shah , Otavio Braga , Olivier Siohan

Speaker-attributed automatic speech recognition (SA-ASR) in multi-party meeting scenarios is one of the most valuable and challenging ASR task. It was shown that single-channel frame-level diarization with serialized output training…

Audio and Speech Processing · Electrical Eng. & Systems 2023-03-03 Mohan Shi , Jie Zhang , Zhihao Du , Fan Yu , Qian Chen , Shiliang Zhang , Li-Rong Dai

While automatic speech recognition (ASR) systems degrade significantly in noisy environments, audio-visual speech recognition (AVSR) systems aim to complement the audio stream with noise-invariant visual cues and improve the system's…

Sound · Computer Science 2024-04-09 He Wang , Pengcheng Guo , Pan Zhou , Lei Xie

We introduce Condition-Aware Self-Supervised Learning Representation (CA-SSLR), a generalist conditioning model broadly applicable to various speech-processing tasks. Compared to standard fine-tuning methods that optimize for downstream…

Audio and Speech Processing · Electrical Eng. & Systems 2024-12-06 Yen-Ju Lu , Jing Liu , Thomas Thebaud , Laureano Moro-Velazquez , Ariya Rastrow , Najim Dehak , Jesus Villalba

We propose a novel approach for spoofed speech characterization through explainable probabilistic attribute embeddings. In contrast to high-dimensional raw embeddings extracted from a spoofing countermeasure (CM) whose dimensions are not…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-18 Manasi Chhibber , Jagabandhu Mishra , Hyejin Shim , Tomi H. Kinnunen

A number of studies have successfully developed speaker verification or presentation attack detection systems. However, studies integrating the two tasks remain in the preliminary stages. In this paper, we propose two approaches for…

Audio and Speech Processing · Electrical Eng. & Systems 2020-09-29 Hye-jin Shim , Jee-weon Jung , Ju-ho Kim , Seung-bin Kim , Ha-Jin Yu

Audio deepfake detection is crucial to combat the malicious use of AI-synthesized speech. Among many efforts undertaken by the community, the ASVspoof challenge has become one of the benchmarks to evaluate the generalizability and…

Audio and Speech Processing · Electrical Eng. & Systems 2024-10-11 Yi Zhu , Chirag Goel , Surya Koppisetti , Trang Tran , Ankur Kumar , Gaurav Bharaj

Commonly used automatic speech recognition (ASR) systems can be classified into frame-synchronous and label-synchronous categories, based on whether the speech is decoded on a per-frame or per-label basis. Frame-synchronous systems, such as…

Audio and Speech Processing · Electrical Eng. & Systems 2021-07-05 Qiujia Li , Chao Zhang , Philip C. Woodland

Self-Supervised Learning (SSL) has led to considerable progress in Speaker Verification (SV). The standard framework uses same-utterance positive sampling and data-augmentation to generate anchor-positive pairs of the same speaker. This is…

Audio and Speech Processing · Electrical Eng. & Systems 2025-08-20 Theo Lepage , Reda Dehak

Automatic speaker verification (ASV) vendors and corpus providers would both benefit from tools to reliably extrapolate performance metrics for large speaker populations without collecting new speakers. We address false alarm rate…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-11 Alexey Sholokhov , Tomi Kinnunen , Ville Vestman , Kong Aik Lee

Explaining the decisions made by audio spoofing detection models is crucial for fostering trust in detection outcomes. However, current research on the interpretability of detection models is limited to applying XAI tools to post-trained…

Sound · Computer Science 2025-07-28 Menglu Li , Xiao-Ping Zhang

This paper presents Seewo's systems for both tracks of the Multilingual Conversational Speech Language Model Challenge (MLC-SLM), addressing automatic speech recognition (ASR) and speaker diarization with ASR (SD-ASR). We introduce a…

Computation and Language · Computer Science 2025-06-19 Bo Li , Chengben Xu , Wufeng Zhang

Speaker verification systems are vulnerable to spoofing attacks which presents a major problem in their real-life deployment. To date, most of the proposed synthetic speech detectors (SSDs) have weighted the importance of different segments…

Sound · Computer Science 2016-10-11 Ali Khodabakhsh , Cenk Demiroglu

The goal of self-supervised learning (SSL) for automatic speech recognition (ASR) is to learn good speech representations from a large amount of unlabeled speech for the downstream ASR task. However, most SSL frameworks do not consider…

Computation and Language · Computer Science 2022-01-27 Yiming Wang , Jinyu Li , Heming Wang , Yao Qian , Chengyi Wang , Yu Wu

Recent developments in Self-Supervised Learning (SSL) have demonstrated significant potential for Speaker Verification (SV), but closing the performance gap with supervised systems remains an ongoing challenge. SSL frameworks rely on…

Audio and Speech Processing · Electrical Eng. & Systems 2025-07-28 Theo Lepage , Reda Dehak

This paper describes speaker verification (SV) systems submitted by the SpeakIn team to the Task 1 and Task 2 of the Far-Field Speaker Verification Challenge 2022 (FFSVC2022). SV tasks of the challenge focus on the problem of fully…

Sound · Computer Science 2022-09-26 Yu Zheng , Jinghan Peng , Yihao Chen , Yajun Zhang , Jialong Wang , Min Liu , Minqiang Xu

High-performance anti-spoofing models for automatic speaker verification (ASV), have been widely used to protect ASV by identifying and filtering spoofing audio that is deliberately generated by text-to-speech, voice conversion, audio…

Audio and Speech Processing · Electrical Eng. & Systems 2020-12-08 Haibin Wu , Andy T. Liu , Hung-yi Lee

Pitch scaling algorithms have a significant impact on the security of Automatic Speaker Verification (ASV) systems. Although numerous anti-spoofing algorithms have been proposed to identify the pitch-shifted voice and even restore it to the…

Sound · Computer Science 2023-03-14 Yangfu Li , Xiaodan Lin , Jiaxin Yang