English
Related papers

Related papers: Robust Speaker Recognition with Transformers Using…

200 papers

The wav2vec 2.0 and integrated spectro-temporal graph attention network (AASIST) based countermeasure achieves great performance in speech anti-spoofing. However, current spoof speech detection systems have fixed training and evaluation…

Audio and Speech Processing · Electrical Eng. & Systems 2024-01-05 Yuxiang Zhang , Jingze Lu , Zengqiang Shang , Wenchao Wang , Pengyuan Zhang

This paper describes speaker verification (SV) systems submitted by the SpeakIn team to the Task 1 and Task 2 of the Far-Field Speaker Verification Challenge 2022 (FFSVC2022). SV tasks of the challenge focus on the problem of fully…

Sound · Computer Science 2022-09-26 Yu Zheng , Jinghan Peng , Yihao Chen , Yajun Zhang , Jialong Wang , Min Liu , Minqiang Xu

Accurately detecting voiced intervals in speech signals is a critical step in pitch tracking and has numerous applications. While conventional signal processing methods and deep learning algorithms have been proposed for this task, their…

Audio and Speech Processing · Electrical Eng. & Systems 2023-12-07 Yixuan Zhang , Heming Wang , DeLiang Wang

The deep learning models used for speaker verification rely heavily on large amounts of data and correct labeling. However, noisy (incorrect) labels often occur, which degrades the performance of the system. In this paper, we propose a…

Sound · Computer Science 2026-04-29 Zhihua Fang , Liang He , Hanhan Ma , Xiaochen Guo , Lin Li

The ResNet-based architecture has been widely adopted to extract speaker embeddings for text-independent speaker verification systems. By introducing the residual connections to the CNN and standardizing the residual blocks, the ResNet…

Audio and Speech Processing · Electrical Eng. & Systems 2020-12-01 Tianyan Zhou , Yong Zhao , Jian Wu

Explaining the decisions made by audio spoofing detection models is crucial for fostering trust in detection outcomes. However, current research on the interpretability of detection models is limited to applying XAI tools to post-trained…

Sound · Computer Science 2025-07-28 Menglu Li , Xiao-Ping Zhang

This paper presents SpecWav-Attack, an adversarial model for detecting speakers in anonymized speech. It leverages Wav2Vec2 for feature extraction and incorporates spectrogram resizing and incremental training for improved performance.…

Sound · Computer Science 2025-05-16 Yuqi Li , Yuanzhong Zheng , Zhongtian Guo , Yaoxuan Wang , Jianjun Yin , Haojun Fei

This paper presents an improved deep embedding learning method based on convolutional neural network (CNN) for text-independent speaker verification. Two improvements are proposed for x-vector embedding learning: (1) Multi-scale convolution…

Audio and Speech Processing · Electrical Eng. & Systems 2020-01-15 Bin Gu , Wu Guo

In this paper we describe the recent advancements made in the IBM i-vector speaker recognition system for conversational speech. In particular, we identify key techniques that contribute to significant improvements in performance of our…

Sound · Computer Science 2016-02-24 Seyed Omid Sadjadi , Sriram Ganapathy , Jason W. Pelecanos

This paper presents an experimental study on deep speaker embedding with an attention mechanism that has been found to be a powerful representation learning technique in speaker recognition. In this framework, an attention model works as a…

Sound · Computer Science 2018-09-26 Qiongqiong Wang , Koji Okabe , Kong Aik Lee , Hitoshi Yamamoto , Takafumi Koshinaka

Deep learning has become a de facto method of choice for speech enhancement tasks with significant improvements in speech quality. However, real-time processing with reduced size and computations for low-power edge devices drastically…

Audio and Speech Processing · Electrical Eng. & Systems 2024-05-28 Monisankha Pal , Arvind Ramanathan , Ted Wada , Ashutosh Pandey

This paper presents XLSR which learns cross-lingual speech representations by pretraining a single model from the raw waveform of speech in multiple languages. We build on wav2vec 2.0 which is trained by solving a contrastive task over…

Computation and Language · Computer Science 2020-12-17 Alexis Conneau , Alexei Baevski , Ronan Collobert , Abdelrahman Mohamed , Michael Auli

This paper presents XLS-R, a large-scale model for cross-lingual speech representation learning based on wav2vec 2.0. We train models with up to 2B parameters on nearly half a million hours of publicly available speech audio in 128…

Recently, speaker embeddings extracted from a speaker discriminative deep neural network (DNN) yield better performance than the conventional methods such as i-vector. In most cases, the DNN speaker classifier is trained using cross entropy…

Audio and Speech Processing · Electrical Eng. & Systems 2019-06-19 Xu Xiang , Shuai Wang , Houjun Huang , Yanmin Qian , Kai Yu

In recent research, in the domain of speech processing, large End-to-End (E2E) systems for Automatic Speech Recognition (ASR) have reported state-of-the-art performance on various benchmarks. These systems intrinsically learn how to handle…

Computation and Language · Computer Science 2023-09-06 Patrick Eickhoff , Matthias Möller , Theresa Pekarek Rosin , Johannes Twiefel , Stefan Wermter

Recent advances in sophisticated synthetic speech generated from text-to-speech (TTS) or voice conversion (VC) systems cause threats to the existing automatic speaker verification (ASV) systems. Since such synthetic speech is generated from…

Audio and Speech Processing · Electrical Eng. & Systems 2022-12-15 Youngsik Eom , Yeonghyeon Lee , Ji Sub Um , Hoirin Kim

Speaker identification in multilingual settings presents unique challenges, particularly when conventional models are predominantly trained on English data. In this paper, we propose WSI (Whisper Speaker Identification), a framework that…

Sound · Computer Science 2025-03-14 Jakaria Islam Emon , Md Abu Salek , Kazi Tamanna Alam

Visual Speech Recognition (VSR) differs from the common perception tasks as it requires deeper reasoning over the video sequence, even by human experts. Despite the recent advances in VSR, current approaches rely on labeled data to fully…

Current leading mispronunciation detection and diagnosis (MDD) systems achieve promising performance via end-to-end phoneme recognition. One challenge of such end-to-end solutions is the scarcity of human-annotated phonemes on natural L2…

Audio and Speech Processing · Electrical Eng. & Systems 2022-07-13 Mu Yang , Kevin Hirschi , Stephen D. Looney , Okim Kang , John H. L. Hansen

Recently, speaker embeddings extracted with deep neural networks became the state-of-the-art method for speaker verification. In this paper we aim to facilitate its implementation on a more generic toolkit than Kaldi, which we anticipate to…

Sound · Computer Science 2018-11-07 Hossein Zeinali , Lukas Burget , Johan Rohdin , Themos Stafylakis , Jan Cernocky