English
Related papers

Related papers: Lightweight Speaker Verification Using Transformat…

200 papers

In this study, we propose the global context guided channel and time-frequency transformations to model the long-range, non-local time-frequency dependencies and channel variances in speaker representations. We use the global context…

Audio and Speech Processing · Electrical Eng. & Systems 2020-09-10 Wei Xia , John H. L. Hansen

This paper aims to improve the widely used deep speaker embedding x-vector model. We propose the following improvements: (1) a hybrid neural network structure using both time delay neural network (TDNN) and long short-term memory neural…

Computation and Language · Computer Science 2019-02-22 Yun Tang , Guohong Ding , Jing Huang , Xiaodong He , Bowen Zhou

Many existing speaker verification systems are reported to be vulnerable against different spoofing attacks, for example speaker-adapted speech synthesis, voice conversion, play back, etc. In order to detect these spoofed speech signals as…

Sound · Computer Science 2015-07-30 Shitao Weng , Shushan Chen , Lei Yu , Xuewei Wu , Weicheng Cai , Zhi Liu , Ming Li

In recent years, speaker verification has primarily performed using deep neural networks that are trained to output embeddings from input features such as spectrograms or Mel-filterbank energies. Studies that design various loss functions,…

Audio and Speech Processing · Electrical Eng. & Systems 2019-07-18 Hee-Soo Heo , Jee-weon Jung , IL-Ho Yang , Sung-Hyun Yoon , Hye-jin Shim , Ha-Jin Yu

Speaker recognition technology is applied to various tasks, from personal virtual assistants to secure access systems. However, the robustness of these systems against adversarial attacks, particularly to additive perturbations, remains a…

Sound · Computer Science 2024-12-19 Dmitrii Korzh , Elvir Karimov , Mikhail Pautov , Oleg Y. Rogov , Ivan Oseledets

Speech enhancement is a demanding task in automated speech processing pipelines, focusing on separating clean speech from noisy channels. Transformer based models have recently bested RNN and CNN models in speech enhancement, however at the…

Sound · Computer Science 2023-08-07 Jinyu Long , Jetic Gū , Binhao Bai , Zhibo Yang , Ping Wei , Junli Li

This paper is concerned with the task of speaker verification on audio with multiple overlapping speakers. Most speaker verification systems are designed with the assumption of a single speaker being present in a given audio segment.…

Audio and Speech Processing · Electrical Eng. & Systems 2023-04-10 Jenthe Thienpondt , Nilesh Madhu , Kris Demuynck

Voice recognition and speaker identification are vital for applications in security and personal assistants. This paper presents a lightweight 1D-Convolutional Neural Network (1D-CNN) designed to perform speaker identification on minimal…

Sound · Computer Science 2024-11-25 Irfan Nafiz Shahan , Pulok Ahmed Auvi

In dysarthric speech recognition, data scarcity and the vast diversity between dysarthric speakers pose significant challenges. While finetuning has been a popular solution, it can lead to overfitting and low parameter efficiency. Adapter…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-13 Jinzi Qi , Hugo Van hamme

In recent years, speaker recognition systems based on raw waveform inputs have received increasing attention. However, the performance of such systems are typically inferior to the state-of-the-art handcrafted feature-based counterparts,…

Audio and Speech Processing · Electrical Eng. & Systems 2022-03-30 Jee-weon Jung , You Jin Kim , Hee-Soo Heo , Bong-Jin Lee , Youngki Kwon , Joon Son Chung

Phase-based features related to vocal source characteristics can be incorporated into magnitude-based speaker recognition systems to improve the system performance. However, traditional feature-level fusion methods typically ignore the…

Audio and Speech Processing · Electrical Eng. & Systems 2025-10-20 Rongfeng Su , Mengjie Du , Xiaokang Liu , Lan Wang , Nan Yan

Incremental improvements in accuracy of Convolutional Neural Networks are usually achieved through use of deeper and more complex models trained on larger datasets. However, enlarging dataset and models increases the computation and storage…

Audio and Speech Processing · Electrical Eng. & Systems 2018-07-24 Mahdi Hajibabaei , Dengxin Dai

Fusing outputs from automatic speaker verification (ASV) and spoofing countermeasure (CM) is expected to make an integrated system robust to zero-effort imposters and synthesized spoofing attacks. Many score-level fusion methods have been…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-25 Xin Wang , Tomi Kinnunen , Kong Aik Lee , Paul-Gauthier Noé , Junichi Yamagishi

Audio-visual speech recognition (AVSR) typically improves recognition accuracy in noisy environments by integrating noise-immune visual cues with audio signals. Nevertheless, high-noise audio inputs are prone to introducing adverse…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-09 Linzhi Wu , Xingyu Zhang , Hao Yuan , Yakun Zhang , Changyan Zheng , Liang Xie , Tiejun Liu , Erwei Yin

This paper proposes the target speaker enhancement based speaker verification network (TASE-SVNet), an all neural model that couples target speaker enhancement and speaker embedding extraction for robust speaker verification (SV).…

Audio and Speech Processing · Electrical Eng. & Systems 2021-03-17 Chunlei Zhang , Meng Yu , Chao Weng , Dong Yu

When trained at a sufficient scale, self-supervised learning has exhibited a notable ability to solve a wide range of visual or language understanding tasks. In this paper, we investigate simple, yet effective approaches for adapting the…

Computer Vision and Pattern Recognition · Computer Science 2022-10-28 Chaofan Ma , Yuhuan Yang , Yanfeng Wang , Ya Zhang , Weidi Xie

Large-scale self-supervised Pre-Trained Models (PTMs) have shown significant improvements in the speaker verification (SV) task by providing rich feature representations. In this paper, we utilize w2v-BERT 2.0, a model with approximately…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-10 Ze Li , Ming Cheng , Ming Li

An important step in speaker verification is extracting features that best characterize the speaker voice. This paper investigates a front-end processing that aims at improving the performance of speaker verification based on the SVMs…

Machine Learning · Computer Science 2013-06-13 Kawthar Yasmine Zergat , Abderrahmane Amrouche

Precise control over speech characteristics, such as pitch, duration, and speech rate, remains a significant challenge in the field of voice conversion. The ability to manipulate parameters like pitch and syllable rate is an important…

Sound · Computer Science 2025-07-08 Mathilde Abrassart , Nicolas Obin , Axel Roebel

Voice Activity Detection (VAD) plays a key role in speech processing, often utilizing hand-crafted or neural features. This study examines the effectiveness of Mel-Frequency Cepstral Coefficients (MFCCs) and pre-trained model (PTM)…

Sound · Computer Science 2025-06-03 Kumud Tripathi , Chowdam Venkata Kumar , Pankaj Wasnik