English
Related papers

Related papers: Lightweight Speaker Verification Using Transformat…

200 papers

In this paper, Whisper, a large-scale pre-trained model for automatic speech recognition, is proposed to apply to speaker verification. A partial multi-scale feature aggregation (PMFA) approach is proposed based on a subset of Whisper…

Sound · Computer Science 2024-08-29 Yiyang Zhao , Shuai Wang , Guangzhi Sun , Zehua Chen , Chao Zhang , Mingxing Xu , Thomas Fang Zheng

Speaker verification has been widely explored using speech signals, which has shown significant improvement using deep models. Recently, there has been a surge in exploring faces and voices as they can offer more complementary and…

Sound · Computer Science 2023-09-29 R. Gnana Praveen , Jahangir Alam

In recent years, self-supervised learning paradigm has received extensive attention due to its great success in various down-stream tasks. However, the fine-tuning strategies for adapting those pre-trained models to speaker verification…

Audio and Speech Processing · Electrical Eng. & Systems 2022-10-05 Junyi Peng , Oldrich Plchot , Themos Stafylakis , Ladislav Mosner , Lukas Burget , Jan Cernocky

In this paper, a novel architecture for speaker recognition is proposed by cascading speech enhancement and speaker processing. Its aim is to improve speaker recognition performance when speech signals are corrupted by noise. Instead of…

Computation and Language · Computer Science 2020-05-25 Yanpei Shi , Qiang Huang , Thomas Hain

Traditional Time Delay Neural Networks (TDNN) have achieved state-of-the-art performance at the cost of high computational complexity and slower inference speed, making them difficult to implement in an industrial environment. The Densely…

Computation and Language · Computer Science 2024-02-13 Di Cao , Xianchen Wang , Junfeng Zhou , Jiakai Zhang , Yanjing Lei , Wenpeng Chen

Although speaker verification has conventionally been an audio-only task, some practical applications provide both audio and visual streams of input. In these cases, the visual stream provides complementary information and can often be…

Sound · Computer Science 2021-02-15 Leda Sarı , Kritika Singh , Jiatong Zhou , Lorenzo Torresani , Nayan Singhal , Yatharth Saraf

Spoofing-robust speaker verification (SASV) combines the tasks of speaker and spoof detection to authenticate speakers under adversarial settings. Many SASV systems rely on fusion of speaker and spoof cues at embedding, score or decision…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-31 Oğuzhan Kurnaz , Jagabandhu Mishra , Tomi H. Kinnunen , Cemal Hanilçi

In this paper, we present Multi-scale Feature Aggregation Conformer (MFA-Conformer), an easy-to-implement, simple but effective backbone for automatic speaker verification based on the Convolution-augmented Transformer (Conformer). The…

Sound · Computer Science 2022-11-14 Yang Zhang , Zhiqiang Lv , Haibin Wu , Shanshan Zhang , Pengfei Hu , Zhiyong Wu , Hung-yi Lee , Helen Meng

A number of studies have successfully developed speaker verification or presentation attack detection systems. However, studies integrating the two tasks remain in the preliminary stages. In this paper, we propose two approaches for…

Audio and Speech Processing · Electrical Eng. & Systems 2020-09-29 Hye-jin Shim , Jee-weon Jung , Ju-ho Kim , Seung-bin Kim , Ha-Jin Yu

Verifying if two audio segments belong to the same speaker has been recently put forward as a flexible way to carry out speaker identification, since it does not require to be re-trained when new speakers appear on the auditory scene.…

Audio and Speech Processing · Electrical Eng. & Systems 2020-10-26 Ivette Velez , Caleb Rascon , Gibran Fuentes-Pineda

Trained on 680,000 hours of massive speech data, Whisper is a multitasking, multilingual speech foundation model demonstrating superior performance in automatic speech recognition, translation, and language identification. However, its…

Sound · Computer Science 2024-07-16 Li Zhang , Ning Jiang , Qing Wang , Yue Li , Quan Lu , Lei Xie

Speech synthesis technology has posed a serious threat to speaker verification systems. Currently, the most effective fake audio detection methods utilize pretrained models, and integrating features from various layers of pretrained model…

Speaker verification systems have been used in many production scenarios in recent years. Unfortunately, they are still highly prone to different kinds of spoofing attacks such as voice conversion and speech synthesis, etc. In this paper,…

Audio and Speech Processing · Electrical Eng. & Systems 2021-09-07 Junxiao Xue , Hao Zhou , Yabo Wang

One of the most important parts of an end-to-end speaker verification system is the speaker embedding generation. In our previous paper, we reported that shortcut connections-based multi-layer aggregation improves the representational power…

Audio and Speech Processing · Electrical Eng. & Systems 2020-07-29 Soonshin Seo , Ji-Hwan Kim

Despite achieving satisfactory performance in speaker verification using deep neural networks, variable-duration utterances remain a challenge that threatens the robustness of systems. To deal with this issue, we propose a speaker…

Audio and Speech Processing · Electrical Eng. & Systems 2022-06-28 Ju-ho Kim , Hye-jin Shim , Jungwoo Heo , Ha-Jin Yu

Speaker verification (SV) utilizing features obtained from models pre-trained via self-supervised learning has recently demonstrated impressive performances. However, these pre-trained models (PTMs) usually have a temporal resolution of 20…

Audio and Speech Processing · Electrical Eng. & Systems 2026-01-28 Jisoo Myoung , Sangwook Han , Kihyuk Kim , Jong Won Shin

Recently, there have been significant advancements in voice conversion, resulting in high-quality performance. However, there are still two critical challenges in this field. Firstly, current voice conversion methods have limited robustness…

Sound · Computer Science 2024-08-13 Le Xu , Jiangyan Yi , Tao Wang , Yong Ren , Rongxiu Zhong , Zhengqi Wen , Jianhua Tao

Recent years have witnessed the extraordinary development of automatic speaker verification (ASV). However, previous works show that state-of-the-art ASV models are seriously vulnerable to voice spoofing attacks, and the recently proposed…

Sound · Computer Science 2022-06-22 Haibin Wu , Jiawen Kang , Lingwei Meng , Yang Zhang , Xixin Wu , Zhiyong Wu , Hung-yi Lee , Helen Meng

In recent years, using raw waveforms as input for deep networks has been widely explored for the speaker verification system. For example, RawNet and RawNet2 extracted speaker's feature embeddings from waveforms automatically for…

Audio and Speech Processing · Electrical Eng. & Systems 2021-10-08 Jin Li , Nan Yan , Lan Wang

Recently, direct modeling of raw waveforms using deep neural networks has been widely studied for a number of tasks in audio domains. In speaker verification, however, utilization of raw waveforms is in its preliminary phase, requiring…

Audio and Speech Processing · Electrical Eng. & Systems 2019-07-18 Jee-weon Jung , Hee-Soo Heo , Ju-ho Kim , Hye-jin Shim , Ha-Jin Yu