中文
相关论文

相关论文: Lightweight Speaker Verification Using Transformat…

200 篇论文

Pooling is needed to aggregate frame-level features into utterance-level representations for speaker modeling. Given the success of statistics-based pooling methods, we hypothesize that speaker characteristics are well represented in the…

音频与语音处理 · 电气工程与系统科学 2022-06-28 Yusheng Tian , Jingyu Li , Tan Lee

In this paper, a novel Convolutional Neural Network architecture has been developed for speaker verification in order to simultaneously capture and discard speaker and non-speaker information, respectively. In training phase, the network is…

音频与语音处理 · 电气工程与系统科学 2018-08-13 Hossein Salehghaffari

This technical report describes the IDLab submission for track 1 and 2 of the VoxCeleb Speaker Recognition Challenge 2021 (VoxSRC-21). This speaker verification competition focuses on short duration test recordings and cross-lingual trials.…

音频与语音处理 · 电气工程与系统科学 2021-09-10 Jenthe Thienpondt , Brecht Desplanques , Kris Demuynck

While promising performance for speaker verification has been achieved by deep speaker embeddings, the advantage would reduce in the case of speaking-style variability. Speaking rate mismatch is often observed in practical speaker…

音频与语音处理 · 电气工程与系统科学 2022-05-31 Fuchuan Tong , Siqi Zheng , Haodong Zhou , Xingjia Xie , Qingyang Hong , Lin Li

Audio-visual speaker tracking aims to determine the location of human targets in a scene using signals captured by a multi-sensor platform, whose accuracy and robustness can be improved by multi-modal fusion methods. Recently, several…

计算机视觉与模式识别 · 计算机科学 2024-10-10 Yidi Li , Hong Liu , Bing Yang

In recent years, a great deal of attention has been paid to the Transformer network for speech recognition tasks due to its excellent model performance. However, the Transformer network always involves heavy computation and large number of…

声音 · 计算机科学 2023-04-12 Guangyong Wei , Zhikui Duan , Shiren Li , Guangguang Yang , Xinmei Yu , Junhua Li

Automatic speaker verification, like every other biometric system, is vulnerable to spoofing attacks. Using only a few minutes of recorded voice of a genuine client of a speaker verification system, attackers can develop a variety of…

声音 · 计算机科学 2019-06-20 Balamurali BT , Kin Wah Edward Lin , Simon Lui , Jer-Ming Chen , Dorien Herremans

The performances of the automatic speaker verification (ASV) systems degrade due to the reduction in the amount of speech used for enrollment and verification. Combining multiple systems based on different features and classifiers…

计算机视觉与模式识别 · 计算机科学 2019-02-01 Arnab Poddar , Md Sahidullah , Goutam Saha

In this paper, we propose an innovative approach to perform speaker recognition by fusing two recently introduced deep neural networks (DNNs) namely - SincNet and X-Vector. The idea behind using SincNet filters on the raw speech waveform is…

计算与语言 · 计算机科学 2020-04-07 Mayank Tripathi , Divyanshu Singh , Seba Susan

This paper explores the use of ASR-pretrained Conformers for speaker verification, leveraging their strengths in modeling speech signals. We introduce three strategies: (1) Transfer learning to initialize the speaker embedding network,…

音频与语音处理 · 电气工程与系统科学 2024-07-17 Danwei Cai , Ming Li

This paper describes the NPU system submitted to Spoofing Aware Speaker Verification Challenge 2022. We particularly focus on the \textit{backend ensemble} for speaker verification and spoofing countermeasure from three aspects. Firstly,…

声音 · 计算机科学 2022-09-26 Li Zhang , Yue Li , Huan Zhao , Qing Wang , Lei Xie

Transformer models have been used in automatic speech recognition (ASR) successfully and yields state-of-the-art results. However, its performance is still affected by speaker mismatch between training and test data. Further finetuning a…

音频与语音处理 · 电气工程与系统科学 2021-10-19 Yingzhu Zhao , Chongjia Ni , Cheung-Chi Leung , Shafiq Joty , Eng Siong Chng , Bin Ma

Transformer-based architectures for speaker verification typically require more training data than ECAPA-TDNN. Therefore, recent work has generally been trained on VoxCeleb1&2. We propose a backbone network based on self-attention, which…

声音 · 计算机科学 2024-05-31 Nian Li , Jianguo Wei

We propose semantic fusion, a lightweight scheme that augments a Transformer language model (LM) with a parallel, fuzzy-membership feature channel that encodes token-level semantics. Each token is represented by a vector of interpretable…

人工智能 · 计算机科学 2025-09-18 Yongchao Huang , Hassan Raza

Voice disorders negatively impact the quality of daily life in various ways. However, accurately recognizing the category of pathological features from raw audio remains a considerable challenge due to the limited dataset. A promising…

声音 · 计算机科学 2024-10-08 Lipeng Shen , Yifan Xiong , Dongyue Guo , Wei Mo , Lingyu Yu , Hui Yang , Yi Lin

In the field of speaker verification, session or channel variability poses a significant challenge. While many contemporary methods aim to disentangle session information from speaker embeddings, we introduce a novel approach using an…

音频与语音处理 · 电气工程与系统科学 2023-09-27 Hee-Soo Heo , KiHyun Nam , Bong-Jin Lee , Youngki Kwon , Minjae Lee , You Jin Kim , Joon Son Chung

This paper introduces an efficient and accurate pipeline for text-dependent speaker verification (TDSV), designed to address the need for high-performance biometric systems. The proposed system incorporates a Fast-Conformer-based ASR module…

声音 · 计算机科学 2024-11-26 Mohammadreza Molavi , Reza Khodadadi

Current multi-modal image fusion methods typically rely on task-specific models, leading to high training costs and limited scalability. While generative methods provide a unified modeling perspective, they often suffer from slow inference…

计算机视觉与模式识别 · 计算机科学 2025-11-19 Huayi Zhu , Xiu Shu , Youqiang Xiong , Qiao Liu , Rui Chen , Di Yuan , Xiaojun Chang , Zhenyu He

Speaker verification (SV) provides billions of voice-enabled devices with access control, and ensures the security of voice-driven technologies. As a type of biometrics, it is necessary that SV is unbiased, with consistent and reliable…

音频与语音处理 · 电气工程与系统科学 2022-09-14 Wiebke Toussaint Hutiri , Lauriane Gorce , Aaron Yi Ding

In speaker verification, ECAPA-TDNN has shown remarkable improvement by utilizing one-dimensional(1D) Res2Net block and squeeze-and-excitation(SE) module, along with multi-layer feature aggregation (MFA). Meanwhile, in vision tasks, ConvNet…

音频与语音处理 · 电气工程与系统科学 2026-04-01 Hyun-Jun Heo , Ui-Hyeop Shin , Ran Lee , YoungJu Cheon , Hyung-Min Park