English
Related papers

Related papers: Pushing the Frontiers of Self-Distillation Prototy…

200 papers

In this paper, we propose a new pooling method called spatial pyramid encoding (SPE) to generate speaker embeddings for text-independent speaker verification. We first partition the output feature maps from a deep residual network (ResNet)…

Audio and Speech Processing · Electrical Eng. & Systems 2019-12-30 Youngmoon Jung , Younggwan Kim , Hyungjun Lim , Yeunju Choi , Hoirin Kim

Self-supervised learning (SSL) has drawn an increased attention in the field of speech processing. Recent studies have demonstrated that contrastive learning is able to learn discriminative speaker embeddings in a self-supervised manner.…

Audio and Speech Processing · Electrical Eng. & Systems 2022-11-23 Chunlei Zhang , Dong Yu

Knowledge distillation (KD) is used to enhance automatic speaker verification performance by ensuring consistency between large teacher networks and lightweight student networks at the embedding level or label level. However, the…

Sound · Computer Science 2024-06-28 Duc-Tuan Truong , Ruijie Tao , Jia Qi Yip , Kong Aik Lee , Eng Siong Chng

For self-supervised speaker verification, the quality of pseudo labels decides the upper bound of the system due to the massive unreliable labels. In this work, we propose dynamic loss-gate and label correction (DLG-LC) to alleviate the…

Sound · Computer Science 2022-08-04 Bing Han , Zhengyang Chen , Yanmin Qian

For many years, i-vector based audio embedding techniques were the dominant approach for speaker verification and speaker diarization applications. However, mirroring the rise of deep learning in various domains, neural network based audio…

Audio and Speech Processing · Electrical Eng. & Systems 2022-01-25 Quan Wang , Carlton Downey , Li Wan , Philip Andrew Mansfield , Ignacio Lopez Moreno

Modern automatic speaker verification relies largely on deep neural networks (DNNs) trained on mel-frequency cepstral coefficient (MFCC) features. While there are alternative feature extraction methods based on phase, prosody and long-term…

Audio and Speech Processing · Electrical Eng. & Systems 2020-07-31 Xuechen Liu , Md Sahidullah , Tomi Kinnunen

This paper explores three novel approaches to improve the performance of speaker verification (SV) systems based on deep neural networks (DNN) using Multi-head Self-Attention (MSA) mechanisms and memory layers. Firstly, we propose the use…

Audio and Speech Processing · Electrical Eng. & Systems 2023-02-13 Victoria Mingote , Antonio Miguel , Alfonso Ortega , Eduardo Lleida

Speaker Verification (SV) systems involve mainly two individual stages: feature extraction and classification. In this paper, we explore these two modules with the aim of improving the performance of a speaker verification system under…

Audio and Speech Processing · Electrical Eng. & Systems 2024-02-06 Kerlos Atia Abdalmalak , Ascensión Gallardo-Antol'in

Speaker representation learning is crucial for voice recognition systems, with recent advances in self-supervised approaches reducing dependency on labeled data. Current two-stage iterative frameworks, while effective, suffer from…

Audio and Speech Processing · Electrical Eng. & Systems 2025-06-03 Danwei Cai , Zexin Cai , Ze Li , Ming Li

The development of deep neural networks (DNN) has significantly enhanced the performance of speaker verification (SV) systems in recent years. However, a critical issue that persists when applying DNN-based SV systems in practical…

Audio and Speech Processing · Electrical Eng. & Systems 2023-09-26 Jingyu Li , Tan Lee

In this paper, we investigate distillation and pruning methods to reduce model size for non-intrusive speech quality assessment based on self-supervised representations. Our experiments build on XLS-R-SQA, a speech quality assessment model…

Audio and Speech Processing · Electrical Eng. & Systems 2025-02-11 Benjamin Stahl , Hannes Gamper

Recently, speaker embeddings extracted with deep neural networks became the state-of-the-art method for speaker verification. In this paper we aim to facilitate its implementation on a more generic toolkit than Kaldi, which we anticipate to…

Sound · Computer Science 2018-11-07 Hossein Zeinali , Lukas Burget , Johan Rohdin , Themos Stafylakis , Jan Cernocky

Speaker verification is an established yet challenging task in speech processing and a very vibrant research area. Recent speaker verification (SV) systems rely on deep neural networks to extract high-level embeddings which are able to…

Audio and Speech Processing · Electrical Eng. & Systems 2020-03-23 Fei Tao , Gokhan Tur

After their introduction to robust speech recognition, power normalized cepstral coefficient (PNCC) features were successfully adopted to other tasks, including speaker verification. However, as a feature extractor with long-term operations…

Sound · Computer Science 2021-09-27 Xuechen Liu , Md Sahidullah , Tomi Kinnunen

In this study, we investigate self-supervised representation learning for speaker verification (SV). First, we examine a simple contrastive learning approach (SimCLR) with a momentum contrastive (MoCo) learning framework, where the MoCo…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-16 Wei Xia , Chunlei Zhang , Chao Weng , Meng Yu , Dong Yu

One of the most important parts of an end-to-end speaker verification system is the speaker embedding generation. In our previous paper, we reported that shortcut connections-based multi-layer aggregation improves the representational power…

Audio and Speech Processing · Electrical Eng. & Systems 2020-07-29 Soonshin Seo , Ji-Hwan Kim

Self-supervised learning (SSL) has transformed speech processing, with benchmarks such as SUPERB establishing fair comparisons across diverse downstream tasks. Despite it's security-critical importance, Audio deepfake detection has remained…

Audio and Speech Processing · Electrical Eng. & Systems 2026-04-10 Hashim Ali , Nithin Sai Adupa , Surya Subramani , Hafiz Malik

As Deep Neural Networks (DNNs) rapidly advance in various fields, including speech verification, they typically involve high computational costs and substantial memory consumption, which can be challenging to manage on mobile systems.…

Audio and Speech Processing · Electrical Eng. & Systems 2024-07-15 Yeona Hong , Woo-Jin Chung , Hong-Goo Kang

Speaker verification (SV) suffers from unsatisfactory performance in far-field scenarios due to environmental noise andthe adverse impact of room reverberation. This work presents a benchmark of multichannel speech enhancement for…

The application of speech self-supervised learning (SSL) models has achieved remarkable performance in speaker verification (SV). However, there is a computational cost hurdle in employing them, which makes development and deployment…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-09 Jungwoo Heo , Chan-yeong Lim , Ju-ho Kim , Hyun-seo Shin , Ha-Jin Yu