English
Related papers

Related papers: Self-Supervised Frameworks for Speaker Verificatio…

200 papers

In recent years, self-supervised learning (SSL) frameworks have been extensively applied to sensor-based Human Activity Recognition (HAR) in order to learn deep representations without data annotations. While SSL frameworks reach…

Machine Learning · Computer Science 2023-08-01 Bulat Khaertdinov , Stylianos Asteriadis

In real application scenarios, it is often challenging to obtain a large amount of labeled data for speaker representation learning due to speaker privacy concerns. Self-supervised learning with no labels has become a more and more…

Sound · Computer Science 2022-11-28 Zhengyang Chen , Yao Qian , Bing Han , Yanmin Qian , Michael Zeng

Self-supervised learning (SSL) has recently shown remarkable results in closing the gap between supervised and unsupervised learning. The idea is to learn robust features that are invariant to distortions of the input data. Despite its…

Sound · Computer Science 2023-03-08 Bac Nguyen , Stefan Uhlich , Fabien Cardinaux

Recent semi-supervised learning (SSL) methods typically include a filtering strategy to improve the quality of pseudo labels. However, these filtering strategies are usually hand-crafted and do not change as the model is updated, resulting…

Machine Learning · Computer Science 2023-09-19 Lei Zhu , Zhanghan Ke , Rynson Lau

We investigate the performance of self-supervised pretraining frameworks on pathological speech datasets used for automatic speech recognition (ASR). Modern end-to-end models require thousands of hours of data to train well, but only a…

Sound · Computer Science 2022-06-30 Lester Phillip Violeta , Wen-Chin Huang , Tomoki Toda

Considering the abundance of unlabeled speech data and the high labeling costs, unsupervised learning methods can be essential for better system development. One of the most successful methods is contrastive self-supervised methods, which…

Audio and Speech Processing · Electrical Eng. & Systems 2022-08-11 Jaejin Cho , Raghavendra Pappagari , Piotr Żelasko , Laureano Moro-Velazquez , Jesús Villalba , Najim Dehak

Deep learning with noisy labels is a challenging task. Recent prominent methods that build on a specific sample selection (SS) strategy and a specific semi-supervised learning (SSL) model achieved state-of-the-art performance. Intuitively,…

Machine Learning · Computer Science 2020-12-03 Zhuowei Wang , Jing Jiang , Bo Han , Lei Feng , Bo An , Gang Niu , Guodong Long

This paper describes speaker verification (SV) systems submitted by the SpeakIn team to the Task 1 and Task 2 of the Far-Field Speaker Verification Challenge 2022 (FFSVC2022). SV tasks of the challenge focus on the problem of fully…

Sound · Computer Science 2022-09-26 Yu Zheng , Jinghan Peng , Yihao Chen , Yajun Zhang , Jialong Wang , Min Liu , Minqiang Xu

Spoofing attacks posed by generating artificial speech can severely degrade the performance of a speaker verification system. Recently, many anti-spoofing countermeasures have been proposed for detecting varying types of attacks from…

Audio and Speech Processing · Electrical Eng. & Systems 2020-12-08 Yuanjun Zhao , Roberto Togneri , Victor Sreeram

Background noise considerably reduces the accuracy and reliability of speaker verification (SV) systems. These challenges can be addressed using a speech enhancement system as a front-end module. Recently, diffusion probabilistic models…

Audio and Speech Processing · Electrical Eng. & Systems 2023-12-20 Ju-ho Kim , Jungwoo Heo , Hyun-seo Shin , Chan-yeong Lim , Ha-Jin Yu

Audio and speech self-supervised encoder models are now widely used for a lot of different tasks. Many of these models are often trained on clean segmented speech content such as LibriSpeech. In this paper, we look into how the pretraining…

Audio and Speech Processing · Electrical Eng. & Systems 2026-04-13 Valentin Pelloin , Lina Bekkali , Reda Dehak , David Doukhan

Self-supervised learning (SSL)-based speech models are extensively used for full-stack speech processing. However, it has been observed that improving SSL-based speech representations using unlabeled speech for content-related tasks is…

Computation and Language · Computer Science 2024-06-14 Amit Meghanani , Thomas Hain

In real-world applications, it is challenging to build a speaker verification system that is simultaneously robust against common threats, including spoofing attacks, channel mismatch, and domain mismatch. Traditional automatic speaker…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-11 Chang Zeng , Xiaoxiao Miao , Xin Wang , Erica Cooper , Junichi Yamagishi

Self-supervised learning algorithms (SSL) based on instance discrimination have shown promising results, performing competitively or even outperforming supervised learning counterparts in some downstream tasks. Such approaches employ data…

Computer Vision and Pattern Recognition · Computer Science 2025-05-01 Mohammad Alkhalefi , Georgios Leontidis , Mingjun Zhong

Inspired by the humans' cognitive ability to generalise knowledge and skills, Self-Supervised Learning (SSL) targets at discovering general representations from large-scale data without requiring human annotations, which is an expensive and…

Voice anti-spoofing systems are crucial auxiliaries for automatic speaker verification (ASV) systems. A major challenge is caused by unseen attacks empowered by advanced speech synthesis technologies. Our previous research on one-class…

Audio and Speech Processing · Electrical Eng. & Systems 2022-11-08 Siwen Ding , You Zhang , Zhiyao Duan

Self-supervised learning (SSL) methods have proven to be very successful in automatic speech recognition (ASR). These great improvements have been reported mostly based on highly curated datasets such as LibriSpeech for non-streaming…

Sound · Computer Science 2022-05-19 Mostafa Karimi , Changliang Liu , Kenichi Kumatani , Yao Qian , Tianyu Wu , Jian Wu

Methods for extracting audio and speech features have been studied since pioneering work on spectrum analysis decades ago. Recent efforts are guided by the ambition to develop general-purpose audio representations. For example, deep neural…

Over the last few years, deep learning has grown in popularity for speaker verification, identification, and diarization. Inarguably, a significant part of this success is due to the demonstrated effectiveness of their speaker…

Sound · Computer Science 2022-10-07 Yehoshua Dissen , Felix Kreuk , Joseph Keshet

Self-supervised learning (SSL) leverages large datasets of unlabeled speech to reach impressive performance with reduced amounts of annotated data. The high number of proposed approaches fostered the emergence of comprehensive benchmarks…

Audio and Speech Processing · Electrical Eng. & Systems 2024-02-22 Salah Zaiem , Youcef Kemiche , Titouan Parcollet , Slim Essid , Mirco Ravanelli