English
Related papers

Related papers: Learning Speaker Embedding with Momentum Contrast

200 papers

Automatic Speaker Verification (ASV) suffers from performance degradation in noisy conditions. To address this issue, we propose a novel adversarial learning framework that incorporates noise-disentanglement to establish a noise-independent…

Sound · Computer Science 2024-09-27 Xujiang Xing , Mingxing Xu , Thomas Fang Zheng

This paper presents E5, a family of state-of-the-art text embeddings that transfer well to a wide range of tasks. The model is trained in a contrastive manner with weak supervision signals from our curated large-scale text pair dataset…

Computation and Language · Computer Science 2024-02-23 Liang Wang , Nan Yang , Xiaolong Huang , Binxing Jiao , Linjun Yang , Daxin Jiang , Rangan Majumder , Furu Wei

Large language models are typically deployed as monolithic systems, requiring the full model even when applications need only a narrow subset of capabilities, e.g., code, math, or domain-specific knowledge. Mixture-of-Experts (MoEs)…

Computation and Language · Computer Science 2026-05-12 Ryan Wang , Akshita Bhagia , Sewon Min

In this paper, a novel architecture for speaker recognition is proposed by cascading speech enhancement and speaker processing. Its aim is to improve speaker recognition performance when speech signals are corrupted by noise. Instead of…

Computation and Language · Computer Science 2020-05-25 Yanpei Shi , Qiang Huang , Thomas Hain

We present Transformation Invariance and Covariance Contrast (TiCo) for self-supervised visual representation learning. Similar to other recent self-supervised learning methods, our method is based on maximizing the agreement among…

Computer Vision and Pattern Recognition · Computer Science 2022-06-24 Jiachen Zhu , Rafael M. Moraes , Serkan Karakulak , Vlad Sobol , Alfredo Canziani , Yann LeCun

Recent advances in unsupervised speech representation learning discover new approaches and provide new state-of-the-art for diverse types of speech processing tasks. This paper presents an investigation of using wav2vec 2.0 deep speech…

The challenges in applying contrastive learning to speaker verification (SV) are that the softmax-based contrastive loss lacks discriminative power and that the hard negative pairs can easily influence learning. To overcome the first…

Audio and Speech Processing · Electrical Eng. & Systems 2023-03-14 Zhe Li , Man-Wai Mak , Helen Mei-Ling Meng

The adoption of advanced deep learning architectures in stuttering detection (SD) tasks is challenging due to the limited size of the available datasets. To this end, this work introduces the application of speech embeddings extracted from…

Sound · Computer Science 2023-06-02 Shakeel A. Sheikh , Md Sahidullah , Fabrice Hirsch , Slim Ouni

Over the recent years, various deep learning-based embedding methods have been proposed and have shown impressive performance in speaker verification. However, as in most of the classical embedding techniques, the deep learning-based…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-10 Woo Hyun Kang , Sung Hwan Mun , Min Hyun Han , Nam Soo Kim

Recent advancements in Self-Supervised Learning (SSL) have shown promising results in Speaker Verification (SV). However, narrowing the performance gap with supervised systems remains an ongoing challenge. Several studies have observed that…

Audio and Speech Processing · Electrical Eng. & Systems 2025-06-25 Victor Miara , Theo Lepage , Reda Dehak

Zero-shot speaker adaptation aims to clone an unseen speaker's voice without any adaptation time and parameters. Previous researches usually use a speaker encoder to extract a global fixed speaker embedding from reference speech, and…

Sound · Computer Science 2022-11-14 Yixuan Zhou , Changhe Song , Xiang Li , Luwen Zhang , Zhiyong Wu , Yanyao Bian , Dan Su , Helen Meng

Contrary to i-vectors, speaker embeddings such as x-vectors are incapable of leveraging unlabelled utterances, due to the classification loss over training speakers. In this paper, we explore an alternative training strategy to enable the…

Computer Vision and Pattern Recognition · Computer Science 2019-04-24 Themos Stafylakis , Johan Rohdin , Oldrich Plchot , Petr Mizera , Lukas Burget

Contrastive learning-based methods, such as unsup-SimCSE, have achieved state-of-the-art (SOTA) performances in learning unsupervised sentence embeddings. However, in previous studies, each embedding used for contrastive learning only…

Computation and Language · Computer Science 2023-05-19 Hongliang He , Junlei Zhang , Zhenzhong Lan , Yue Zhang

In this paper, we propose an effective training strategy to ex-tract robust speaker representations from a speech signal. Oneof the key challenges in speaker recognition tasks is to learnlatent representations or embeddings containing…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-05 Yoohwan Kwon , Soo-Whan Chung , Hong-Goo Kang

This paper describes the NPU system submitted to Spoofing Aware Speaker Verification Challenge 2022. We particularly focus on the \textit{backend ensemble} for speaker verification and spoofing countermeasure from three aspects. Firstly,…

Sound · Computer Science 2022-09-26 Li Zhang , Yue Li , Huan Zhao , Qing Wang , Lei Xie

Personalized speech enhancement (PSE) models can improve the audio quality of teleconferencing systems by adapting to the characteristics of a speaker's voice. However, most existing methods require a separate speaker embedding model to…

Sound · Computer Science 2024-06-17 Tanel Pärnamaa , Ando Saabas

Dominant researches adopt supervised training for speaker extraction, while the scarcity of ideally clean corpus and channel mismatch problem are rarely considered. To this end, we propose speaker-aware mixture of mixtures training (SAMoM),…

Audio and Speech Processing · Electrical Eng. & Systems 2022-04-18 Zifeng Zhao , Rongzhi Gu , Dongchao Yang , Jinchuan Tian , Yuexian Zou

Multi-speaker TTS has to learn both linguistic embedding and text embedding to generate speech of desired linguistic content in desired voice. However, it is unclear which characteristic of speech results from speaker and which part from…

Audio and Speech Processing · Electrical Eng. & Systems 2020-06-15 Sunghee Jung , Hoirin Kim

Speaker verification is a task of confirming an individual's identity through the analysis of their voice. Whispered speech differs from phonated speech in acoustic characteristics, which degrades the performance of speaker verification…

Sound · Computer Science 2026-05-08 Magdalena Gołębiowska , Piotr Syga

We explore self-supervised models that can be potentially deployed on mobile devices to learn general purpose audio representations. Specifically, we propose methods that exploit the temporal context in the spectrogram domain. One method…

Audio and Speech Processing · Electrical Eng. & Systems 2019-05-29 Marco Tagliasacchi , Beat Gfeller , Félix de Chaumont Quitry , Dominik Roblek
‹ Prev 1 4 5 6 7 8 10 Next ›