English
Related papers

Related papers: Causally Disentangled Contrastive Learning for Mul…

200 papers

Speaker embeddings are widely used in speaker verification systems and other applications where it is useful to characterise the voice of a speaker with a fixed-length vector. These embeddings tend to be treated as "black box" encodings,…

Sound · Computer Science 2025-10-21 Mark Huckvale

In this work we address disentanglement of style and content in speech signals. We propose a fully convolutional variational autoencoder employing two encoders: a content encoder and a style encoder. To foster disentanglement, we propose…

Audio and Speech Processing · Electrical Eng. & Systems 2021-03-12 Janek Ebbers , Michael Kuhlmann , Tobias Cord-Landwehr , Reinhold Haeb-Umbach

Contrastive self-supervised learning (CSL) for speaker verification (SV) has drawn increasing interest recently due to its ability to exploit unlabeled data. Performing data augmentation on raw waveforms, such as adding noise or…

Audio and Speech Processing · Electrical Eng. & Systems 2024-03-12 Chong-Xin Gan , Man-Wai Mak , Weiwei Lin , Jen-Tzung Chien

Factorizing speech as disentangled speech representations is vital to achieve highly controllable style transfer in voice conversion (VC). Conventional speech representation learning methods in VC only factorize speech as speaker and…

Audio and Speech Processing · Electrical Eng. & Systems 2021-12-06 Jie Wang , Jingbei Li , Xintao Zhao , Zhiyong Wu , Shiyin Kang , Helen Meng

The goal of this work is to train robust speaker recognition models without speaker labels. Recent works on unsupervised speaker representations are based on contrastive learning in which they encourage within-utterance embeddings to be…

Sound · Computer Science 2020-11-02 Jaesung Huh , Hee Soo Heo , Jingu Kang , Shinji Watanabe , Joon Son Chung

State-of-the-art speaker verification systems are inherently dependent on some kind of human supervision as they are trained on massive amounts of labeled data. However, manually annotating utterances is slow, expensive and not scalable to…

Audio and Speech Processing · Electrical Eng. & Systems 2025-06-25 Théo Lepage , Réda Dehak

Deep neural networks are susceptible to learn biased models with entangled feature representations, which may lead to subpar performances on various downstream tasks. This is particularly true for under-represented classes, where a lack of…

Computer Vision and Pattern Recognition · Computer Science 2021-11-02 Sanghyeok Chu , Dongwan Kim , Bohyung Han

There are a number of studies about extraction of bottleneck (BN) features from deep neural networks (DNNs)trained to discriminate speakers, pass-phrases and triphone states for improving the performance of text-dependent speaker…

Sound · Computer Science 2019-05-14 Achintya kr. Sarkar , Zheng-Hua Tan , Hao Tang , Suwon Shon , James Glass

Over the recent years, various deep learning-based embedding methods have been proposed and have shown impressive performance in speaker verification. However, as in most of the classical embedding techniques, the deep learning-based…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-10 Woo Hyun Kang , Sung Hwan Mun , Min Hyun Han , Nam Soo Kim

Single channel target speaker separation (TSS) aims at extracting a speaker's voice from a mixture of multiple talkers given an enrollment utterance of that speaker. A typical deep learning TSS framework consists of an upstream model that…

Sound · Computer Science 2022-10-27 Xiaoyu Liu , Xu Li , Joan Serrà

State-of-the-art Deep Learning systems for speaker verification are commonly based on speaker embedding extractors. These architectures are usually composed of a feature extractor front-end together with a pooling layer to encode…

Audio and Speech Processing · Electrical Eng. & Systems 2024-05-08 Federico Costa , Miquel India , Javier Hernando

Cross-lingual speaker verification suffers from severe language-speaker entanglement. This causes systematic degradation in the hardest scenario: correctly accepting utterances from the same speaker across different languages while…

Audio and Speech Processing · Electrical Eng. & Systems 2026-05-01 Qituan Shangguan , Junhao Du , Kunyang Peng , Feng Xue , Hui Zhang , Xinsheng Wang , Kai Yu , Shuai Wang

Automatic speaker verification has achieved remarkable progress in recent years. However, there is little research on cross-age speaker verification (CASV) due to insufficient relevant data. In this paper, we mine cross-age test sets based…

Audio and Speech Processing · Electrical Eng. & Systems 2022-07-14 Xiaoyi Qin , Na Li , Chao Weng , Dan Su , Ming Li

Speech-based detection of cognitive impairment (CI) offers a promising non-invasive approach for early diagnosis, yet performance disparities across demographic and clinical subgroups remain underexplored, raising concerns around fairness…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-04 Kashaf Gulzar , Korbinian Riedhammer , Elmar Nöth , Andreas K. Maier , Paula Andrea Pérez-Toro

A great challenge in speaker representation learning using deep models is to design learning objectives that can enhance the discrimination of unseen speakers under unseen domains. This work proposes a supervised contrastive learning…

Audio and Speech Processing · Electrical Eng. & Systems 2022-11-18 Zhe Li , Man-Wai Mak

Previous work has encouraged domain-invariance in deep speaker embedding by adversarially classifying the dataset or labelled environment to which the generated features belong. We propose a training strategy which aims to produce features…

Sound · Computer Science 2020-04-17 Chau Luu , Peter Bell , Steve Renals

Self-supervised learning (SSL) has reduced the reliance on expensive labeling in speech technologies by learning meaningful representations from unannotated data. Since most SSL-based downstream tasks prioritize content information in…

Sound · Computer Science 2025-05-27 Giuseppe Ruggiero , Matteo Testa , Jurgen Van de Walle , Luigi Di Caro

This paper introduces a general classifier based on WavLM features, to infer demographic characteristics, such as age, gender, native language, education, and country, from speech. Demographic feature prediction plays a crucial role in…

Computation and Language · Computer Science 2025-02-18 Yuchen Yang , Thomas Thebaud , Najim Dehak

Word embeddings have been shown to produce remarkable results in tackling a vast majority of NLP related tasks. Unfortunately, word embeddings also capture the stereotypical biases that are prevalent in society, affecting the predictive…

Computation and Language · Computer Science 2024-11-20 Navya Yarrabelly , Vinay Damodaran , Feng-Guang Su

Deep speaker embeddings have shown promising results in speaker recognition, as well as in other speaker-related tasks. However, some issues are still under explored, for instance, the information encoded in these representations and their…

Audio and Speech Processing · Electrical Eng. & Systems 2022-12-15 Zifeng Zhao , Ding Pan , Junyi Peng , Rongzhi Gu