English
Related papers

Related papers: Causally Disentangled Contrastive Learning for Mul…

200 papers

Growing concerns regarding algorithmic fairness have led to a surge in methodologies to mitigate algorithmic bias. However, such methodologies largely assume that observed labels in training data are correct. This is problematic because…

Machine Learning · Computer Science 2023-10-02 Yunyi Li , Maria De-Arteaga , Maytal Saar-Tsechansky

In this work, we examine the extent to which embeddings may encode marginalized populations differently, and how this may lead to a perpetuation of biases and worsened performance on clinical tasks. We pretrain deep embedding models (BERT)…

Computation and Language · Computer Science 2020-03-26 Haoran Zhang , Amy X. Lu , Mohamed Abdalla , Matthew McDermott , Marzyeh Ghassemi

The popular frameworks for self-supervised learning of speech representations have largely focused on frame-level masked prediction of speech regions. While this has shown promising downstream task performance for speech recognition and…

Computation and Language · Computer Science 2025-07-22 Varun Krishna , Sriram Ganapathy

Self-supervised learning (SSL) has recently allowed leveraging large datasets of unlabeled speech signals to reach impressive performance on speech tasks using only small amounts of annotated data. The high number of proposed approaches…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-02 Salah Zaiem , Youcef Kemiche , Titouan Parcollet , Slim Essid , Mirco Ravanelli

Existing methods for debiasing word embeddings often do so only superficially, in that words that are stereotypically associated with, e.g., a particular gender in the original embedding space can still be clustered together in the debiased…

Computation and Language · Computer Science 2020-06-23 Yuhao Du , Kenneth Joseph

This article presents a novel approach for learning domain-invariant speaker embeddings using Generative Adversarial Networks. The main idea is to confuse a domain discriminator so that is can't tell if embeddings are from the source or…

Audio and Speech Processing · Electrical Eng. & Systems 2018-11-08 Gautam Bhattacharya , Joao Monteiro , Jahangir Alam , Patrick Kenny

Neural speaker embeddings trained using classification objectives have demonstrated state-of-the-art performance in multiple applications. Typically, such embeddings are trained on an out-of-domain corpus on a single task e.g., speaker…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-03 Manoj Kumar , Tae Jin-Park , Somer Bishop , Shrikanth Narayanan

Nowadays, recognition-synthesis-based methods have been quite popular with voice conversion (VC). By introducing linguistics features with good disentangling characters extracted from an automatic speech recognition (ASR) model, the VC…

Sound · Computer Science 2023-05-17 Xintao Zhao , Shuai Wang , Yang Chao , Zhiyong Wu , Helen Meng

Self-supervised learning models for speech processing, such as wav2vec2, HuBERT, WavLM, and Whisper, generate embeddings that capture both linguistic and paralinguistic information, making it challenging to analyze tone independently of…

Machine Learning · Computer Science 2025-02-27 Hamdan Al Ahbabi , Gautier Marti , Saeed AlMarri , Ibrahim Elfadel

Recently, the standard variational autoencoder has been successfully used to learn a probabilistic prior over speech signals, which is then used to perform speech enhancement. Variational autoencoders have then been conditioned on a label…

Audio and Speech Processing · Electrical Eng. & Systems 2022-01-04 Guillaume Carbajal , Julius Richter , Timo Gerkmann

Self-supervised speech models have achieved remarkable success on content-driven tasks, yet they remain limited in capturing speaker-discriminative features critical for verification, diarization, and profiling applications. We introduce…

Sound · Computer Science 2026-03-26 Massa Baali , Rita Singh , Bhiksha Raj

Spoofing detection systems are typically trained using diverse recordings from multiple speakers, often assuming that the resulting embeddings are independent of speaker identity. However, this assumption remains unverified. In this paper,…

Sound · Computer Science 2026-02-25 Anh-Tuan Dao , Driss Matrouf , Nicholas Evans

Adversarial perturbations in speech pose a serious threat to automatic speech recognition (ASR) and speaker verification by introducing subtle waveform modifications that remain imperceptible to humans but can significantly alter system…

Sound · Computer Science 2026-02-02 Daniyal Kabir Dar , Qiben Yan , Li Xiao , Arun Ross

Automated speaker recognition uses data processing to identify speakers by their voice. Today, automated speaker recognition is deployed on billions of smart devices and in services such as call centres. Despite their wide-scale deployment…

Sound · Computer Science 2022-06-22 Wiebke Toussaint Hutiri , Aaron Ding

Accurately classifying accents and assessing accentedness in non-native speakers are both challenging tasks due to the complexity and diversity of accent and dialect variations. In this study, embeddings from advanced pre-trained language…

Audio and Speech Processing · Electrical Eng. & Systems 2023-10-18 Shahram Ghorbani , John H. L. Hansen

During training, Large Language Models (LLMs) learn social regularities that can lead to gender bias in downstream applications. Most mitigation efforts focus on reducing bias in generated outputs, typically evaluated on structured…

Computation and Language · Computer Science 2026-05-14 Nour Bouchouchi , Thibault Laugel , Xavier Renard , Christophe Marsala , Marie-Jeanne Lesot , Marcin Detyniecki

Introduction: Healthcare AI models often inherit biases from their training data. While efforts have primarily targeted bias in structured data, mental health heavily depends on unstructured data. This study aims to detect and mitigate…

In recent years, the rapid progress in speaker verification (SV) technology has been driven by the extraction of speaker representations based on deep learning. However, such representations are still vulnerable to emotion variability. To…

Sound · Computer Science 2025-05-27 Jingguang Tian , Xinhui Hu , Xinkang Xu

Online texts -- across genres, registers, domains, and styles -- are riddled with human stereotypes, expressed in overt or subtle ways. Word embeddings, trained on these texts, perpetuate and amplify these stereotypes, and propagate biases…

Computation and Language · Computer Science 2019-07-03 Thomas Manzini , Yao Chong Lim , Yulia Tsvetkov , Alan W Black

Word embedding has become essential for natural language processing as it boosts empirical performances of various tasks. However, recent research discovers that gender bias is incorporated in neural word embeddings, and downstream tasks…

Computation and Language · Computer Science 2019-11-26 Zekun Yang , Juan Feng