English
Related papers

Related papers: Contrastive-mixup learning for improved speaker ve…

200 papers

Building multispeaker neural network-based text-to-speech synthesis systems commonly relies on the availability of large amounts of high quality recordings from each speaker and conditioning the training process on the speaker's identity or…

Audio and Speech Processing · Electrical Eng. & Systems 2021-06-04 Beata Lorincz , Adriana Stan , Mircea Giurgiu

Efficiently retrieving specific instrument timbres from audio mixtures remains a challenge in digital music production. This paper introduces a contrastive learning framework for musical instrument retrieval, enabling direct querying of…

Sound · Computer Science 2025-09-17 Gwendal Le Vaillant , Yannick Molle

Respiratory sound classification plays a pivotal role in diagnosing respiratory diseases. While deep learning models have shown success with various respiratory sound datasets, our experiments indicate that models trained on one dataset…

Sound · Computer Science 2025-01-03 Shijia Ge , Weixiang Zhang , Shuzhao Xie , Baixu Yan , Zhi Wang

Mixup is a widely adopted data augmentation technique known for enhancing the generalization of machine learning models by interpolating between data points. Despite its success and popularity, limited attention has been given to…

Machine Learning · Computer Science 2025-03-05 Chungpa Lee , Jongho Im , Joseph H. T. Kim

Contrastive learning is a major studied topic in metric learning. However, sampling effective contrastive pairs remains a challenge due to factors such as limited batch size, imbalanced data distribution, and the risk of overfitting. In…

Computer Vision and Pattern Recognition · Computer Science 2023-08-02 Bolun Cai , Pengfei Xiong , Shangxuan Tian

We propose RemixIT, a simple and novel self-supervised training method for speech enhancement. The proposed method is based on a continuously self-training scheme that overcomes limitations from previous studies including assumptions for…

Sound · Computer Science 2022-11-14 Efthymios Tzinis , Yossi Adi , Vamsi K. Ithapu , Buye Xu , Anurag Kumar

This paper addresses the persistent challenge in Keyword Spotting (KWS), a fundamental component in speech technology, regarding the acquisition of substantial labeled data for training. Given the difficulty in obtaining large quantities of…

Sound · Computer Science 2024-09-04 Weinan Dai , Yifeng Jiang , Yuanjing Liu , Jinkun Chen , Xin Sun , Jinglei Tao

Speech deepfake detection has achieved remarkable success in clean environments but faces significant challenges in complex, real-world scenarios where speech is often mixed with background music or noise. Current state-of-the-art methods…

Sound · Computer Science 2026-05-25 Qingcao Li , Yipeng Lin , Weichen Lian , Zhongjie Ba , Peng Cheng , Zhichao Lian

Neural networks trained with ERM (empirical risk minimization) sometimes learn unintended decision rules, in particular when their training data is biased, i.e., when training labels are strongly correlated with undesirable features. To…

Computer Vision and Pattern Recognition · Computer Science 2022-11-07 Inwoo Hwang , Sangjun Lee , Yunhyeok Kwak , Seong Joon Oh , Damien Teney , Jin-Hwa Kim , Byoung-Tak Zhang

Data augmentation (DA) has gained widespread popularity in deep speaker models due to its ease of implementation and significant effectiveness. It enriches training data by simulating real-life acoustic variations, enabling deep neural…

Sound · Computer Science 2024-02-07 Zhenyu Zhou , Junhui Chen , Namin Wang , Lantian Li , Dong Wang

Data mixing augmentation has been widely applied to improve the generalization ability of deep neural networks. Recently, offline data mixing augmentation, e.g. handcrafted and saliency information-based mixup, has been gradually replaced…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Huafeng Qin , Xin Jin , Yun Jiang , Mounim A. El-Yacoubi , Xinbo Gao

In this paper, we investigate the challenges of complementary-label learning (CLL), a specialized form of weakly-supervised learning (WSL) where models are trained with labels indicating classes to which instances do not belong, rather than…

Machine Learning · Computer Science 2026-02-03 Tan-Ha Mai , Hsuan-Tien Lin

Contrastive learning is a family of self-supervised methods where a model is trained to solve a classification task constructed from unlabeled data. It has recently emerged as one of the leading learning paradigms in the absence of labels…

Machine Learning · Statistics 2021-03-05 Bingbin Liu , Pradeep Ravikumar , Andrej Risteski

We study the problem of robust data augmentation for regression tasks in the presence of noisy data. Data augmentation is essential for generalizing deep learning models, but most of the techniques like the popular Mixup are primarily…

Machine Learning · Computer Science 2024-08-19 Seong-Hyeon Hwang , Minsu Kim , Steven Euijong Whang

Mixup and its variants form a popular class of data augmentation techniques.Using a random sample pair, it generates a new sample by linear interpolation of the inputs and labels. However, generating only one single interpolation may limit…

Machine Learning · Computer Science 2024-06-04 Lifeng Shen , Jincheng Yu , Hansi Yang , James T. Kwok

Machine unlearning is a critical area of research aimed at safeguarding data privacy by enabling the removal of sensitive information from machine learning models. One unique challenge in this field is catastrophic unlearning, where erasing…

Machine Learning · Computer Science 2025-02-17 Zhuoyi Peng , Yixuan Tang , Yi Yang

This paper proposes an improved approach for open-set speaker identification based on pretrained speaker foundation models. Building upon the previous Speaker Reciprocal Points Learning framework (V1), we first introduce an enhanced…

Audio and Speech Processing · Electrical Eng. & Systems 2026-04-16 Zhiyong Chen , Shuhang Wu , Yingjie Duan , Xinkang Xu , Xinhui Hu

Multilingual speech emotion recognition aims to estimate a speaker's emotional state using a contactless method across different languages. However, variability in voice characteristics and linguistic diversity poses significant challenges…

Computation and Language · Computer Science 2025-03-31 Heqing Zou , Fengmao Lv , Desheng Zheng , Eng Siong Chng , Deepu Rajan

Contrastive learning has become pivotal in unsupervised representation learning, with frameworks like Momentum Contrast (MoCo) effectively utilizing large negative sample sets to extract discriminative features. However, traditional…

Machine Learning · Computer Science 2025-01-29 Duy Hoang , Huy Ngo , Khoi Pham , Tri Nguyen , Gia Bao , Huy Phan

Modern deep networks can be better generalized when trained with noisy samples and regularization techniques. Mixup and CutMix have been proven to be effective for data augmentation to help avoid overfitting. Previous Mixup-based methods…

Computer Vision and Pattern Recognition · Computer Science 2022-11-30 Shuyang Sun , Jie-Neng Chen , Ruifei He , Alan Yuille , Philip Torr , Song Bai