English
Related papers

Related papers: Enhancing GAN-Based Vocoders with Contrastive Lear…

200 papers

In audio-visual navigation (AVN), an intelligent agent needs to navigate to a constantly sound-making object in complex 3D environments based on its audio and visual perceptions. While existing methods attempt to improve the navigation…

Sound · Computer Science 2022-06-02 Shunqi Mao , Chaoyi Zhang , Heng Wang , Weidong Cai

Nowadays, neural vocoders can generate very high-fidelity speech when a bunch of training data is available. Although a speaker-dependent (SD) vocoder usually outperforms a speaker-independent (SI) vocoder, it is impractical to collect a…

Audio and Speech Processing · Electrical Eng. & Systems 2021-06-11 Yi-Chiao Wu , Cheng-Hung Hu , Hung-Shin Lee , Yu-Huai Peng , Wen-Chin Huang , Yu Tsao , Hsin-Min Wang , Tomoki Toda

Contrastive learning has proven to be highly efficient and adaptable in shaping representation spaces across diverse modalities by pulling similar samples together and pushing dissimilar ones apart. However, two key limitations persist: (1)…

Machine Learning · Computer Science 2025-12-08 Ziwen Wang , Jiajun Fan , Thao Nguyen , Heng Ji , Ge Liu

Contrastive cross-modal models such as CLIP and CLAP aid various vision-language (VL) and audio-language (AL) tasks. However, there has been limited investigation of and improvement in their language encoder, which is the central component…

Computation and Language · Computer Science 2023-10-23 Mengjie Zhao , Junya Ono , Zhi Zhong , Chieh-Hsin Lai , Yuhta Takida , Naoki Murata , Wei-Hsiang Liao , Takashi Shibuya , Hiromi Wakaki , Yuki Mitsufuji

Contrastive learning has demonstrated great effectiveness in representation learning especially for image classification tasks. However, there is still a shortage in the studies targeting regression tasks, and more specifically applications…

Computer Vision and Pattern Recognition · Computer Science 2024-03-27 Mohamad Dhaini , Maxime Berar , Paul Honeine , Antonin Van Exem

The challenges in applying contrastive learning to speaker verification (SV) are that the softmax-based contrastive loss lacks discriminative power and that the hard negative pairs can easily influence learning. To overcome the first…

Audio and Speech Processing · Electrical Eng. & Systems 2023-03-14 Zhe Li , Man-Wai Mak , Helen Mei-Ling Meng

In this study, we investigate self-supervised representation learning for speaker verification (SV). First, we examine a simple contrastive learning approach (SimCLR) with a momentum contrastive (MoCo) learning framework, where the MoCo…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-16 Wei Xia , Chunlei Zhang , Chao Weng , Meng Yu , Dong Yu

Self-supervised contrastive learning is an effective approach for addressing the challenge of limited labelled data. This study builds upon the previously established two-stage patch-level, multi-label classification method for…

Computer Vision and Pattern Recognition · Computer Science 2026-02-09 Salma Haidar , José Oramas

Self-supervised pre-training methods based on contrastive learning or regression tasks can utilize more unlabeled data to improve the performance of automatic speech recognition (ASR). However, the robustness impact of combining the two…

Audio and Speech Processing · Electrical Eng. & Systems 2022-10-28 Qiu-Shi Zhu , Long Zhou , Jie Zhang , Shu-Jie Liu , Yu-Chen Hu , Li-Rong Dai

Recent advances suggest the advantage of multi-modal training in comparison with single-modal methods. In contrast to this view, in our work we find that similar gain can be obtained from training with different formats of a single…

Sound · Computer Science 2021-03-25 Luyu Wang , Aaron van den Oord

Data-Efficient GANs (DE-GANs), which aim to learn generative models with a limited amount of training data, encounter several challenges for generating high-quality samples. Since data augmentation strategies have largely alleviated the…

Computer Vision and Pattern Recognition · Computer Science 2022-07-20 Ziqiang Li , Chaoyue Wang , Heliang Zheng , Jing Zhang , Bin Li

Despite recent advancements, audio-text models still lag behind their image-text counterparts in scale and performance. In this paper, we propose to improve both the data scale and the training procedure of audio-text contrastive models.…

Sound · Computer Science 2024-10-01 Ge Zhu , Jordan Darefsky , Zhiyao Duan

Several automatic approaches for objective music performance assessment (MPA) have been proposed in the past, however, existing systems are not yet capable of reliably predicting ratings with the same accuracy as professional judges. This…

Sound · Computer Science 2021-08-16 Pavan Seshadri , Alexander Lerch

Speech enhancement is an essential task of improving speech quality in noise scenario. Several state-of-the-art approaches have introduced visual information for speech enhancement,since the visual aspect of speech is essentially unaffected…

Audio and Speech Processing · Electrical Eng. & Systems 2022-04-21 Xinmeng Xu , Yang Wang , Dongxiang Xu , Yiyuan Peng , Cong Zhang , Jie Jia , Binbin Chen

Since the introduction of Generative Adversarial Networks (GANs) in speech synthesis, remarkable achievements have been attained. In a thorough exploration of vocoders, it has been discovered that audio waveforms can be generated at speeds…

Audio and Speech Processing · Electrical Eng. & Systems 2024-08-14 Yubing Cao , Yongming Li , Liejun Wang , Yinfeng Yu

Recently, pre-trained transformer-based models have achieved great success in the task of definition generation (DG). However, previous encoder-decoder models lack effective representation learning to contain full semantic components of the…

Computation and Language · Computer Science 2022-10-04 Hengyuan Zhang , Dawei Li , Shiping Yang , Yanran Li

The output of text-to-image synthesis systems should be coherent, clear, photo-realistic scenes with high semantic fidelity to their conditioned text descriptions. Our Cross-Modal Contrastive Generative Adversarial Network (XMC-GAN)…

Computer Vision and Pattern Recognition · Computer Science 2022-04-15 Han Zhang , Jing Yu Koh , Jason Baldridge , Honglak Lee , Yinfei Yang

In text-to-speech (TTS) and voice conversion (VC), acoustic features, such as mel spectrograms, are typically used as synthesis or conversion targets owing to their compactness and ease of learning. However, because the ultimate goal is to…

Sound · Computer Science 2025-08-28 Takuhiro Kaneko , Hirokazu Kameoka , Kou Tanaka , Yuto Kondo

Neural network based speech recognition systems suffer from performance degradation due to accented speech, especially unfamiliar accents. In this paper, we study the supervised contrastive learning framework for accented speech…

Sound · Computer Science 2021-07-05 Tao Han , Hantao Huang , Ziang Yang , Wei Han

We study a novel neural architecture and its training strategies of speaker encoder for speaker recognition without using any identity labels. The speaker encoder is trained to extract a fixed-size speaker embedding from a spoken utterance…

Audio and Speech Processing · Electrical Eng. & Systems 2022-10-28 Ruijie Tao , Kong Aik Lee , Rohan Kumar Das , Ville Hautamäki , Haizhou Li