English
Related papers

Related papers: Unsupervised Domain Adaptation by Adversarial Lear…

200 papers

This paper proposes an unsupervised data selection method by using a submodular function based on contrastive loss ratios of target and training data sets. A model using a contrastive loss function is trained on both sets. Then the ratio of…

Audio and Speech Processing · Electrical Eng. & Systems 2022-07-26 Chanho Park , Rehan Ahmad , Thomas Hain

In this study, we propose a novel noise adaptive speech enhancement (SE) system, which employs a domain adversarial training (DAT) approach to tackle the issue of a noise type mismatch between the training and testing conditions. Such a…

Sound · Computer Science 2019-07-02 Chien-Feng Liao , Yu Tsao , Hung-Yi Lee , Hsin-Min Wang

The vulnerability of deep neural networks to imperceptible adversarial perturbations has attracted widespread attention. Inspired by the success of vision-language foundation models, previous efforts achieved zero-shot adversarial…

Computer Vision and Pattern Recognition · Computer Science 2024-10-24 Yiwei Zhou , Xiaobo Xia , Zhiwei Lin , Bo Han , Tongliang Liu

Significant advances have been made towards building accurate automatic segmentation systems for a variety of biomedical applications using machine learning. However, the performance of these systems often degrades when they are applied on…

Speech recognition systems often struggle with data domains that have not been included in the training. To address this, unsupervised domain adaptation has been explored with ensemble and multi-stage teacher-student training methods…

Audio and Speech Processing · Electrical Eng. & Systems 2026-04-14 Rehan Ahmad , Muhammad Umar Farooq , Qihang Feng , Thomas Hain

While recent automatic speech recognition systems achieve remarkable performance when large amounts of adequate, high quality annotated speech data is used for training, the same systems often only achieve an unsatisfactory result for tasks…

Audio and Speech Processing · Electrical Eng. & Systems 2022-01-19 Michael Gref , Oliver Walter , Christoph Schmidt , Sven Behnke , Joachim Köhler

Speech enhancement deep learning systems usually require large amounts of training data to operate in broad conditions or real applications. This makes the adaptability of those systems into new, low resource environments an important…

Sound · Computer Science 2017-12-19 Santiago Pascual , Maruchan Park , Joan Serrà , Antonio Bonafonte , Kang-Hun Ahn

The recent success of neural machine translation models relies on the availability of high quality, in-domain data. Domain adaptation is required when domain-specific data is scarce or nonexistent. Previous unsupervised domain adaptation…

Computation and Language · Computer Science 2019-08-29 Zi-Yi Dou , Junjie Hu , Antonios Anastasopoulos , Graham Neubig

Eliminating the negative effect of non-stationary environmental noise is a long-standing research topic for automatic speech recognition that stills remains an important challenge. Data-driven supervised approaches, including ones based on…

This paper studies the task of speech reconstruction from ultrasound tongue images and optical lip videos recorded in a silent speaking mode, where people only activate their intra-oral and extra-oral articulators without producing sound.…

Audio and Speech Processing · Electrical Eng. & Systems 2023-04-13 Rui-Chen Zheng , Yang Ai , Zhen-Hua Ling

Unsupervised domain adaption aims to learn a powerful classifier for the target domain given a labeled source data set and an unlabeled target data set. To alleviate the effect of `domain shift', the major challenge in domain adaptation,…

Computer Vision and Pattern Recognition · Computer Science 2018-12-03 Yexun Zhang , Ya Zhang , Yanfeng Wang , Qi Tian

Many speech enhancement methods try to learn the relationship between noisy and clean speech, obtained using an acoustic room simulator. We point out several limitations of enhancement methods relying on clean speech targets; the goal of…

Computation and Language · Computer Science 2018-12-26 Geonmin Kim , Hwaran Lee , Bo-Kyeong Kim , Sang-Hoon Oh , Soo-Young Lee

Extensive Unsupervised Domain Adaptation (UDA) studies have shown great success in practice by learning transferable representations across a labeled source domain and an unlabeled target domain with deep models. However, previous works…

Machine Learning · Computer Science 2021-09-03 Muhammad Awais , Fengwei Zhou , Hang Xu , Lanqing Hong , Ping Luo , Sung-Ho Bae , Zhenguo Li

In Automatic Speech Recognition (ASR), teacher-student (T/S) training has shown to perform well for domain adaptation with small amount of training data. However, adaption without ground-truth labels is still challenging. A previous study…

Audio and Speech Processing · Electrical Eng. & Systems 2024-02-08 Rehan Ahmad , Muhammad Umar Farooq , Thomas Hain

This work provides a framework for addressing the problem of supervised domain adaptation with deep models. The main idea is to exploit adversarial learning to learn an embedded subspace that simultaneously maximizes the confusion between…

Computer Vision and Pattern Recognition · Computer Science 2017-11-08 Saeid Motiian , Quinn Jones , Seyed Mehdi Iranmanesh , Gianfranco Doretto

Multilingual training has been shown to improve acoustic modeling performance by sharing and transferring knowledge in modeling different languages. Knowledge sharing is usually achieved by using common lower-level layers for different…

Computation and Language · Computer Science 2019-06-18 Ke Hu , Hasim Sak , Hank Liao

Speaker recognition, recognizing speaker identities based on voice alone, enables important downstream applications, such as personalization and authentication. Learning speaker representations, in the context of supervised learning,…

Machine Learning · Computer Science 2022-07-13 Metehan Cekic , Ruirui Li , Zeya Chen , Yuguang Yang , Andreas Stolcke , Upamanyu Madhow

Training models that are robust to data domain shift has gained an increasing interest both in academia and industry. Question-Answering language models, being one of the typical problem in Natural Language Processing (NLP) research, has…

Computation and Language · Computer Science 2022-06-27 Shubham Shrivastava , Kaiyue Wang

Adapting speaker recognition systems to new environments is a widely-used technique to improve a well-performing model learned from large-scale data towards a task-specific small-scale data scenarios. However, previous studies focus on…

Sound · Computer Science 2022-11-21 Zhenyu Wang , John H. L. Hansen

The performance of machine learning algorithms is known to be negatively affected by possible mismatches between training (source) and test (target) data distributions. In fact, this problem emerges whenever an acoustic scene classification…

Audio and Speech Processing · Electrical Eng. & Systems 2020-05-04 Alessandro Ilic Mezza , Emanuël A. P. Habets , Meinard Müller , Augusto Sarti