English
Related papers

Related papers: Unsupervised Domain Adaptation for Speech Recognit…

200 papers

In this paper, we explore various approaches for semi supervised learning in an end to end automatic speech recognition (ASR) framework. The first step in our approach involves training a seed model on the limited amount of labelled data.…

Audio and Speech Processing · Electrical Eng. & Systems 2019-08-15 Subhadeep Dey , Petr Motlicek , Trung Bui , Franck Dernoncourt

Adapting pre-trained language models (PrLMs) (e.g., BERT) to new domains has gained much attention recently. Instead of fine-tuning PrLMs as done in most previous work, we investigate how to adapt the features of PrLMs to new domains…

Computation and Language · Computer Science 2020-12-01 Hai Ye , Qingyu Tan , Ruidan He , Juntao Li , Hwee Tou Ng , Lidong Bing

Self-training is an important class of unsupervised domain adaptation (UDA) approaches that are used to mitigate the problem of domain shift, when applying knowledge learned from a labeled source domain to unlabeled and heterogeneous target…

Image and Video Processing · Electrical Eng. & Systems 2023-05-25 Xiaofeng Liu , Jerry L. Prince , Fangxu Xing , Jiachen Zhuo , Reese Timothy , Maureen Stone , Georges El Fakhri , Jonghye Woo

High accuracy speech recognition requires a large amount of transcribed data for supervised training. In the absence of such data, domain adaptation of a well-trained acoustic model can be performed, but even here, high accuracy usually…

Computation and Language · Computer Science 2017-08-21 Jinyu Li , Michael L. Seltzer , Xi Wang , Rui Zhao , Yifan Gong

End-to-end automatic speech recognition (ASR) usually suffers from performance degradation when applied to a new domain due to domain shift. Unsupervised domain adaptation (UDA) aims to improve the performance on the unlabeled target domain…

Computation and Language · Computer Science 2023-02-23 Jiaming Zhou , Shiwan Zhao , Ning Jiang , Guoqing Zhao , Yong Qin

Recently, remarkable progress has been made in learning transferable representation across domains. Previous works in domain adaptation are majorly based on two techniques: domain-adversarial learning and self-training. However,…

Computer Vision and Pattern Recognition · Computer Science 2020-01-07 Minghao Chen , Shuai Zhao , Haifeng Liu , Deng Cai

Speech distortions are a long-standing problem that degrades the performance of supervisely trained speech processing models. It is high time that we enhance the robustness of speech processing models to obtain good performance when…

Sound · Computer Science 2022-07-26 Kuan Po Huang , Yu-Kuan Fu , Yu Zhang , Hung-yi Lee

We consider the problem of unsupervised domain adaptation for image classification. To learn target-domain-aware features from the unlabeled data, we create a self-supervised pretext task by augmenting the unlabeled data with a certain type…

Computer Vision and Pattern Recognition · Computer Science 2020-10-16 L. Xiao , J. Xu , D. Zhao , Z. Wang , L. Wang , Y. Nie , B. Dai

Thanks to the rise of self-supervised learning, automatic speech recognition (ASR) systems now achieve near-human performance on a wide variety of datasets. However, they still lack generalization capability and are not robust to domain…

Machine Learning · Computer Science 2023-03-15 Lucas Maison , Yannick Estève

As acquiring manual labels on data could be costly, unsupervised domain adaptation (UDA), which transfers knowledge learned from a rich-label dataset to the unlabeled target dataset, is gaining increasing popularity. While extensive studies…

Computer Vision and Pattern Recognition · Computer Science 2022-12-13 Wanqing Zhu , Jia-Li Yin , Bo-Hao Chen , Ximeng Liu

Semantic segmentation of remote sensing (RS) images is a challenging yet essential task with broad applications. While deep learning, particularly supervised learning with large-scale labeled datasets, has significantly advanced this field,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Bin Wang , Fei Deng , Shuang Wang , Wen Luo , Zhixuan Zhang , Peifan Jiang

Deep Learning-based end-to-end Automatic Speech Recognition (ASR) has made significant strides but still struggles with performance on out-of-domain samples due to domain shifts in real-world scenarios. Test-Time Adaptation (TTA) methods…

Audio and Speech Processing · Electrical Eng. & Systems 2024-10-04 Guan-Ting Lin , Wei-Ping Huang , Hung-yi Lee

Automatic speech recognition (ASR) systems have achieved strong performance on general transcription tasks. However, they continue to struggle with recognizing rare named entities and adapting to domain mismatches. In contrast, large…

Computation and Language · Computer Science 2025-08-21 Shaoshi Ling , Guoli Ye

Deep learning is usually data starved, and the unsupervised domain adaptation (UDA) is developed to introduce the knowledge in the labeled source domain to the unlabeled target domain. Recently, deep self-training presents a powerful means…

Computer Vision and Pattern Recognition · Computer Science 2022-08-30 Lingsheng Kong , Bo Hu , Xiongchang Liu , Jun Lu , Jane You , Xiaofeng Liu

The utilization of speech Self-Supervised Learning (SSL) models achieves impressive performance on Automatic Speech Recognition (ASR). However, in low-resource language ASR, they encounter the domain mismatch problem between pre-trained and…

Recent unsupervised domain adaptation (UDA) methods have shown great success in addressing classical domain shifts (e.g., synthetic-to-real), but they still suffer under complex shifts (e.g. geographical shift), where both the background…

Computer Vision and Pattern Recognition · Computer Science 2025-08-11 Mattia Litrico , Mario Valerio Giuffrida , Sebastiano Battiato , Devis Tuia

Speech recognition systems are often highly domain dependent, a fact widely reported in the literature. However the concept of domain is complex and not bound to clear criteria. Hence it is often not evident if data should be considered to…

Computation and Language · Computer Science 2015-09-23 Mortaza Doulaty , Oscar Saz , Thomas Hain

Automatic speech recognition (ASR) models often experience performance degradation due to data domain shifts introduced at test time, a challenge that is further amplified for child speakers. Test-time adaptation (TTA) methods have shown…

Machine Learning · Computer Science 2025-08-05 Zhonghao Shi , Xuan Shi , Anfeng Xu , Tiantian Feng , Harshvardhan Srivastava , Shrikanth Narayanan , Maja J. Matarić

Unsupervised Domain Adaptation (UDA) addresses the problem of performance degradation due to domain shift between training and testing sets, which is common in computer vision applications. Most existing UDA approaches are based on…

Computer Vision and Pattern Recognition · Computer Science 2019-05-14 Songsong Wu , Yan Yan , Hao Tang , Jianjun Qian , Jian Zhang , Xiao-Yuan Jing

By leveraging data from a fully labeled source domain, unsupervised domain adaptation (UDA) improves classification performance on an unlabeled target domain through explicit discrepancy minimization of data distribution or adversarial…

Computer Vision and Pattern Recognition · Computer Science 2021-12-06 Shengjia Zhang , Tiancheng Lin , Yi Xu