English
Related papers

Related papers: Large-Scale Domain Adaptation via Teacher-Student …

200 papers

We present a theoretical and algorithmic study of the multiple-source domain adaptation problem in the common scenario where the learner has access only to a limited amount of labeled target data, but where the learner has at disposal a…

Machine Learning · Computer Science 2020-11-02 Yishay Mansour , Mehryar Mohri , Jae Ro , Ananda Theertha Suresh , Ke Wu

Semi-supervised domain adaptation (SSDA) has been widely studied due to its ability to utilize a few labeled target data to improve the generalization ability of the model. However, existing methods only consider designing certain…

Computer Vision and Pattern Recognition · Computer Science 2024-11-12 Xinyang Huang , Chuang Zhu , Bowen Zhang , Shanghang Zhang

State-of-the-art speaker recognition relays on models that need a large amount of training data. This models are successful in tasks like NIST SRE because there is sufficient data available. However, in real applications, we usually do not…

Machine Learning · Statistics 2015-11-25 Jesús Villalba

Self- and semi-supervised learning methods have been actively investigated to reduce labeled training data or enhance the model performance. However, the approach mostly focus on in-domain performance for public datasets. In this study, we…

Audio and Speech Processing · Electrical Eng. & Systems 2022-02-17 Dongseong Hwang , Ananya Misra , Zhouyuan Huo , Nikhil Siddhartha , Shefali Garg , David Qiu , Khe Chai Sim , Trevor Strohman , Françoise Beaufays , Yanzhang He

Domain adaptation seeks to leverage the abundant label information in a source domain to improve classification performance in a target domain with limited labels. While the field has seen extensive methodological development, its…

Machine Learning · Statistics 2025-07-31 Elif Vural , Huseyin Karaca

Although deep neural networks have achieved remarkable results for the task of semantic segmentation, they usually fail to generalize towards new domains, especially when performing synthetic-to-real adaptation. Such domain shift is…

Computer Vision and Pattern Recognition · Computer Science 2021-10-07 Adriano Cardace , Pierluigi Zama Ramirez , Samuele Salti , Luigi Di Stefano

Performance of a pre-trained semantic segmentation model is likely to substantially decrease on data from a new domain. We show a pre-trained model can be adapted to unlabelled target domain data by calculating soft-label prototypes under…

Computer Vision and Pattern Recognition · Computer Science 2023-07-21 Ondrej Bohdal , Da Li , Timothy Hospedales

Domain adaptation is crucial in many real-world applications where the distribution of the training data differs from the distribution of the test data. Previous Deep Learning-based approaches to domain adaptation need to be trained jointly…

Computation and Language · Computer Science 2017-02-08 Sebastian Ruder , Parsa Ghaffari , John G. Breslin

In non-stationary environments, learning machines usually confront the domain adaptation scenario where the data distribution does change over time. Previous domain adaptation works have achieved great success in theory and practice.…

Machine Learning · Computer Science 2020-05-06 Zhongyi Han , Xian-Jin Gui , Chaoran Cui , Yilong Yin

We consider the problem of active domain adaptation (ADA) to unlabeled target data, of which subset is actively selected and labeled given a budget constraint. Inspired by recent analysis on a critical issue from label distribution mismatch…

Machine Learning · Computer Science 2022-08-16 Sehyun Hwang , Sohyun Lee , Sungyeon Kim , Jungseul Ok , Suha Kwak

3D object detection networks tend to be biased towards the data they are trained on. Evaluation on datasets captured in different locations, conditions or sensors than that of the training (source) data results in a drop in model…

Computer Vision and Pattern Recognition · Computer Science 2021-12-02 Deepti Hegde , Vishal M. Patel

Automatic speech recognition (ASR) systems have achieved strong performance on general transcription tasks. However, they continue to struggle with recognizing rare named entities and adapting to domain mismatches. In contrast, large…

Computation and Language · Computer Science 2025-08-21 Shaoshi Ling , Guoli Ye

The recent success of neural machine translation models relies on the availability of high quality, in-domain data. Domain adaptation is required when domain-specific data is scarce or nonexistent. Previous unsupervised domain adaptation…

Computation and Language · Computer Science 2019-08-29 Zi-Yi Dou , Junjie Hu , Antonios Anastasopoulos , Graham Neubig

Domain adaptation tackles the challenge of generalizing knowledge acquired from a source domain to a target domain with different data distributions. Traditional domain adaptation methods presume that the classes in the source and target…

Computer Vision and Pattern Recognition · Computer Science 2023-03-22 Xinghong Liu , Yi Zhou , Tao Zhou , Jie Qin , Shengcai Liao

Domain Adaptation (DA) aims to generalize the classifier learned from the source domain to the target domain. Existing DA methods usually assume that rich labels could be available in the source domain. However, there are usually a large…

Computer Vision and Pattern Recognition · Computer Science 2020-05-11 Wei Wang , Zhihui Wang , Yuankai Xiang , Jing Sun , Haojie Li , Fuming Sun , Zhengming Ding

Recent research indicates that pretraining cross-lingual language models on large-scale unlabeled texts yields significant performance improvements over various cross-lingual and low-resource tasks. Through training on one hundred languages…

Computation and Language · Computer Science 2020-11-24 Juntao Li , Ruidan He , Hai Ye , Hwee Tou Ng , Lidong Bing , Rui Yan

Large language models (LLMs) have showcased their capability with few-shot inference known as in-context learning. However, in-domain demonstrations are not always readily available in real scenarios, leading to cross-domain in-context…

Computation and Language · Computer Science 2023-11-21 Quanyu Long , Wenya Wang , Sinno Jialin Pan

Recently, self-supervised learning (SSL) from unlabelled speech data has gained increased attention in the automatic speech recognition (ASR) community. Typical SSL methods include autoregressive predictive coding (APC), Wav2vec2.0, and…

Audio and Speech Processing · Electrical Eng. & Systems 2023-05-02 Ruchao Fan , Yunzheng Zhu , Jinhan Wang , Abeer Alwan

Domain adaptive semantic segmentation aims to transfer knowledge from a labeled source domain to an unlabeled target domain. However, existing methods primarily focus on directly learning qualified target features, making it challenging to…

Computer Vision and Pattern Recognition · Computer Science 2024-10-24 Haochen Wang , Yujun Shen , Jingjing Fei , Wei Li , Liwei Wu , Yuxi Wang , Zhaoxiang Zhang

To learn target discriminative representations, using pseudo-labels is a simple yet effective approach for unsupervised domain adaptation. However, the existence of false pseudo-labels, which may have a detrimental influence on learning…

Computer Vision and Pattern Recognition · Computer Science 2019-08-02 Jaehoon Choi , Minki Jeong , Taekyung Kim , Changick Kim