English
Related papers

Related papers: Holistic Transfer: Towards Non-Disruptive Fine-Tun…

200 papers

Pretrained language models have shown success in various areas of natural language processing, including reading comprehension tasks. However, when applying machine learning methods to new domains, labeled data may not always be available.…

Computation and Language · Computer Science 2022-06-15 Xiang Pan , Alex Sheng , David Shimshoni , Aditya Singhal , Sara Rosenthal , Avirup Sil

In this work, we define and address a novel domain adaptation (DA) problem in semantic scene segmentation, where the target domain not only exhibits a data distribution shift w.r.t. the source domain, but also includes novel classes that do…

Computer Vision and Pattern Recognition · Computer Science 2021-02-17 Maxime Bucher , Tuan-Hung Vu , Matthieu Cord , Patrick Pérez

We introduce a new representation learning approach for domain adaptation, in which data at training and test time come from similar but different distributions. Our approach is directly inspired by the theory on domain adaptation…

Machine learning systems must adapt to data distributions that evolve over time, in applications ranging from sensor networks and self-driving car perception modules to brain-machine interfaces. We consider gradual domain adaptation, where…

Machine Learning · Computer Science 2020-02-27 Ananya Kumar , Tengyu Ma , Percy Liang

In many real applications of statistical learning, collecting sufficiently many training data is often expensive, time-consuming, or even unrealistic. In this case, a transfer learning approach, which aims to leverage knowledge from a…

Machine Learning · Statistics 2025-02-26 Baozhen Wang , Xingye Qiao

While unsupervised domain adaptation methods based on deep architectures have achieved remarkable success in many computer vision tasks, they rely on a strong assumption, i.e. labeled source data must be available. In this work we overcome…

Computer Vision and Pattern Recognition · Computer Science 2020-08-12 Willi Menapace , Stéphane Lathuilière , Elisa Ricci

Deep domain adaptation methods have achieved appealing performance by learning transferable representations from a well-labeled source domain to a different but related unlabeled target domain. Most existing works assume source and target…

Computer Vision and Pattern Recognition · Computer Science 2020-04-13 Shuang Li , Chi Harold Liu , Qiuxia Lin , Qi Wen , Limin Su , Gao Huang , Zhengming Ding

The focus in machine learning has branched beyond training classifiers on a single task to investigating how previously acquired knowledge in a source domain can be leveraged to facilitate learning in a related target domain, known as…

Machine Learning · Computer Science 2018-10-30 Tyler R. Scott , Karl Ridgeway , Michael C. Mozer

This paper solves a generalized version of the problem of multi-source model adaptation for semantic segmentation. Model adaptation is proposed as a new domain adaptation problem which requires access to a pre-trained model instead of data…

Computer Vision and Pattern Recognition · Computer Science 2022-12-07 Zongyao Li , Ren Togo , Takahiro Ogawa , Miki haseyama

In this paper, we introduce a realistic and challenging domain adaptation problem called Universal Semi-supervised Model Adaptation (USMA), which i) requires only a pre-trained source model, ii) allows the source and target domain to have…

Computer Vision and Pattern Recognition · Computer Science 2023-11-06 Zizheng Yan , Yushuang Wu , Yipeng Qin , Xiaoguang Han , Shuguang Cui , Guanbin Li

Most visual recognition methods implicitly assume the data distribution remains unchanged from training to testing. However, in practice domain shift often exists, where real-world factors such as lighting and sensor type change between…

Machine Learning · Computer Science 2015-07-30 Yongxin Yang , Timothy Hospedales

Unsupervised Domain adaptation methods solve the adaptation problem for an unlabeled target set, assuming that the source dataset is available with all labels. However, the availability of actual source samples is not always possible in…

Computer Vision and Pattern Recognition · Computer Science 2021-02-19 Vinod K Kurmi , Venkatesh K Subramanian , Vinay P Namboodiri

Hyperspectral image (HSI) classification is one of the most active research topics and has achieved promising results boosted by the recent development of deep learning. However, most state-of-the-art approaches tend to perform poorly when…

Computer Vision and Pattern Recognition · Computer Science 2021-12-08 Ying Qu , Razieh Kaviani Baghbaderani , Wei Li , Lianru Gao , Hairong Qi

Semi-supervised domain adaptation (SSDA) aims to solve tasks in target domain by utilizing transferable information learned from the available source domain and a few labeled target data. However, source data is not always accessible in…

Computer Vision and Pattern Recognition · Computer Science 2021-07-21 Xiaodong Wang , Junbao Zhuo , Shuhao Cui , Shuhui Wang

Effort in releasing large-scale datasets may be compromised by privacy and intellectual property considerations. A feasible alternative is to release pre-trained models instead. While these models are strong on their original task (source…

Computer Vision and Pattern Recognition · Computer Science 2021-05-18 Yunzhong Hou , Liang Zheng

Domain adaptation has been a fundamental technology for transferring knowledge from a source domain to a target domain. The key issue of domain adaptation is how to reduce the distribution discrepancy between two domains in a proper way…

Computer Vision and Pattern Recognition · Computer Science 2020-10-21 Lei Tian , Yongqiang Tang , Liangchen Hu , Zhida Ren , Wensheng Zhang

We study the problem of unsupervised domain adaption in the universal scenario, in which only some of the classes are shared between the source and target domains. We present a scoring scheme that is effective in identifying the samples of…

Computer Vision and Pattern Recognition · Computer Science 2020-01-16 Omri Lifshitz , Lior Wolf

We study the problem of unsupervised domain adaptation, which aims to adapt classifiers trained on a labeled source domain to an unlabeled target domain. Many existing approaches first learn domain-invariant features and then construct…

Machine Learning · Computer Science 2012-07-03 Yuan Shi , Fei Sha

Partial Adaptation (PDA) addresses a practical scenario in which the target domain contains only a subset of classes in the source domain. While PDA should take into account both class-level and sample-level to mitigate negative transfer,…

Computer Vision and Pattern Recognition · Computer Science 2020-08-10 Youngeun Kim , Sungeun Hong , Seunghan Yang , Sungil Kang , Yunho Jeon , Jiwon Kim

High accuracy speech recognition requires a large amount of transcribed data for supervised training. In the absence of such data, domain adaptation of a well-trained acoustic model can be performed, but even here, high accuracy usually…

Computation and Language · Computer Science 2017-08-21 Jinyu Li , Michael L. Seltzer , Xi Wang , Rui Zhao , Yifan Gong