English
Related papers

Related papers: Domain Adaptation from Scratch

200 papers

Domain adaptation for semantic segmentation aims to improve the model performance in the presence of a distribution shift between source and target domain. Leveraging the supervision from auxiliary tasks~(such as depth estimation) has the…

Computer Vision and Pattern Recognition · Computer Science 2021-08-25 Qin Wang , Dengxin Dai , Lukas Hoyer , Luc Van Gool , Olga Fink

Domain adaptation, adapting models from domains rich in labeled training data to domains poor in such data, is a fundamental NLP challenge. We introduce a neural network model that marries together ideas from two prominent strands of…

Computation and Language · Computer Science 2017-06-20 Yftah Ziser , Roi Reichart

Domain adaptation is the supervised learning setting in which the training and test data are sampled from different distributions: training data is sampled from a source domain, whilst test data is sampled from a target domain. This paper…

Machine Learning · Statistics 2016-10-21 Wouter M. Kouw , Jesse H. Krijthe , Marco Loog , Laurens J. P. van der Maaten

Adapting general large language models (LLMs) to specialized domains presents great challenges due to varied data distributions. This adaptation typically requires continual pre-training on massive domain-specific corpora to facilitate…

Computation and Language · Computer Science 2024-07-16 Jinhao Jiang , Junyi Li , Wayne Xin Zhao , Yang Song , Tao Zhang , Ji-Rong Wen

Unsupervised domain adaptation aims to transfer knowledge from a source domain to a target domain so that the target domain data can be recognized without any explicit labelling information for this domain. One limitation of the problem…

Computer Vision and Pattern Recognition · Computer Science 2019-08-27 Qian Wang , Penghui Bu , Toby P. Breckon

Domain Adaptation (DA) facilitates knowledge transfer from a source domain to a related target domain. This paper investigates a practical DA paradigm, namely Source data-Free Active Domain Adaptation (SFADA), where source data becomes…

Computer Vision and Pattern Recognition · Computer Science 2024-07-29 Mengyao Lyu , Tianxiang Hao , Xinhao Xu , Hui Chen , Zijia Lin , Jungong Han , Guiguang Ding

Domain adaptation is a popular paradigm in modern machine learning which aims at tackling the problem of divergence (or shift) between the labeled training and validation datasets (source domain) and a potentially large unlabeled dataset…

Machine Learning · Computer Science 2023-11-10 Evgeny M Mirkes , Jonathan Bac , Aziz Fouché , Sergey V. Stasenko , Andrei Zinovyev , Alexander N. Gorban

The major challenge in today's computer vision scenario is the availability of good quality labeled data. In a field of study like image classification, where data is of utmost importance, we need to find more reliable methods which can…

Computer Vision and Pattern Recognition · Computer Science 2025-10-15 Aashish Dhawan , Divyanshu Mudgal

Recent work has demonstrated that pre-training in-domain language models can boost performance when adapting to a new domain. However, the costs associated with pre-training raise an important question: given a fixed budget, what steps…

Computation and Language · Computer Science 2022-05-16 Fan Bai , Alan Ritter , Wei Xu

Domain Adaptation (DA), the process of effectively adapting task models learned on one domain, the source, to other related but distinct domains, the targets, with no or minimal retraining, is typically accomplished using the process of…

Computer Vision and Pattern Recognition · Computer Science 2019-09-30 Behnam Gholami , Pritish Sahu , Minyoung Kim , Vladimir Pavlovic

Natural Language Processing (NLP) is an essential subset of artificial intelligence. It has become effective in several domains, such as healthcare, finance, and media, to identify perceptions, opinions, and misuse, among others. Privacy is…

Computation and Language · Computer Science 2025-01-20 Andrick Adhikari , Sanchari Das , Rinku Dewri

Domain adaptation is a crucial and increasingly important task in remote sensing, aiming to transfer knowledge from a source domain a differently distributed target domain. It has broad applications across various real-world applications,…

Computer Vision and Pattern Recognition · Computer Science 2025-10-20 Shuchang Lyu , Qi Zhao , Zheng Zhou , Meng Li , You Zhou , Dingding Yao , Guangliang Cheng , Huiyu Zhou , Zhenwei Shi

The goal of Deep Domain Adaptation is to make it possible to use Deep Nets trained in one domain where there is enough annotated training data in another where there is little or none. Most current approaches have focused on learning…

Computer Vision and Pattern Recognition · Computer Science 2017-11-22 Artem Rozantsev , Mathieu Salzmann , Pascal Fua

Images seen during test time are often not from the same distribution as images used for learning. This problem, known as domain shift, occurs when training classifiers from object-centric internet image databases and trying to apply them…

Computer Vision and Pattern Recognition · Computer Science 2013-08-21 Erik Rodner , Judy Hoffman , Jeff Donahue , Trevor Darrell , Kate Saenko

The difficulty of anonymizing text data hinders the development and deployment of NLP in high-stakes domains that involve private data, such as healthcare and social services. Poorly anonymized sensitive data cannot be easily shared with…

Computation and Language · Computer Science 2024-10-14 Krithika Ramesh , Nupoor Gandhi , Pulkit Madaan , Lisa Bauer , Charith Peris , Anjalie Field

Generalisation of deep neural networks becomes vulnerable when distribution shifts are encountered between train (source) and test (target) domain data. Few-shot domain adaptation mitigates this issue by adapting deep neural networks…

Computer Vision and Pattern Recognition · Computer Science 2023-08-10 Youssef Dawoud , Gustavo Carneiro , Vasileios Belagiannis

Unsupervised domain adaptation for point cloud semantic segmentation has attracted great attention due to its effectiveness in learning with unlabeled data. Most of existing methods use global-level feature alignment to transfer the…

Computer Vision and Pattern Recognition · Computer Science 2022-08-10 Yikai Bian , Le Hui , Jianjun Qian , Jin Xie

The standard closed-set domain adaptation approaches seek to mitigate distribution discrepancies between two domains under the constraint of both sharing identical label sets. However, in realistic scenarios, finding an optimal source…

Machine Learning · Computer Science 2022-12-06 Sandipan Choudhuri , Suli Adeniye , Arunabha Sen , Hemanth Venkateswara

While deep learning techniques have shown promising results in many natural language processing (NLP) tasks, it has not been widely applied to the clinical domain. The lack of large datasets and the pervasive use of domain-specific language…

Computation and Language · Computer Science 2019-06-20 Jiin Nam , Seunghyun Yoon , Kyomin Jung

Domain shift is a fundamental problem in visual recognition which typically arises when the source and target data follow different distributions. The existing domain adaptation approaches which tackle this problem work in the closed-set…

Computer Vision and Pattern Recognition · Computer Science 2020-07-01 Yadan Luo , Zijian Wang , Zi Huang , Mahsa Baktashmotlagh