English
Related papers

Related papers: Frustratingly Easy Domain Adaptation

200 papers

We tackle an unsupervised domain adaptation problem for which the domain discrepancy between labeled source and unlabeled target domains is large, due to many factors of inter and intra-domain variation. While deep domain adaptation methods…

Computer Vision and Pattern Recognition · Computer Science 2020-08-26 Shuyang Dai , Kihyuk Sohn , Yi-Hsuan Tsai , Lawrence Carin , Manmohan Chandraker

Large Language Models (LLMs), being generic task solvers, are versatile. However, despite the vast amount of data they are trained on, there are speculations about their adaptation capabilities to a new domain. Additionally, the simple…

Computation and Language · Computer Science 2025-09-03 Anum Afzal , Mehul Kumawat , Florian Matthes

The task of learning a sentiment classification model that adapts well to any target domain, different from the source domain, is a challenging problem. Majority of the existing approaches focus on learning a common representation by…

Machine Learning · Computer Science 2019-12-05 Pratik Kayal , Mayank Singh , Pawan Goyal

Domain adaptation aims to learn models on a supervised source domain that perform well on an unsupervised target. Prior work has examined domain adaptation in the context of stationary domain shifts, i.e. static data sets. However, with…

Computer Vision and Pattern Recognition · Computer Science 2018-08-03 Sindi Shkodrani , Michael Hofmann , Efstratios Gavves

The development of deep learning techniques has allowed Neural Machine Translation (NMT) models to become extremely powerful, given sufficient training data and training time. However, systems struggle when translating text from a new…

Computation and Language · Computer Science 2022-03-23 Danielle Saunders

Getting deep convolutional neural networks to perform well requires a large amount of training data. When the available labelled data is small, it is often beneficial to use transfer learning to leverage a related larger dataset (source) in…

Machine Learning · Computer Science 2021-10-26 Lukas Hedegaard Morsing , Omar Ali Sheikh-Omar , Alexandros Iosifidis

Fine-tuning is known to improve NLP models by adapting an initial model trained on more plentiful but less domain-salient examples to data in a target domain. Such domain adaptation is typically done using one stage of fine-tuning. We…

Computation and Language · Computer Science 2021-09-08 Haoran Xu , Seth Ebner , Mahsa Yarmohammadi , Aaron Steven White , Benjamin Van Durme , Kenton Murray

Training models dedicated to semantic segmentation requires a large amount of pixel-wise annotated data. Due to their costly nature, these annotations might not be available for the task at hand. To alleviate this problem, unsupervised…

Computer Vision and Pattern Recognition · Computer Science 2022-06-07 Fei Pan , Francois Rameau , Junsik Kim , In So Kweon

In many practical applications, it is often difficult and expensive to obtain enough large-scale labeled data to train deep neural networks to their full capability. Therefore, transferring the learned knowledge from a separate, labeled…

Machine Learning · Computer Science 2020-02-28 Sicheng Zhao , Bo Li , Colorado Reed , Pengfei Xu , Kurt Keutzer

Data sparsity is an inherent challenge in the recommender systems, where most of the data is collected from the implicit feedbacks of users. This causes two difficulties in designing effective algorithms: first, the majority of users only…

Information Retrieval · Computer Science 2020-07-15 Wenhui Yu , Xiao Lin , Junfeng Ge , Wenwu Ou , Zheng Qin

Deep learning has recently been shown to be instrumental in the problem of domain adaptation, where the goal is to learn a model on a target domain using a similar --but not identical-- source domain. The rationale for coupling both…

Machine Learning · Computer Science 2018-08-17 Behrang Mehrparvar , Ricardo Vilalta

Domain shift is a well known problem where a model trained on a particular domain (source) does not perform well when exposed to samples from a different domain (target). Unsupervised methods that can adapt to domain shift are highly…

Computer Vision and Pattern Recognition · Computer Science 2021-08-04 Botos Csaba , Xiaojuan Qi , Arslan Chaudhry , Puneet Dokania , Philip Torr

Unsupervised domain adaptation (uDA) models focus on pairwise adaptation settings where there is a single, labeled, source and a single target domain. However, in many real-world settings one seeks to adapt to multiple, but somewhat…

Computer Vision and Pattern Recognition · Computer Science 2018-10-30 Behnam Gholami , Pritish Sahu , Ognjen Rudovic , Konstantinos Bousmalis , Vladimir Pavlovic

Domain adaptation is critical for learning in new and unseen environments. With domain adversarial training, deep networks can learn disentangled and transferable features that effectively diminish the dataset shift between the source and…

Computer Vision and Pattern Recognition · Computer Science 2019-04-09 Zhangjie Cao , Kaichao You , Mingsheng Long , Jianmin Wang , Qiang Yang

Segmentation is a crucial analysis task in biomedical imaging. Given the diverse experimental settings in this field, the lack of generalization limits the use of deep learning in practice. Domain adaptation is a promising remedy: it…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Anwai Archit , Constantin Pape

Transferring the knowledge of pretrained networks to new domains by means of finetuning is a widely used practice for applications based on discriminative models. To the best of our knowledge this practice has not been studied within the…

Computer Vision and Pattern Recognition · Computer Science 2018-10-03 Yaxing Wang , Chenshen Wu , Luis Herranz , Joost van de Weijer , Abel Gonzalez-Garcia , Bogdan Raducanu

This paper studies the problem of stance detection which aims to predict the perspective (or stance) of a given document with respect to a given claim. Stance detection is a major component of automated fact checking. As annotating stances…

Machine Learning · Computer Science 2019-02-08 Brian Xu , Mitra Mohtarami , James Glass

Domain adaptation is a potential method to train a powerful deep neural network, which can handle the absence of labeled data. More precisely, domain adaptation solving the limitation called dataset bias or domain shift when the training…

Computer Vision and Pattern Recognition · Computer Science 2022-10-20 Thai-Vu Nguyen , Anh Nguyen , Nghia Le , Bac Le

Domain adaptation for semantic segmentation has recently been actively studied to increase the generalization capabilities of deep learning models. The vast majority of the domain adaptation methods tackle single-source case, where the…

Image and Video Processing · Electrical Eng. & Systems 2020-04-16 Onur Tasar , Yuliya Tarabalka , Alain Giros , Pierre Alliez , Sébastien Clerc

In contrast to a standard closed-set domain adaptation task, partial domain adaptation setup caters to a realistic scenario by relaxing the identical label set assumption. The fact of source label set subsuming the target label set,…

Machine Learning · Computer Science 2022-12-12 Sandipan Choudhuri , Hemanth Venkateswara , Arunabha Sen