English
Related papers

Related papers: Domain Adaptation for Statistical Classifiers

200 papers

Progress in machine learning is typically measured by training and testing a model on the same distribution of data, i.e., the same domain. This over-estimates future accuracy on out-of-distribution data. The Visual Domain Adaptation…

Machine Learning · Computer Science 2021-07-26 Dina Bashkirova , Dan Hendrycks , Donghyun Kim , Samarth Mishra , Kate Saenko , Kuniaki Saito , Piotr Teterwak , Ben Usman

We present a novel approach for test-time adaptation via online self-training, consisting of two components. First, we introduce a statistical framework that detects distribution shifts in the classifier's entropy values obtained on a…

Machine Learning · Computer Science 2025-01-07 Yarin Bar , Shalev Shaer , Yaniv Romano

Object counting models suffer when deployed across domains with differing density variety, since density shifts are inherently task-relevant and violate standard domain adaptation assumptions. To address this, we propose a theoretical…

Computer Vision and Pattern Recognition · Computer Science 2025-11-03 Zhuonan Liang , Dongnan Liu , Jianan Fan , Yaxuan Song , Qiang Qu , Runnan Chen , Yu Yao , Peng Fu , Weidong Cai

Domain adaptation aims to transfer knowledge from a domain with adequate labeled samples to a domain with scarce labeled samples. Prior research has introduced various open set domain adaptation settings in the literature to extend the…

Computer Vision and Pattern Recognition · Computer Science 2020-09-25 Tasfia Shermin , Guojun Lu , Shyh Wei Teng , Manzur Murshed , Ferdous Sohel

Domain generalization involves learning a classifier from a heterogeneous collection of training sources such that it generalizes to data drawn from similar unknown target domains, with applications in large-scale learning and personalized…

Machine Learning · Computer Science 2021-12-24 Xavier Thomas , Dhruv Mahajan , Alex Pentland , Abhimanyu Dubey

Domain adaptation (DA) is transfer learning which aims to learn an effective predictor on target data from source data despite data distribution mismatch between source and target. We present in this paper a novel unsupervised DA method for…

Computer Vision and Pattern Recognition · Computer Science 2018-02-23 Lingkun Luo , Liming Chen , Ying lu , Shiqiang Hu

State of the art models using deep neural networks have become very good in learning an accurate mapping from inputs to outputs. However, they still lack generalization capabilities in conditions that differ from the ones encountered during…

Computation and Language · Computer Science 2018-08-28 Alexey Romanov , Chaitanya Shivade

Multi-source domain adaptation aims to reduce performance degradation when applying machine learning models to unseen domains. A fundamental challenge is devising the optimal strategy for feature selection. Existing literature is somewhat…

Machine Learning · Statistics 2024-03-12 Ziliang Samuel Zhong , Xiang Pan , Qi Lei

In this work, we present a method for unsupervised domain adaptation. Many adversarial learning methods train domain classifier networks to distinguish the features as either a source or target and train a feature generator network to mimic…

Computer Vision and Pattern Recognition · Computer Science 2018-04-04 Kuniaki Saito , Kohei Watanabe , Yoshitaka Ushiku , Tatsuya Harada

Domain adaptation is a popular paradigm in modern machine learning which aims at tackling the problem of divergence (or shift) between the labeled training and validation datasets (source domain) and a potentially large unlabeled dataset…

Machine Learning · Computer Science 2023-11-10 Evgeny M Mirkes , Jonathan Bac , Aziz Fouché , Sergey V. Stasenko , Andrei Zinovyev , Alexander N. Gorban

In many machine learning domains, datasets are characterized by highly imbalanced and overlapping classes. Particularly in the medical domain, a specific list of symptoms can be labeled as one of various different conditions. Some of these…

Machine Learning · Computer Science 2020-06-03 Ran Ilan Ber , Tom Haramaty

In the problem of domain generalization (DG), there are labeled training data sets from several related prediction problems, and the goal is to make accurate predictions on future unlabeled data sets that are not known to the learner. This…

Machine Learning · Statistics 2021-01-08 Gilles Blanchard , Aniket Anand Deshmukh , Urun Dogan , Gyemin Lee , Clayton Scott

The similarity of feature representations plays a pivotal role in the success of problems related to domain adaptation. Feature similarity includes both the invariance of marginal distributions and the closeness of conditional distributions…

Machine Learning · Computer Science 2022-01-10 Ammar Shaker , Shujian Yu , Daniel Oñoro-Rubio

The data distribution commonly evolves over time leading to problems such as concept drift that often decrease classifier performance. Current techniques are not adequate for this problem because they either require detailed knowledge of…

Machine Learning · Computer Science 2022-06-13 Johannes Schneider

Despite remarkable success in a variety of applications, it is well-known that deep learning can fail catastrophically when presented with out-of-distribution data. Toward addressing this challenge, we consider the domain generalization…

Machine Learning · Statistics 2021-11-16 Alexander Robey , George J. Pappas , Hamed Hassani

The basic underlying assumption of machine learning (ML) models is that the training and test data are sampled from the same distribution. However, in daily practice, this assumption is often broken, i.e. the distribution of the test data…

Computation and Language · Computer Science 2026-01-16 Adriana Valentina Costache , Silviu Florin Gheorghe , Eduard Gabriel Poesina , Paul Irofti , Radu Tudor Ionescu

Machine translation systems are vulnerable to domain mismatch, especially in a low-resource scenario. Out-of-domain translations are often of poor quality and prone to hallucinations, due to exposure bias and the decoder acting as a…

Computation and Language · Computer Science 2021-09-22 Nikolay Bogoychev , Pinzhen Chen

Domain adaptation aims to transfer the knowledge learned on (data-rich) source domains to (low-resource) target domains, and a popular method is invariant representation learning, which matches and aligns the data distributions on the…

Information Retrieval · Computer Science 2023-11-01 Ruicheng Xian , Honglei Zhuang , Zhen Qin , Hamed Zamani , Jing Lu , Ji Ma , Kai Hui , Han Zhao , Xuanhui Wang , Michael Bendersky

Domain adaptation is transfer learning which aims to generalize a learning model across training and testing data with different distributions. Most previous research tackle this problem in seeking a shared feature representation between…

Machine Learning · Computer Science 2017-04-17 Lingkun Luo , Xiaofang Wang , Shiqiang Hu , Chao Wang , Yuxing Tang , Liming Chen

We study the problem of unsupervised domain adaption in the universal scenario, in which only some of the classes are shared between the source and target domains. We present a scoring scheme that is effective in identifying the samples of…

Computer Vision and Pattern Recognition · Computer Science 2020-01-16 Omri Lifshitz , Lior Wolf