English
Related papers

Related papers: Adaptive Risk Minimization: Learning to Adapt to D…

200 papers

We investigate the fundamental performance limitations of learning algorithms in several Domain Generalisation (DG) settings. Motivated by the difficulty with which previously proposed methods have in reliably outperforming Empirical Risk…

Machine Learning · Statistics 2024-05-24 Henry Gouk , Ondrej Bohdal , Da Li , Timothy Hospedales

Domain generalization methods aim to learn models robust to domain shift with data from a limited number of source domains and without access to target domain samples during training. Popular domain alignment methods for domain…

Machine Learning · Computer Science 2022-06-17 Wenyu Zhang , Mohamed Ragab , Chuan-Sheng Foo

While domain adaptation methods address data shifts, most assume target populations align with at least one source population, neglecting mixtures that combine sources influenced by factors like demographics. Additional challenges in…

Methodology · Statistics 2025-05-02 Keyao Zhan , Xin Xiong , Zijian Guo , Tianxi Cai , Molei Liu

Domain adaptation is an important problem and often needed for real-world applications. In this problem, instead of i.i.d. training and testing datapoints, we assume that the source (training) data and the target (testing) data have…

Machine Learning · Computer Science 2022-03-15 A. Tuan Nguyen , Toan Tran , Yarin Gal , Philip H. S. Torr , Atılım Güneş Baydin

A basic assumption of statistical learning theory is that train and test data are drawn from the same underlying distribution. Unfortunately, this assumption doesn't hold in many applications. Instead, ample labeled data might exist in a…

Computer Vision and Pattern Recognition · Computer Science 2012-11-21 Oscar Beijbom

We propose a new \emph{Transformed Risk Minimization} (TRM) framework as an extension of classical risk minimization. In TRM, we optimize not only over predictive models, but also over data transformations; specifically over distributions…

Machine Learning · Computer Science 2023-10-09 Evangelos Chatzipantazis , Stefanos Pertigkiozoglou , Kostas Daniilidis , Edgar Dobriban

Existing calibration algorithms address the problem of covariate shift via unsupervised domain adaptation. However, these methods suffer from the following limitations: 1) they require unlabeled data from the target domain, which may not be…

Machine Learning · Computer Science 2021-10-19 Yunye Gong , Xiao Lin , Yi Yao , Thomas G. Dietterich , Ajay Divakaran , Melinda Gervasio

Domain adaptation (DA) is a technique that transfers predictive models trained on a labeled source domain to an unlabeled target domain, with the core difficulty of resolving distributional shift between domains. Currently, most popular DA…

Computer Vision and Pattern Recognition · Computer Science 2020-07-06 Bo Li , Yezhen Wang , Tong Che , Shanghang Zhang , Sicheng Zhao , Pengfei Xu , Wei Zhou , Yoshua Bengio , Kurt Keutzer

Learning with identical train and test distributions has been extensively investigated both practically and theoretically. Much remains to be understood, however, in statistical learning under distribution shifts. This paper focuses on a…

Machine Learning · Computer Science 2024-11-01 Omar Montasser , Han Shao , Emmanuel Abbe

Data samples generated by several real world processes are dynamic in nature \textit{i.e.}, their characteristics vary with time. Thus it is not possible to train and tackle all possible distributional shifts between training and inference,…

Machine Learning · Computer Science 2021-10-22 Prabhu Teja Sivaprasad , François Fleuret

Domain adaptation is a sub-field of machine learning that involves transferring knowledge from a source domain to perform the same task in the target domain. It is a typical challenge in machine learning that arises, e.g., when data is…

Machine Learning · Computer Science 2025-01-09 Philipp Spitzer , Dominik Martin , Laurin Eichberger , Niklas Kühl

Deep learning-based methods deliver state-of-the-art performance for solving inverse problems that arise in computational imaging. These methods can be broadly divided into two groups: (1) learn a network to map measurements to the signal…

Image and Video Processing · Electrical Eng. & Systems 2023-10-11 Nebiyou Yismaw , Ulugbek S. Kamilov , M. Salman Asif

Enhancing the stability of machine learning algorithms under distributional shifts is at the heart of the Out-of-Distribution (OOD) Generalization problem. Derived from causal learning, recent works of invariant learning pursue strict…

Machine Learning · Computer Science 2024-02-15 Jiashuo Liu , Jiayun Wu , Jie Peng , Xiaoyu Wu , Yang Zheng , Bo Li , Peng Cui

Visual data driven dictionaries have been successfully employed for various object recognition and classification tasks. However, the task becomes more challenging if the training and test data are from contrasting domains. In this paper,…

Computer Vision and Pattern Recognition · Computer Science 2014-11-04 Varun Panaganti

Domain adaptation algorithms are useful when the distributions of the training and the test data are different. In this paper, we focus on the problem of instrumental variation and time-varying drift in the field of sensors and measurement,…

Computer Vision and Pattern Recognition · Computer Science 2017-06-23 Ke Yan , Lu Kou , David Zhang

In practice, the data distribution at test time often differs, to a smaller or larger extent, from that of the original training data. Consequentially, the so-called source classifier, trained on the available labelled data, deteriorates on…

Machine Learning · Statistics 2021-06-18 Wouter M. Kouw , Marco Loog

We introduce a new representation learning algorithm suited to the context of domain adaptation, in which data at training and test time come from similar but different distributions. Our algorithm is directly inspired by theory on domain…

Machine Learning · Statistics 2015-02-10 Hana Ajakan , Pascal Germain , Hugo Larochelle , François Laviolette , Mario Marchand

Machine learning algorithms with empirical risk minimization usually suffer from poor generalization performance due to the greedy exploitation of correlations among the training data, which are not stable under distributional shifts.…

Machine Learning · Computer Science 2021-06-18 Jiashuo Liu , Zheyuan Hu , Peng Cui , Bo Li , Zheyan Shen

Domain adaptation seeks to leverage the abundant label information in a source domain to improve classification performance in a target domain with limited labels. While the field has seen extensive methodological development, its…

Machine Learning · Statistics 2025-07-31 Elif Vural , Huseyin Karaca

In AI-based histopathology, domain shifts are common and well-studied. However, this research focuses on stain and scanner variations, which do not show the full picture -- shifts may be combinations of other shifts, or "invisible" shifts…

Image and Video Processing · Electrical Eng. & Systems 2023-05-10 Andrew Walker