English
Related papers

Related papers: Respecting Domain Relations: Hypothesis Invariance…

200 papers

The phenomenon of distribution shift (DS) occurs when a dataset at test time differs from the dataset at training time, which can significantly impair the performance of a machine learning model in practical settings due to a lack of…

Domain Generalization aims to develop models that can generalize to novel and unseen data distributions. In this work, we study how model architectures and pre-training objectives impact feature richness and propose a method to effectively…

Machine Learning · Computer Science 2025-04-30 Xavier Thomas , Deepti Ghadiyaram

Emerging diseases present challenges in symptom recognition and timely clinical intervention due to limited available information. An effective prognostic model could assist physicians in making accurate diagnoses and designing personalized…

Machine Learning · Computer Science 2025-02-12 Zhongji Zhang , Yuhang Wang , Yinghao Zhu , Xinyu Ma , Yasha Wang , Junyi Gao , Liantao Ma , Wen Tang , Xiaoyun Zhang , Ling Wang

Machine learning algorithms with empirical risk minimization usually suffer from poor generalization performance due to the greedy exploitation of correlations among the training data, which are not stable under distributional shifts.…

Machine Learning · Computer Science 2021-06-18 Jiashuo Liu , Zheyuan Hu , Peng Cui , Bo Li , Zheyan Shen

Recent work has highlighted the label alignment property (LAP) in supervised learning, where the vector of all labels in the dataset is mostly in the span of the top few singular vectors of the data matrix. Drawing inspiration from this…

Machine Learning · Computer Science 2024-09-12 Ehsan Imani , Guojun Zhang , Runjia Li , Jun Luo , Pascal Poupart , Philip H. S. Torr , Yangchen Pan

Machine learning models trained with purely observational data and the principle of empirical risk minimization \citep{vapnik_principles_1992} can fail to generalize to unseen domains. In this paper, we focus on the case where the problem…

Machine Learning · Statistics 2020-10-27 Maximilian Ilse , Jakub M. Tomczak , Patrick Forré

The problem of domain generalization is to learn, given data from different source distributions, a model that can be expected to generalize well on new target distributions which are only seen through unlabeled samples. In this paper, we…

Machine Learning · Computer Science 2024-03-12 Markus Holzleitner , Sergei V. Pereverzyev , Werner Zellinger

Semi-supervised domain adaptation (SSDA) aims to solve tasks in target domain by utilizing transferable information learned from the available source domain and a few labeled target data. However, source data is not always accessible in…

Computer Vision and Pattern Recognition · Computer Science 2021-07-21 Xiaodong Wang , Junbao Zhuo , Shuhao Cui , Shuhui Wang

We consider unsupervised domain adaptation: given labelled examples from a source domain and unlabelled examples from a related target domain, the goal is to infer the labels of target examples. Under the assumption that features from…

Machine Learning · Statistics 2019-01-08 Jeroen Manders , Twan van Laarhoven , Elena Marchiori

Domain generalization (DG) tends to alleviate the poor generalization capability of deep neural networks by learning model with multiple source domains. A classical solution to DG is domain augmentation, the common belief of which is that…

Computer Vision and Pattern Recognition · Computer Science 2023-03-24 Fangrui Lv , Jian Liang , Shuang Li , Jinming Zhang , Di Liu

Deep learning has produced state-of-the-art results for a variety of tasks. While such approaches for supervised learning have performed well, they assume that training and testing data are drawn from the same distribution, which may not…

Machine Learning · Computer Science 2020-02-10 Garrett Wilson , Diane J. Cook

Invariant approaches have been remarkably successful in tackling the problem of domain generalization, where the objective is to perform inference on data distributions different from those used in training. In our work, we investigate…

Computer Vision and Pattern Recognition · Computer Science 2021-03-31 Abhimanyu Dubey , Vignesh Ramanathan , Alex Pentland , Dhruv Mahajan

Domain generalization (DG) intends to train a model on multiple source domains to ensure that it can generalize well to an arbitrary unseen target domain. The acquisition of domain-invariant representations is pivotal for DG as they possess…

Computer Vision and Pattern Recognition · Computer Science 2024-01-12 Na Wang , Lei Qi , Jintao Guo , Yinghuan Shi , Yang Gao

This work studies the generalization issue of face anti-spoofing (FAS) models on domain gaps, such as image resolution, blurriness and sensor variations. Most prior works regard domain-specific signals as a negative impact, and apply metric…

Computer Vision and Pattern Recognition · Computer Science 2023-03-27 Yiyou Sun , Yaojie Liu , Xiaoming Liu , Yixuan Li , Wen-Sheng Chu

Unsupervised domain adaptation methods aim to alleviate performance degradation caused by domain-shift by learning domain-invariant representations. Existing deep domain adaptation methods focus on holistic feature alignment by matching…

Machine Learning · Computer Science 2018-11-20 Jun Wen , Risheng Liu , Nenggan Zheng , Qian Zheng , Zhefeng Gong , Junsong Yuan

Despite impressive success in many tasks, deep learning models are shown to rely on spurious features, which will catastrophically fail when generalized to out-of-distribution (OOD) data. Invariant Risk Minimization (IRM) is proposed to…

Machine Learning · Computer Science 2022-12-20 Shiji Xin , Yifei Wang , Jingtong Su , Yisen Wang

Recently, considerable effort has been devoted to deep domain adaptation in computer vision and machine learning communities. However, most of existing work only concentrates on learning shared feature representation by minimizing the…

Machine Learning · Computer Science 2019-04-24 Chao Chen , Zhihong Chen , Boyuan Jiang , Xinyu Jin

One method for obtaining generalizable solutions to machine learning tasks when presented with diverse training environments is to find \textit{invariant representations} of the data. These are representations of the covariates such that…

Machine Learning · Computer Science 2022-08-16 Advait Parulekar , Karthikeyan Shanmugam , Sanjay Shakkottai

Aiming to generalize the label knowledge from a source domain with continuous outputs to an unlabeled target domain, Domain Adaptation Regression (DAR) is developed for complex practical learning problems. However, due to the continuity…

Machine Learning · Computer Science 2024-08-14 Hao-Ran Yang , Chuan-Xian Ren , You-Wei Luo

Domain generalisation (DG) methods address the problem of domain shift, when there is a mismatch between the distributions of training and target domains. Data augmentation approaches have emerged as a promising alternative for DG. However,…

Machine Learning · Computer Science 2020-12-29 Hoang Son Le , Rini Akmeliawati , Gustavo Carneiro