English
Related papers

Related papers: Domain Generalization In Robust Invariant Represen…

200 papers

To overcome the restriction of identical distribution assumption, invariant representation learning for unsupervised domain adaptation (UDA) has made significant advances in computer vision and pattern recognition communities. In UDA…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 You-Wei Luo , Chuan-Xian Ren , Xiao-Lin Xu , Qingshan Liu

Extensive work has demonstrated that equivariant neural networks can significantly improve sample efficiency and generalization by enforcing an inductive bias in the network architecture. These applications typically assume that the domain…

Machine Learning · Computer Science 2023-02-13 Dian Wang , Jung Yeon Park , Neel Sortur , Lawson L. S. Wong , Robin Walters , Robert Platt

Training deep neural networks is known to require a large number of training samples. However, in many applications only few training samples are available. In this work, we tackle the issue of training neural networks for classification…

Machine Learning · Computer Science 2017-12-25 Soufiane Belharbi , Clément Chatelain , Romain Hérault , Sébastien Adam

Machine learning algorithms typically assume that the training and test samples come from the same distributions, i.e., in-distribution. However, in open-world scenarios, streaming big data can be Out-Of-Distribution (OOD), rendering these…

Machine Learning · Computer Science 2022-11-10 Anique Tahir , Lu Cheng , Ruocheng Guo , Huan Liu

In real-life applications, machine learning models often face scenarios where there is a change in data distribution between training and test domains. When the aim is to make predictions on distributions different from those seen at…

Machine Learning · Computer Science 2021-11-04 Lucas Mansilla , Rodrigo Echeveste , Diego H. Milone , Enzo Ferrante

We consider the problem of generalization in reinforcement learning where visual aspects of the observations might differ, e.g. when there are different backgrounds or change in contrast, brightness, etc. We assume that our agent has access…

Machine Learning · Computer Science 2021-02-16 Bonnie Li , Vincent François-Lavet , Thang Doan , Joelle Pineau

Studies show that the representations learned by deep neural networks can be transferred to similar prediction tasks in other domains for which we do not have enough labeled data. However, as we transition to higher layers in the model, the…

Machine Learning · Computer Science 2019-10-29 Raha Moraffah , Kai Shu , Adrienne Raglin , Huan Liu

Though remarkable progress has been achieved in various vision tasks, deep neural networks still suffer obvious performance degradation when tested in out-of-distribution scenarios. We argue that the feature statistics (mean and standard…

Computer Vision and Pattern Recognition · Computer Science 2022-04-25 Xiaotong Li , Yongxing Dai , Yixiao Ge , Jun Liu , Ying Shan , Ling-Yu Duan

Real-world classification problems must contend with domain shift, the (potential) mismatch between the domain where a model is deployed and the domain(s) where the training data was gathered. Methods to handle such problems must specify…

Machine Learning · Computer Science 2022-07-05 Yibo Jiang , Victor Veitch

Machine learning systems generally assume that the training and testing distributions are the same. To this end, a key requirement is to develop models that can generalize to unseen distributions. Domain generalization (DG), i.e.,…

Machine Learning · Computer Science 2022-05-25 Jindong Wang , Cuiling Lan , Chang Liu , Yidong Ouyang , Tao Qin , Wang Lu , Yiqiang Chen , Wenjun Zeng , Philip S. Yu

Deep Neural Networks (DNNs) suffer from domain shift when the test dataset follows a distribution different from the training dataset. Domain generalization aims to tackle this issue by learning a model that can generalize to unseen…

Computer Vision and Pattern Recognition · Computer Science 2022-12-15 Yu Ding , Lei Wang , Bin Liang , Shuming Liang , Yang Wang , Fang Chen

Learning models whose predictions are invariant under multiple environments is a promising approach for out-of-distribution generalization. Such models are trained to extract features $X_{\text{inv}}$ where the conditional distribution $Y…

Machine Learning · Computer Science 2024-07-29 Gina Wong , Joshua Gleason , Rama Chellappa , Yoav Wald , Anqi Liu

Domain generalization aims to learn knowledge invariant across different distributions while semantically meaningful for downstream tasks from multiple source domains, to improve the model's generalization ability on unseen target domains.…

Machine Learning · Computer Science 2021-06-03 Yunqi Wang , Furui Liu , Zhitang Chen , Qing Lian , Shoubo Hu , Jianye Hao , Yik-Chung Wu

While deep neural networks have achieved remarkable success in various computer vision tasks, they often fail to generalize to new domains and subtle variations of input images. Several defenses have been proposed to improve the robustness…

Computer Vision and Pattern Recognition · Computer Science 2021-09-08 Omid Poursaeed , Tianxing Jiang , Harry Yang , Serge Belongie , SerNam Lim

Molecular representation learning lays the foundation for drug discovery. However, existing methods suffer from poor out-of-distribution (OOD) generalization, particularly when data for training and testing originate from different…

Machine Learning · Computer Science 2023-10-24 Xiang Zhuang , Qiang Zhang , Keyan Ding , Yatao Bian , Xiao Wang , Jingsong Lv , Hongyang Chen , Huajun Chen

Computer vision research has long aimed to build systems that are robust to spatial transformations found in natural data. Traditionally, this is done using data augmentation or hard-coding invariances into the architecture. However, too…

Computer Vision and Pattern Recognition · Computer Science 2024-02-19 Utkarsh Singhal , Carlos Esteves , Ameesh Makadia , Stella X. Yu

Out-of-distribution (OOD) generalization remains a fundamental challenge in real-world classification, where test distributions often differ substantially from training data. Most existing approaches pursue domain-invariant representations,…

Machine Learning · Computer Science 2026-01-30 Chen Cheng , Ang Li

Domain generalization approaches aim to learn a domain invariant prediction model for unknown target domains from multiple training source domains with different distributions. Significant efforts have recently been committed to broad…

Computer Vision and Pattern Recognition · Computer Science 2021-08-23 Mohammad Mahfujur Rahman , Clinton Fookes , Sridha Sridharan

Domain shifts in the training data are common in practical applications of machine learning; they occur for instance when the data is coming from different sources. Ideally, a ML model should work well independently of these shifts, for…

The task of distribution generalization concerns making reliable prediction of a response in unseen environments. The structural causal models are shown to be useful to model distribution changes through intervention. Motivated by the…

Methodology · Statistics 2022-06-14 Kang Du , Yu Xiang