English
Related papers

Related papers: Domain Generalization via Rationale Invariance

200 papers

Model explainability is crucial for human users to be able to interpret how a proposed classifier assigns labels to data based on its feature values. We study generalized linear models constructed using sets of feature value rules, which…

Machine Learning · Statistics 2023-11-06 Sanjeeb Dash , Soumyadip Ghosh , Joao Goncalves , Mark S. Squillante

We consider the problem of generalization in reinforcement learning where visual aspects of the observations might differ, e.g. when there are different backgrounds or change in contrast, brightness, etc. We assume that our agent has access…

Machine Learning · Computer Science 2021-02-16 Bonnie Li , Vincent François-Lavet , Thang Doan , Joelle Pineau

We introduce a novel end-to-end approach for learning to cluster in the absence of labeled examples. Our clustering objective is based on optimizing normalized cuts, a criterion which measures both intra-cluster similarity as well as…

Machine Learning · Computer Science 2019-10-18 Azade Nazi , Will Hang , Anna Goldie , Sujith Ravi , Azalia Mirhoseini

Poor generalization performance caused by distribution shifts in unseen domains often hinders the trustworthy deployment of deep neural networks. Many domain generalization techniques address this problem by adding a domain invariant…

Invariant risk minimization (IRM) has recently emerged as a promising alternative for domain generalization. Nevertheless, the loss function is difficult to optimize for nonlinear classifiers and the original optimization objective could…

Machine Learning · Computer Science 2022-03-22 Bo Li , Yifei Shen , Yezhen Wang , Wenzhen Zhu , Colorado J. Reed , Jun Zhang , Dongsheng Li , Kurt Keutzer , Han Zhao

Hybrid learning methods use theoretical knowledge of a domain and a set of classified examples to develop a method for classification. Methods that use domain knowledge have been shown to perform better than inductive learners. However,…

Machine Learning · Computer Science 2011-01-26 Ridwan Al Iqbal

The well known domain shift issue causes model performance to degrade when deployed to a new target domain with different statistics to training. Domain adaptation techniques alleviate this, but need some instances from the target domain to…

Machine Learning · Computer Science 2019-06-11 Yiying Li , Yongxin Yang , Wei Zhou , Timothy M. Hospedales

Achieving the generalization of an invariant classifier from training domains to shifted test domains while simultaneously considering model fairness is a substantial and complex challenge in machine learning. Existing methods address the…

Machine Learning · Computer Science 2024-08-20 Dong Li , Chen Zhao , Minglai Shao , Wenjun Wang

The principal innovative idea in this paper is to transform the original complex nonlinear modeling problem into a combination of linear problem and very simple nonlinear problems. The key step is the generalized linearization of nonlinear…

Computational Engineering, Finance, and Science · Computer Science 2024-09-21 W. Chen

Geographic distribution shift arises when the distribution of locations on Earth in a training dataset is different from what is seen at inference time. Using standard empirical risk minimization (ERM) in this setting can lead to uneven…

Machine Learning · Computer Science 2026-02-10 Ruth Crasto , Esther Rolf

The data-driven approach to robot control has been gathering pace rapidly, yet generalization to unseen task domains remains a critical challenge. We argue that the key to generalization is representations that are (i) rich enough to…

Robotics · Computer Science 2023-12-05 Bo Ai , Zhanxin Wu , David Hsu

Deep learning models usually suffer from domain shift issues, where models trained on one source domain do not generalize well to other unseen domains. In this work, we investigate the single-source domain generalization problem: training a…

Computer Vision and Pattern Recognition · Computer Science 2023-04-24 Cheng Ouyang , Chen Chen , Surui Li , Zeju Li , Chen Qin , Wenjia Bai , Daniel Rueckert

Existing calibration algorithms address the problem of covariate shift via unsupervised domain adaptation. However, these methods suffer from the following limitations: 1) they require unlabeled data from the target domain, which may not be…

Machine Learning · Computer Science 2021-10-19 Yunye Gong , Xiao Lin , Yi Yao , Thomas G. Dietterich , Ajay Divakaran , Melinda Gervasio

Domain generalization (DG), aiming at models able to work on multiple unseen domains, is a must-have characteristic of general artificial intelligence. DG based on single source domain training data is more challenging due to the lack of…

Computer Vision and Pattern Recognition · Computer Science 2023-04-17 Qingyue Yang , Hongjing Niu , Pengfei Xia , Wei Zhang , Bin Li

Domain generalization requires identifying stable representations that support reliable classification across domains. Most existing methods seek such stability through improving the training process, for example, through model selection…

Computer Vision and Pattern Recognition · Computer Science 2026-05-08 Dat Nguyen , Duc-Duy Nguyen

The aim of this paper is to establish a theory of random variables on domains. Domain theory is a fundamental component of theoretical computer science, providing mathematical models of computational processes. Random variables are the…

Logic in Computer Science · Computer Science 2016-08-30 Michael W. Mislove

Deep learning has revolutionized neuroimage analysis by delivering unprecedented speed and accuracy. However, the narrow scope of many training datasets constrains model robustness and generalizability. This challenge is particularly acute…

Image and Video Processing · Electrical Eng. & Systems 2025-12-08 Malte Hoffmann

We introduce a general reduction strategy that enables one to search for solutions of parameterized linear difference equations in difference rings. Here we assume that the ring itself can be decomposed by a direct sum of integral domains…

Symbolic Computation · Computer Science 2021-02-08 Jakob Ablinger , Carsten Schneider

The task of distribution generalization concerns making reliable prediction of a response in unseen environments. The structural causal models are shown to be useful to model distribution changes through intervention. Motivated by the…

Methodology · Statistics 2022-06-14 Kang Du , Yu Xiang

Due to domain shift, deep neural networks (DNNs) usually fail to generalize well on unknown test data in practice. Domain generalization (DG) aims to overcome this issue by capturing domain-invariant representations from source domains.…

Machine Learning · Computer Science 2022-11-10 Feng Hou , Yao Zhang , Yang Liu , Jin Yuan , Cheng Zhong , Yang Zhang , Zhongchao Shi , Jianping Fan , Zhiqiang He