English
Related papers

Related papers: Domain Generalization via Rationale Invariance

200 papers

Deep neural networks can obtain impressive performance on various tasks under the assumption that their training domain is identical to their target domain. Performance can drop dramatically when this assumption does not hold. One…

Machine Learning · Computer Science 2024-10-10 Gaël Gendron , Michael Witbrock , Gillian Dobbie

In domain generalization, multiple labeled non-independent and non-identically distributed source domains are available during training while neither the data nor the labels of target domains are. Currently, learning so-called domain…

Machine Learning · Computer Science 2020-10-16 Ziqi Wang , Marco Loog , Jan van Gemert

Deep reinforcement learning (RL) agents often fail to generalize to unseen environments (yet semantically similar to trained agents), particularly when they are trained on high-dimensional state spaces, such as images. In this paper, we…

Machine Learning · Computer Science 2020-02-18 Kimin Lee , Kibok Lee , Jinwoo Shin , Honglak Lee

The lack of interpretability remains a barrier to the adoption of deep neural networks. Recently, tree regularization has been proposed to encourage deep neural networks to resemble compact, axis-aligned decision trees without significant…

Machine Learning · Computer Science 2020-03-17 Mike Wu , Sonali Parbhoo , Michael Hughes , Ryan Kindle , Leo Celi , Maurizio Zazzi , Volker Roth , Finale Doshi-Velez

Deep neural networks often suffer performance drops when test data distribution differs from training data. Domain Generalization (DG) aims to address this by focusing on domain-invariant features or augmenting data for greater diversity.…

Computer Vision and Pattern Recognition · Computer Science 2025-09-09 Nam Duong Tran , Nam Nguyen Phuong , Hieu H. Pham , Phi Le Nguyen , My T. Thai

Learning models that gracefully handle distribution shifts is central to research on domain generalization, robust optimization, and fairness. A promising formulation is domain-invariant learning, which identifies the key issue of learning…

Machine Learning · Computer Science 2021-07-16 Elliot Creager , Jörn-Henrik Jacobsen , Richard Zemel

Current supervised learning models cannot generalize well across domain boundaries, which is a known problem in many applications, such as robotics or visual classification. Domain adaptation methods are used to improve these generalization…

Machine Learning · Computer Science 2020-07-09 Christoph Raab , Frank-Michael Schleif

Despite the recent success of deep neural networks, there remains a need for effective methods to enhance domain generalization using vision transformers. In this paper, we propose a novel domain generalization technique called Robust…

Computer Vision and Pattern Recognition · Computer Science 2024-04-15 Ankur Singh , Senthilnath Jayavelu

Domain generalization aims to learn a prediction model on multi-domain source data such that the model can generalize to a target domain with unknown statistics. Most existing approaches have been developed under the assumption that the…

Computer Vision and Pattern Recognition · Computer Science 2021-09-01 Jin Kim , Jiyoung Lee , Jungin Park , Dongbo Min , Kwanghoon Sohn

Domain generalization is the problem of machine learning when the training data and the test data come from different data domains. We present a simple theoretical model of learning to generalize across domains in which there is a…

Machine Learning · Computer Science 2020-02-14 Vikas K. Garg , Adam Kalai , Katrina Ligett , Zhiwei Steven Wu

In imperative programming, the Domain-Driven Design methodology helps in coping with the complexity of software development by materializing in code the invariants of a domain of interest. Code is cleaner and more secure because any…

Artificial Intelligence · Computer Science 2023-07-14 Mario Alviano , Giovambattista Ianni , Francesco Pacenza , Jessica Zangari

Domain generalization aims to enhance the model robustness against domain shift without accessing the target domain. Since the available source domains for training are limited, recent approaches focus on generating samples of novel…

Computer Vision and Pattern Recognition · Computer Science 2021-08-20 Seogkyu Jeon , Kibeom Hong , Pilhyeon Lee , Jewook Lee , Hyeran Byun

Domain generalization is the task of learning models that generalize to unseen target domains. We propose a simple yet effective method for domain generalization, named cross-domain ensemble distillation (XDED), that learns domain-invariant…

Computer Vision and Pattern Recognition · Computer Science 2022-11-28 Kyungmoon Lee , Sungyeon Kim , Suha Kwak

Domain generalization (DG) is essentially an out-of-distribution problem, aiming to generalize the knowledge learned from multiple source domains to an unseen target domain. The mainstream is to leverage statistical models to model the…

Machine Learning · Computer Science 2022-03-29 Fangrui Lv , Jian Liang , Shuang Li , Bin Zang , Chi Harold Liu , Ziteng Wang , Di Liu

When modeling dynamical systems from real-world data samples, the distribution of data often changes according to the environment in which they are captured, and the dynamics of the system itself vary from one environment to another.…

Machine Learning · Computer Science 2022-02-15 Yuan Yin , Ibrahim Ayed , Emmanuel de Bézenac , Nicolas Baskiotis , Patrick Gallinari

Domain-specific intelligence demands specialized knowledge and sophisticated reasoning for problem-solving, posing significant challenges for large language models (LLMs) that struggle with knowledge hallucination and inadequate reasoning…

Computation and Language · Computer Science 2025-05-20 Zhengren Wang , Jiayang Yu , Dongsheng Ma , Zhe Chen , Yu Wang , Zhiyu Li , Feiyu Xiong , Yanfeng Wang , Weinan E , Linpeng Tang , Wentao Zhang

Modern deep neural networks suffer from performance degradation when evaluated on testing data under different distributions from training data. Domain generalization aims at tackling this problem by learning transferable knowledge from…

Computer Vision and Pattern Recognition · Computer Science 2021-05-25 Qinwei Xu , Ruipeng Zhang , Ya Zhang , Yanfeng Wang , Qi Tian

Domain shift across crowd data severely hinders crowd counting models to generalize to unseen scenarios. Although domain adaptive crowd counting approaches close this gap to a certain extent, they are still dependent on the target domain…

Computer Vision and Pattern Recognition · Computer Science 2023-03-29 Zhipeng Du , Jiankang Deng , Miaojing Shi

Domain generalization (DG) strives to address distribution shifts across diverse environments to enhance model's generalizability. Current DG approaches are confined to acquiring robust representations with continuous features, specifically…

Computer Vision and Pattern Recognition · Computer Science 2025-04-10 Shaocong Long , Qianyu Zhou , Xikun Jiang , Chenhao Ying , Lizhuang Ma , Yuan Luo

While the traditional formulation of machine learning tasks is in terms of performance on average, in practice we are often interested in how well a trained model performs on rare or difficult data points at test time. To achieve more…

Machine Learning · Computer Science 2025-12-29 Matthew J. Holland , Toma Hamada