English
Related papers

Related papers: Domain Generalization via Rationale Invariance

200 papers

In this work, we propose to tackle the problem of domain generalization in the context of \textit{insufficient samples}. Instead of extracting latent feature embeddings based on deterministic models, we propose to learn a domain-invariant…

Machine Learning · Computer Science 2024-02-12 Kecheng Chen , Elena Gal , Hong Yan , Haoliang Li

In this paper, we propose a novel domain generalization (DG) framework based on a new upper bound to the risk on the unseen domain. Particularly, our framework proposes to jointly minimize both the covariate-shift as well as the…

Machine Learning · Computer Science 2022-08-02 Thuan Nguyen , Boyang Lyu , Prakash Ishwar , Matthias Scheutz , Shuchin Aeron

In conventional statistical and machine learning methods, it is typically assumed that the test data are identically distributed with the training data. However, this assumption does not always hold, especially in applications where the…

Methodology · Statistics 2023-09-19 Sai Li , Linjun Zhang

Deep learning methods can struggle to handle domain shifts not seen in training data, which can cause them to not generalize well to unseen domains. This has led to research attention on domain generalization (DG), which aims to the model's…

Machine Learning · Computer Science 2022-05-10 Wei Zhu , Le Lu , Jing Xiao , Mei Han , Jiebo Luo , Adam P. Harrison

Over-parameterized deep models usually over-fit to a given training distribution, which makes them sensitive to small changes and out-of-distribution samples at inference time, leading to low generalization performance. To this end, several…

Computer Vision and Pattern Recognition · Computer Science 2019-12-12 Saeid Asgari Taghanaki , Kumar Abhishek , Ghassan Hamarneh

Causality has been combined with machine learning to produce robust representations for domain generalization. Most existing methods of this type require massive data from multiple domains to identify causal features by cross-domain…

Machine Learning · Computer Science 2024-03-01 Yang Chen , Yitao Liang , Zhouchen Lin

Domain adaption has been widely adapted for cross-domain sentiment analysis to transfer knowledge from the source domain to the target domain. Whereas, most methods are proposed under the assumption that the target (test) domain is known,…

Computation and Language · Computer Science 2024-02-23 Siyin Wang , Jie Zhou , Qin Chen , Qi Zhang , Tao Gui , Xuanjing Huang

A key feature of human intelligence is the ability to generalize beyond the training distribution, for instance, parsing longer sentences than seen in the past. Currently, deep neural networks struggle to generalize robustly to such shifts…

Machine Learning · Computer Science 2022-02-22 Soham Dan , Osbert Bastani , Dan Roth

Domain generalization (DG) is a branch of transfer learning that aims to train the learning models on several seen domains and subsequently apply these pre-trained models to other unseen (unknown but related) domains. To deal with…

Machine Learning · Computer Science 2022-10-28 Thuan Nguyen , Boyang Lyu , Prakash Ishwar , Matthias Scheutz , Shuchin Aeron

Traditionally, for most machine learning settings, gaining some degree of explainability that tries to give users more insights into how and why the network arrives at its predictions, restricts the underlying model and hinders performance…

Machine Learning · Computer Science 2021-04-06 Robin M. Schmidt

Domain generalization (DG) aims to learn a generalized model to an unseen target domain using only limited source domains. Previous attempts to DG fail to learn domain-invariant representations only from the source domains due to the…

Machine Learning · Computer Science 2022-07-25 Junbum Cha , Kyungjae Lee , Sungrae Park , Sanghyuk Chun

Despite the impressive advancements in modern machine learning, achieving robustness in Domain Generalization (DG) tasks remains a significant challenge. In DG, models are expected to perform well on samples from unseen test distributions…

Machine Learning · Computer Science 2025-07-08 Ron Tsibulsky , Daniel Nevo , Uri Shalit

Domain generalization asks for models trained over a set of training environments to generalize well in unseen test environments. Recently, a series of algorithms such as Invariant Risk Minimization (IRM) have been proposed for domain…

Machine Learning · Computer Science 2023-11-03 Haoxiang Wang , Gargi Balasubramaniam , Haozhe Si , Bo Li , Han Zhao

Generalization is a central problem in Machine Learning. Indeed most prediction methods require careful calibration of hyperparameters usually carried out on a hold-out \textit{validation} dataset to achieve generalization. The main goal of…

Machine Learning · Statistics 2021-02-18 Karim Lounici , Katia Meziani , Benjamin Riu

Classical Domain Adaptation methods acquire transferability by regularizing the overall distributional discrepancies between features in the source domain (labeled) and features in the target domain (unlabeled). They often do not…

Machine Learning · Computer Science 2023-06-01 Shumin Ma , Zhiri Yuan , Qi Wu , Yiyan Huang , Xixu Hu , Cheuk Hang Leung , Dongdong Wang , Zhixiang Huang

Clinical machine learning models experience significantly degraded performance in datasets not seen during training, e.g., new hospitals or populations. Recent developments in domain generalization offer a promising solution to this problem…

Machine Learning · Computer Science 2021-04-16 Haoran Zhang , Natalie Dullerud , Laleh Seyyed-Kalantari , Quaid Morris , Shalmali Joshi , Marzyeh Ghassemi

Deep Reinforcement Learning has shown great success in a variety of control tasks. However, it is unclear how close we are to the vision of putting Deep RL into practice to solve real world problems. In particular, common practice in the…

Machine Learning · Computer Science 2019-02-21 Chenyang Zhao , Olivier Sigaud , Freek Stulp , Timothy M. Hospedales

Generalization to unseen data remains poorly understood for deep learning classification and foundation models, especially in the open set scenario. How can one assess the ability of networks to adapt to new or extended versions of their…

Machine Learning · Computer Science 2024-11-05 Luciano Dyballa , Evan Gerritz , Steven W. Zucker

Machine learning systems typically assume that the distributions of training and test sets match closely. However, a critical requirement of such systems in the real world is their ability to generalize to unseen domains. Here, we propose…

Machine Learning · Computer Science 2021-07-15 Yuge Shi , Jeffrey Seely , Philip H. S. Torr , N. Siddharth , Awni Hannun , Nicolas Usunier , Gabriel Synnaeve

Machine learning methods often assume that the test data have the same distribution as the training data. However, this assumption may not hold due to multiple levels of heterogeneity in applications, raising issues in algorithmic fairness…

Machine Learning · Statistics 2024-04-03 Sai Li , Linjun Zhang
‹ Prev 1 4 5 6 7 8 10 Next ›