English
Related papers

Related papers: When Distributions Shifts: Causal Generalization f…

200 papers

Generalizing image classification across domains remains challenging in critical tasks such as fundus image-based diabetic retinopathy (DR) grading and resting-state fMRI seizure onset zone (SOZ) detection. When domains differ in unknown…

Computer Vision and Pattern Recognition · Computer Science 2026-03-16 Ayan Banerjee , Kuntal Thakur , Sandeep Gupta

Learning guarantees often rely on assumptions of i.i.d. data, which will likely be violated in practice once predictors are deployed to perform real-world tasks. Domain adaptation approaches thus appeared as a useful framework yielding…

Machine Learning · Computer Science 2021-06-29 Joao Monteiro , Xavier Gibert , Jianqiao Feng , Vincent Dumoulin , Dar-Shyang Lee

When machine learning models are deployed on a test distribution different from the training distribution, they can perform poorly, but overestimate their performance. In this work, we aim to better estimate a model's performance under…

Machine Learning · Computer Science 2020-07-08 Ching-Yao Chuang , Antonio Torralba , Stefanie Jegelka

Machine learning models rely on various assumptions to attain high accuracy. One of the preliminary assumptions of these models is the independent and identical distribution, which suggests that the train and test data are sampled from the…

Machine Learning · Computer Science 2022-11-08 Paras Sheth , Raha Moraffah , K. Selçuk Candan , Adrienne Raglin , Huan Liu

Machine learning models typically suffer from the domain shift problem when trained on a source dataset and evaluated on a target dataset of different distribution. To overcome this problem, domain generalisation (DG) methods aim to…

Computer Vision and Pattern Recognition · Computer Science 2020-03-16 Kaiyang Zhou , Yongxin Yang , Timothy Hospedales , Tao Xiang

Transfer learning has led to large gains in performance for nearly all NLP tasks while making downstream models easier and faster to train. This has also been extended to low-resourced languages, with some success. We investigate the…

Computation and Language · Computer Science 2023-09-12 Michael Beukman , Manuel Fokam

Domain generalization (DG) deals with the problem of domain shift where a machine learning model trained on multiple-source domains fail to generalize well on a target domain with different statistics. Multiple approaches have been proposed…

Computer Vision and Pattern Recognition · Computer Science 2020-07-29 Prashant Pandey , Mrigank Raman , Sumanth Varambally , Prathosh AP

Robustness in Natural Language Processing continues to be a pertinent issue, where state of the art models under-perform under naturally shifted distributions. In the context of Question Answering, work on domain adaptation methods…

Computation and Language · Computer Science 2024-02-12 Arijit Ghosh Chowdhury , Aman Chadha

Domain generalization (DG) focuses on transferring domain-invariant knowledge from multiple source domains (available at train time) to an, a priori, unseen target domain(s). This requires a class to be expressed in multiple domains for the…

Machine Learning · Computer Science 2023-06-02 Kimathi Kaai , Saad Hossain , Sirisha Rambhatla

Domain generalization (DG) aims to learn from multiple source domains a model that can generalize well on unseen target domains. Existing DG methods mainly learn the representations with invariant marginal distribution of the input…

Machine Learning · Computer Science 2023-05-26 Junkun Yuan , Xu Ma , Ruoxuan Xiong , Mingming Gong , Xiangyu Liu , Fei Wu , Lanfen Lin , Kun Kuang

In open-world scenarios, where both novel classes and domains may exist, an ideal segmentation model should detect anomaly classes for safety and generalize to new domains. However, existing methods often struggle to distinguish between…

Computer Vision and Pattern Recognition · Computer Science 2024-11-07 Zhitong Gao , Bingnan Li , Mathieu Salzmann , Xuming He

Due to the ability of deep neural nets to learn rich representations, recent advances in unsupervised domain adaptation have focused on learning domain-invariant features that achieve a small error on the source domain. The hope is that the…

Machine Learning · Computer Science 2019-05-31 Han Zhao , Remi Tachet des Combes , Kun Zhang , Geoffrey J. Gordon

Domain generalisation (DG) methods address the problem of domain shift, when there is a mismatch between the distributions of training and target domains. Data augmentation approaches have emerged as a promising alternative for DG. However,…

Machine Learning · Computer Science 2020-12-29 Hoang Son Le , Rini Akmeliawati , Gustavo Carneiro

In this work, we analyze the conditions under which information about the context of an input $X$ can improve the predictions of deep learning models in new domains. Following work in marginal transfer learning in Domain Generalization…

Machine Learning · Computer Science 2025-10-23 Jens Müller , Lars Kühmichel , Martin Rohbeck , Stefan T. Radev , Ullrich Köthe

Sentiment classification (SC) often suffers from low-resource challenges such as domain-specific contexts, imbalanced label distributions, and few-shot scenarios. The potential of the diffusion language model (LM) for textual data…

Computation and Language · Computer Science 2024-09-24 Zhuowei Chen , Lianxi Wang , Yuben Wu , Xinfeng Liao , Yujia Tian , Junyang Zhong

This paper focuses on domain generalization (DG), the task of learning from multiple source domains a model that generalizes well to unseen domains. A main challenge for DG is that the available source domains often exhibit limited…

Computer Vision and Pattern Recognition · Computer Science 2021-03-10 Kaiyang Zhou , Yongxin Yang , Timothy Hospedales , Tao Xiang

Domain generalization (DG) aims to train a model to perform well in unseen domains under different distributions. This paper considers a more realistic yet more challenging scenario,namely Single Domain Generalization (Single-DG), where…

Computer Vision and Pattern Recognition · Computer Science 2022-12-05 Jiajin Zhang , Hanqing Chao , Amit Dhurandhar , Pin-Yu Chen , Ali Tajer , Yangyang Xu , Pingkun Yan

We focus on the problem of domain adaptation when the goal is shifting the model towards the target distribution, rather than learning domain invariant representations. It has been shown that under the following two assumptions: (a) access…

Machine Learning · Computer Science 2021-07-14 Samira Abnar , Rianne van den Berg , Golnaz Ghiasi , Mostafa Dehghani , Nal Kalchbrenner , Hanie Sedghi

Deep learning techniques have recently shown to be successful in many natural language processing tasks forming state-of-the-art systems. They require, however, a large amount of annotated data which is often missing. This paper explores…

Computation and Language · Computer Science 2020-04-23 Daniel Grießhaber , Ngoc Thang Vu , Johannes Maucher

Domain generalization (DG) is an important problem that learns a model which generalizes to unseen test domains leveraging one or more source domains, under the assumption of shared label spaces. However, most DG methods assume access to…

Computer Vision and Pattern Recognition · Computer Science 2025-06-11 Christopher Liao , Christian So , Theodoros Tsiligkaridis , Brian Kulis