English
Related papers

Related papers: In Search of Lost Domain Generalization

200 papers

In this work, we propose to tackle the problem of domain generalization in the context of \textit{insufficient samples}. Instead of extracting latent feature embeddings based on deterministic models, we propose to learn a domain-invariant…

Machine Learning · Computer Science 2024-02-12 Kecheng Chen , Elena Gal , Hong Yan , Haoliang Li

Domain generalization aims to train models on multiple source domains so that they can generalize well to unseen target domains. Among many domain generalization methods, Fourier-transform-based domain generalization methods have gained…

Image and Video Processing · Electrical Eng. & Systems 2023-12-14 Hongyi Pan , Bin Wang , Zheyuan Zhang , Xin Zhu , Debesh Jha , Ahmet Enis Cetin , Concetto Spampinato , Ulas Bagci

This work generalizes the problem of unsupervised domain generalization to the case in which no labeled samples are available (completely unsupervised). We are given unlabeled samples from multiple source domains, and we aim to learn a…

Machine Learning · Computer Science 2024-02-01 Amit Rozner , Barak Battash , Lior Wolf , Ofir Lindenbaum

Geographic distribution shift arises when the distribution of locations on Earth in a training dataset is different from what is seen at inference time. Using standard empirical risk minimization (ERM) in this setting can lead to uneven…

Machine Learning · Computer Science 2026-02-10 Ruth Crasto , Esther Rolf

Despite the impressive advancements in modern machine learning, achieving robustness in Domain Generalization (DG) tasks remains a significant challenge. In DG, models are expected to perform well on samples from unseen test distributions…

Machine Learning · Computer Science 2025-07-08 Ron Tsibulsky , Daniel Nevo , Uri Shalit

In the context of supervised statistical learning, it is typically assumed that the training set comes from the same distribution that draws the test samples. When this is not the case, the behavior of the learned model is unpredictable and…

Machine Learning · Computer Science 2022-05-12 Antonio-Javier Gallego , Jorge Calvo-Zaragoza , Robert B. Fisher

Recent domain generalization (DG) approaches typically use the hypothesis learned on source domains for inference on the unseen target domain. However, such a hypothesis can be arbitrarily far from the optimal one for the target domain,…

Machine Learning · Computer Science 2023-05-25 Yi-Fan Zhang , Jindong Wang , Jian Liang , Zhang Zhang , Baosheng Yu , Liang Wang , Dacheng Tao , Xing Xie

Domain generalization (DG) for object detection aims to enhance detectors' performance in unseen scenarios. This task remains challenging due to complex variations in real-world applications. Recently, diffusion models have demonstrated…

Computer Vision and Pattern Recognition · Computer Science 2025-06-05 Boyong He , Yuxiang Ji , Qianwen Ye , Zhuoyue Tan , Liaoni Wu

Domain generalization aims to learn knowledge invariant across different distributions while semantically meaningful for downstream tasks from multiple source domains, to improve the model's generalization ability on unseen target domains.…

Machine Learning · Computer Science 2021-06-03 Yunqi Wang , Furui Liu , Zhitang Chen , Qing Lian , Shoubo Hu , Jianye Hao , Yik-Chung Wu

Models trained on one set of domains often suffer performance drops on unseen domains, e.g., when wildlife monitoring models are deployed in new camera locations. In this work, we study principles for designing data augmentations for…

Machine Learning · Computer Science 2024-02-07 Irena Gao , Shiori Sagawa , Pang Wei Koh , Tatsunori Hashimoto , Percy Liang

This paper reviews concepts, modeling approaches, and recent findings along a spectrum of different levels of abstraction of neural network models including generalization across (1) Samples, (2) Distributions, (3) Domains, (4) Tasks, (5)…

Machine Learning · Computer Science 2024-08-02 Chris Rohlfs

Recent advances in deep learning for medical image segmentation demonstrate expert-level accuracy. However, in clinically realistic environments, such methods have marginal performance due to differences in image domains, including…

Computer Vision and Pattern Recognition · Computer Science 2019-06-13 Ling Zhang , Xiaosong Wang , Dong Yang , Thomas Sanford , Stephanie Harmon , Baris Turkbey , Holger Roth , Andriy Myronenko , Daguang Xu , Ziyue Xu

Data-driven machine learning (ML) is promoted as one potential technology to be used in next-generations wireless systems. This led to a large body of research work that applies ML techniques to solve problems in different layers of the…

Machine Learning · Computer Science 2023-03-15 Mohamed Akrout , Amal Feriani , Faouzi Bellili , Amine Mezghani , Ekram Hossain

Link prediction, a foundational task in complex network analysis, has extensive applications in critical scenarios such as social recommendation, drug target discovery, and knowledge graph completion. However, existing evaluations of…

Other Statistics · Statistics 2025-12-30 Yilin Bi , Junhao Bian , Shuyan Wan , Shuaijia Wang , Tao Zhou

There are ubiquitous distribution shifts in the real world. However, deep neural networks (DNNs) are easily biased towards the training set, which causes severe performance degradation when they receive out-of-distribution data. Many…

Computer Vision and Pattern Recognition · Computer Science 2023-09-13 Jiao Zhang , Xu-Yao Zhang , Cheng-Lin Liu

A long standing problem in visual object categorization is the ability of algorithms to generalize across different testing conditions. The problem has been formalized as a covariate shift among the probability distributions generating the…

Computer Vision and Pattern Recognition · Computer Science 2018-06-18 Massimiliano Mancini , Samuel Rota Bulò , Barbara Caputo , Elisa Ricci

Unsupervised domain adaptation is used in many machine learning applications where, during training, a model has access to unlabeled data in the target domain, and a related labeled dataset. In this paper, we introduce a novel and general…

Machine Learning · Computer Science 2021-06-23 David Acuna , Guojun Zhang , Marc T. Law , Sanja Fidler

Data augmentation is one of the most effective techniques for regularizing deep learning models and improving their recognition performance in a variety of tasks and domains. However, this holds for standard in-domain settings, in which the…

Understanding the generalization behaviour of deep neural networks is a topic of recent interest that has driven the production of many studies, notably the development and evaluation of generalization "explainability" measures that…

Machine Learning · Computer Science 2021-10-26 Jonathan Jaegerman , Khalil Damouni , Mahdi S. Hosseini , Konstantinos N. Plataniotis

Domain Generalization (DG) aims to train models that can generalize to unseen testing domains by leveraging data from multiple training domains. However, traditional DG methods rely on the availability of multiple diverse training domains,…

Machine Learning · Computer Science 2025-03-11 Hao Yan , Marzi Heidari , Yuhong Guo