English
Related papers

Related papers: ERM++: An Improved Baseline for Domain Generalizat…

200 papers

The common assumption that train and test sets follow similar distributions is often violated in deployment settings. Given multiple source domains, domain generalization aims to create robust models capable of generalizing to new unseen…

Machine Learning · Computer Science 2023-08-15 Berker Demirel , Erchan Aptoula , Huseyin Ozkan

Domain generalization (DG) attempts to generalize a model trained on single or multiple source domains to the unseen target domain. Benefiting from the success of Visual-and-Language Pre-trained models in recent years, we argue that it is…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Geng Liu , Yuxi Wang

Due to the scarcity of publicly available diarization data, the model performance can be improved by training a single model with data from different domains. In this work, we propose to incorporate domain information to train a single…

Sound · Computer Science 2023-12-13 Ivan Fung , Lahiru Samarakoon , Samuel J. Broughton

Domain Generalization (DG) is a challenging task in machine learning that requires a coherent ability to comprehend shifts across various domains through extraction of domain-invariant features. DG performance is typically evaluated by…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Yiran Luo , Joshua Feinglass , Tejas Gokhale , Kuan-Cheng Lee , Chitta Baral , Yezhou Yang

Generalized Entity Matching (GEM), which aims at judging whether two records represented in different formats refer to the same real-world entity, is an essential task in data management. The prompt tuning paradigm for pre-trained language…

Computation and Language · Computer Science 2024-05-09 Yikuan Xia , Jiazun Chen , Xinchi Li , Jun Gao

Agnostic domain shift is the main reason of model degradation on the unknown target domains, which brings an urgent need to develop Domain Generalization (DG). Recent advances at DG use dynamic networks to achieve training-free adaptation…

Computer Vision and Pattern Recognition · Computer Science 2023-11-27 Luojun Lin , Zhifeng Shen , Zhishu Sun , Yuanlong Yu , Lei Zhang , Weijie Chen

Data augmentation has been widely applied as an effective methodology to improve generalization in particular when training deep neural networks. Recently, researchers proposed a few intensive data augmentation techniques, which indeed…

Machine Learning · Computer Science 2019-11-22 Zhuoxun He , Lingxi Xie , Xin Chen , Ya Zhang , Yanfeng Wang , Qi Tian

As a recent noticeable topic, domain generalization aims to learn a generalizable model on multiple source domains, which is expected to perform well on unseen test domains. Great efforts have been made to learn domain-invariant features by…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Jianxin Lin , Yongqiang Tang , Junping Wang , Wensheng Zhang

The $\ell_0$-constrained empirical risk minimization ($\ell_0$-ERM) is a promising tool for high-dimensional statistical estimation. The existing analysis of $\ell_0$-ERM estimator is mostly on parameter estimation and support recovery…

Statistics Theory · Mathematics 2020-01-22 Xiao-Tong Yuan , Ping Li

The solution to empirical risk minimization with $f$-divergence regularization (ERM-$f$DR) is extended to constrained optimization problems, establishing conditions for equivalence between the solution and constraints. A dual formulation of…

Machine Learning · Statistics 2025-02-21 Francisco Daunas , Iñaki Esnaola , Samir M. Perlaza , Gholamali Aminian

Domain generalization in medical image classification is an important problem for trustworthy machine learning to be deployed in healthcare. We find that existing approaches for domain generalization which utilize ground-truth abnormality…

Computer Vision and Pattern Recognition · Computer Science 2022-06-20 Jupinder Parmar , Khaled Saab , Brian Pogatchnik , Daniel Rubin , Christopher Ré

Domain generalization involves learning a classifier from a heterogeneous collection of training sources such that it generalizes to data drawn from similar unknown target domains, with applications in large-scale learning and personalized…

Machine Learning · Computer Science 2021-12-24 Xavier Thomas , Dhruv Mahajan , Alex Pentland , Abhimanyu Dubey

We consider the problem of training a classification model with group annotated training data. Recent work has established that, if there is distribution shift across different groups, models trained using the standard empirical risk…

Machine Learning · Computer Science 2022-04-21 Vihari Piratla , Praneeth Netrapalli , Sunita Sarawagi

Domain generalization (DG), aiming to make models work on unseen domains, is a surefire way toward general artificial intelligence. Limited by the scale and diversity of current DG datasets, it is difficult for existing methods to scale to…

Computer Vision and Pattern Recognition · Computer Science 2022-09-30 Hongjing Niu , Hanting Li , Feng Zhao , Bin Li

Poor generalization performance caused by distribution shifts in unseen domains often hinders the trustworthy deployment of deep neural networks. Many domain generalization techniques address this problem by adding a domain invariant…

A key challenge in Domain Generalization (DG) is preventing overfitting to source domains, which can be mitigated by finding flatter minima in the loss landscape. In this work, we propose Quantization-aware Training for Domain…

Machine Learning · Computer Science 2025-06-30 Saqib Javed , Hieu Le , Mathieu Salzmann

In this study, we address the gradient-based domain generalization problem, where predictors aim for consistent gradient directions across different domains. Existing methods have two main challenges. First, minimization of gradient…

Machine Learning · Computer Science 2025-07-22 Khoi Do , Duong Nguyen , Nam-Khanh Le , Quoc-Viet Pham , Binh-Son Hua , Won-Joo Hwang

When domains, which represent underlying data distributions, vary during training and testing processes, deep neural networks suffer a drop in their performance. Domain generalization allows improvements in the generalization performance…

Computer Vision and Pattern Recognition · Computer Science 2019-11-19 Toshihiko Matsuura , Tatsuya Harada

Unsupervised domain adaptation (UDA) and domain generalization (DG) enable machine learning models trained on a source domain to perform well on unlabeled or even unseen target domains. As previous UDA&DG semantic segmentation methods are…

Computer Vision and Pattern Recognition · Computer Science 2023-09-28 Lukas Hoyer , Dengxin Dai , Luc Van Gool

Machine learning models fail to perform when facing out-of-distribution (OOD) domains, a challenging task known as domain generalization (DG). In this work, we develop a novel DG training strategy, we call PGrad, to learn a robust gradient…

Machine Learning · Computer Science 2023-05-03 Zhe Wang , Jake Grigsby , Yanjun Qi