English
Related papers

Related papers: PGrad: Learning Principal Gradients For Domain Gen…

200 papers

Domain Generalization (DG) aims to learn from multiple known source domains a model that can generalize well to unknown target domains. One of the key approaches in DG is training an encoder which generates domain-invariant representations.…

Machine Learning · Computer Science 2025-05-27 Trong-Binh Nguyen , Minh-Duong Nguyen , Jinsun Park , Quoc-Viet Pham , Won Joo Hwang

Unsupervised domain adaptation (UDA) intends to transfer knowledge from a labeled source domain to an unlabeled target domain. Many current methods focus on learning feature representations that are both discriminative for classification…

Computer Vision and Pattern Recognition · Computer Science 2024-08-02 Fuxiang Huang , Suqi Song , Lei Zhang

Domain generalization (DG) is a difficult transfer learning problem aiming to learn a generalizable model for unseen domains. Recent foundation models (FMs) are robust to many distribution shifts and, therefore, should substantially improve…

Computer Vision and Pattern Recognition · Computer Science 2022-08-18 Xin Zhang , Shixiang Shane Gu , Yutaka Matsuo , Yusuke Iwasawa

Domain generalization (DG) aims to learn a generalized model to an unseen target domain using only limited source domains. Previous attempts to DG fail to learn domain-invariant representations only from the source domains due to the…

Machine Learning · Computer Science 2022-07-25 Junbum Cha , Kyungjae Lee , Sungrae Park , Sanghyuk Chun

We propose $\textbf{UniDG}$, a novel and $\textbf{Uni}$fied framework for $\textbf{D}$omain $\textbf{G}$eneralization that is capable of significantly enhancing the out-of-distribution generalization performance of foundation models…

Computer Vision and Pattern Recognition · Computer Science 2023-10-17 Yiyuan Zhang , Kaixiong Gong , Xiaohan Ding , Kaipeng Zhang , Fangrui Lv , Kurt Keutzer , Xiangyu Yue

This paper focuses on the domain generalization task where domain knowledge is unavailable, and even worse, only samples from a single domain can be utilized during training. Our motivation originates from the recent progresses in deep…

Machine Learning · Computer Science 2022-03-08 Chris Xing Tian , Haoliang Li , Xiaofei Xie , Yang Liu , Shiqi Wang

Projected Gradient Descent (PGD) is a strong and widely used first-order adversarial attack, yet its computational cost scales poorly, as all training samples undergo identical iterative inner-loop optimization despite contributing…

Machine Learning · Computer Science 2025-12-29 Youran Ye , Dejin Wang , Ajinkya Bhandare

A number of results have recently demonstrated the benefits of incorporating various constraints when training deep architectures in vision and machine learning. The advantages range from guarantees for statistical generalization to better…

Machine Learning · Computer Science 2019-05-27 Sathya N. Ravi , Tuan Dinh , Vishnu Lokhande , Vikas Singh

Generalized Class Discovery (GCD) clusters base and novel classes in a target domain using supervision from a source domain with only base classes. Current methods often falter with distribution shifts and typically require access to target…

Computer Vision and Pattern Recognition · Computer Science 2025-03-24 Vaibhav Rathore , Shubhranil B , Saikat Dutta , Sarthak Mehrotra , Zsolt Kira , Biplab Banerjee

Typically a classifier trained on a given dataset (source domain) does not performs well if it is tested on data acquired in a different setting (target domain). This is the problem that domain adaptation (DA) tries to overcome and, while…

Machine Learning · Computer Science 2018-08-01 Silvia Bucci , Mohammad Reza Loghmani , Barbara Caputo

Out-of-Domain (OOD) generalization is the ability of a model trained on one or more domains to generalize to unseen domains. In the ImageNet era of computer vision, evaluation sets for measuring a model's OOD performance were designed to be…

Computer Vision and Pattern Recognition · Computer Science 2025-06-09 Prasanna Mayilvahanan , Roland S. Zimmermann , Thaddäus Wiedemer , Evgenia Rusak , Attila Juhos , Matthias Bethge , Wieland Brendel

Domain generalization (DG) aims to improve the generalizability of computer vision models toward distribution shifts. The mainstream DG methods focus on learning domain invariance, however, such methods overlook the potential inherent in…

Computer Vision and Pattern Recognition · Computer Science 2025-04-04 Shaocong Long , Qianyu Zhou , Xiangtai Li , Chenhao Ying , Yunhai Tong , Lizhuang Ma , Yuan Luo , Dacheng Tao

Machine learning systems typically assume that the distributions of training and test sets match closely. However, a critical requirement of such systems in the real world is their ability to generalize to unseen domains. Here, we propose…

Machine Learning · Computer Science 2021-07-15 Yuge Shi , Jeffrey Seely , Philip H. S. Torr , N. Siddharth , Awni Hannun , Nicolas Usunier , Gabriel Synnaeve

Traditional place categorization approaches in robot vision assume that training and test images have similar visual appearance. Therefore, any seasonal, illumination and environmental changes typically lead to severe degradation in…

Robotics · Computer Science 2018-05-31 Massimiliano Mancini , Samuel Rota Bulò , Barbara Caputo , Elisa Ricci

In this paper, we propose a new method called Gradual Domain Osmosis, which aims to solve the problem of smooth knowledge migration from source domain to target domain in Gradual Domain Adaptation (GDA). Traditional Gradual Domain…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Zixi Wang , Yubo Huang

While there have been considerable advancements in machine learning driven by extensive datasets, a significant disparity still persists in the availability of data across various sources and populations. This inequality across domains…

Machine Learning · Computer Science 2024-03-11 Jinha Park , Wonguk Cho , Taesup Kim

During the past decade, deep neural networks have led to fast-paced progress and significant achievements in computer vision problems, for both academia and industry. Yet despite their success, state-of-the-art image classification…

Computer Vision and Pattern Recognition · Computer Science 2024-05-13 Aristotelis Ballas , Christos Diou

Two prevalent types of distributional shifts in machine learning are the covariate shift (as observed across different domains) and the semantic shift (as seen across different classes). Traditional OOD detection techniques typically…

Artificial Intelligence · Computer Science 2023-09-20 Haoliang Wang , Chen Zhao , Yunhui Guo , Kai Jiang , Feng Chen

Domain invariant learning aims to learn models that extract invariant features over various training domains, resulting in better generalization to unseen target domains. Recently, Bayesian Neural Networks have achieved promising results in…

Machine Learning · Computer Science 2023-10-26 Shiyu Shen , Bin Pan , Tianyang Shi , Tao Li , Zhenwei Shi

Deep Neural Networks (DNNs)-based semantic segmentation models trained on a source domain often struggle to generalize to unseen target domains, i.e., a domain gap problem. Texture often contributes to the domain gap, making DNNs vulnerable…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Sunghwan Kim , Dae-hwan Kim , Hoseong Kim