English
Related papers

Related papers: Consistency Regularization for Domain Generalizati…

200 papers

Recent work has highlighted the label alignment property (LAP) in supervised learning, where the vector of all labels in the dataset is mostly in the span of the top few singular vectors of the data matrix. Drawing inspiration from this…

Machine Learning · Computer Science 2024-09-12 Ehsan Imani , Guojun Zhang , Runjia Li , Jun Luo , Pascal Poupart , Philip H. S. Torr , Yangchen Pan

Adversarial learning has demonstrated good performance in the unsupervised domain adaptation setting, by learning domain-invariant representations. However, recent work has shown limitations of this approach when label distributions differ…

Machine Learning · Computer Science 2020-12-15 Remi Tachet , Han Zhao , Yu-Xiang Wang , Geoff Gordon

Domain generalization (DG) is essentially an out-of-distribution problem, aiming to generalize the knowledge learned from multiple source domains to an unseen target domain. The mainstream is to leverage statistical models to model the…

Machine Learning · Computer Science 2022-03-29 Fangrui Lv , Jian Liang , Shuang Li , Bin Zang , Chi Harold Liu , Ziteng Wang , Di Liu

We propose a method for unsupervised domain adaptation that trains a shared embedding to align the joint distributions of inputs (domain) and outputs (classes), making any classifier agnostic to the domain. Joint alignment ensures that not…

Machine Learning · Computer Science 2019-05-28 Safa Cicek , Stefano Soatto

Single Domain Generalization (SDG) tackles the problem of training a model on a single source domain so that it generalizes to any unseen target domain. While this has been well studied for image classification, the literature on SDG object…

Computer Vision and Pattern Recognition · Computer Science 2023-03-07 Vidit Vidit , Martin Engilberge , Mathieu Salzmann

In this paper, we propose a novel domain generalization (DG) framework based on a new upper bound to the risk on the unseen domain. Particularly, our framework proposes to jointly minimize both the covariate-shift as well as the…

Machine Learning · Computer Science 2022-08-02 Thuan Nguyen , Boyang Lyu , Prakash Ishwar , Matthias Scheutz , Shuchin Aeron

Semi-supervised Domain Generalization (SSDG) addresses the challenge of generalizing to unseen target domains with limited labeled data. Existing SSDG methods highlight the importance of achieving high pseudo-labeling (PL) accuracy and…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Muditha Fernando , Kajhanan Kailainathan , Krishnakanth Nagaratnam , Isuranga Udaravi Bandara Senavirathne , Ranga Rodrigo

In the domain generalization literature, a common objective is to learn representations independent of the domain after conditioning on the class label. We show that this objective is not sufficient: there exist counter-examples where a…

Machine Learning · Computer Science 2021-06-30 Divyat Mahajan , Shruti Tople , Amit Sharma

Human beings can quickly adapt to environmental changes by leveraging learning experience. However, the poor ability of adapting to dynamic environments remains a major challenge for AI models. To better understand this issue, we study the…

Computer Vision and Pattern Recognition · Computer Science 2020-07-28 Peng Su , Shixiang Tang , Peng Gao , Di Qiu , Ni Zhao , Xiaogang Wang

Domain generalization (DG) aims to tackle the distribution shift between training domains and unknown target domains. Generating new domains is one of the most effective approaches, yet its performance gain depends on the distribution…

Machine Learning · Computer Science 2023-05-17 Rui Dai , Yonggang Zhang , Zhen Fang , Bo Han , Xinmei Tian

Deep learning models for medical image analysis easily suffer from distribution shifts caused by dataset artifacts bias, camera variations, differences in the imaging station, etc., leading to unreliable diagnoses in real-world clinical…

Image and Video Processing · Electrical Eng. & Systems 2024-01-09 Siyuan Yan , Chi Liu , Zhen Yu , Lie Ju , Dwarikanath Mahapatra , Brigid Betz-Stablein , Victoria Mar , Monika Janda , Peter Soyer , Zongyuan Ge

Deep learning models fail on cross-domain challenges if the model is oversensitive to domain-specific attributes, e.g., lightning, background, camera angle, etc. To alleviate this problem, data augmentation coupled with consistency…

Computer Vision and Pattern Recognition · Computer Science 2023-09-26 Mengmeng Jing , Xiantong Zhen , Jingjing Li , Cees Snoek

Generalized linear model with $L_1$ and $L_2$ regularization is a widely used technique for solving classification, class probability estimation and regression problems. With the numbers of both features and examples growing rapidly in the…

Machine Learning · Statistics 2017-06-28 Ilya Trofimov , Alexander Genkin

Although Domain Generalization (DG) problem has been fast-growing in the 2D image tasks, its exploration on 3D point cloud data is still insufficient and challenged by more complex and uncertain cross-domain variances with uneven…

Computer Vision and Pattern Recognition · Computer Science 2023-07-28 Siyuan Huang , Bo Zhang , Botian Shi , Peng Gao , Yikang Li , Hongsheng Li

Domain adaptation seeks to leverage the abundant label information in a source domain to improve classification performance in a target domain with limited labels. While the field has seen extensive methodological development, its…

Machine Learning · Statistics 2025-07-31 Elif Vural , Huseyin Karaca

Single domain generalization (Single-DG) intends to develop a generalizable model with only one single training domain to perform well on other unknown target domains. Under the domain-hungry configuration, how to expand the coverage of…

Computer Vision and Pattern Recognition · Computer Science 2024-06-11 Jian Xu , Chaojie Ji , Yankai Cao , Ye Li , Ruxin Wang

Transferring knowledges learned from multiple source domains to target domain is a more practical and challenging task than conventional single-source domain adaptation. Furthermore, the increase of modalities brings more difficulty in…

Computer Vision and Pattern Recognition · Computer Science 2020-07-29 Hang Wang , Minghao Xu , Bingbing Ni , Wenjun Zhang

Machine learning models fail to perform when facing out-of-distribution (OOD) domains, a challenging task known as domain generalization (DG). In this work, we develop a novel DG training strategy, we call PGrad, to learn a robust gradient…

Machine Learning · Computer Science 2023-05-03 Zhe Wang , Jake Grigsby , Yanjun Qi

Domain Generalization (DG) seeks to transfer knowledge from multiple source domains to unseen target domains, even in the presence of domain shifts. Achieving effective generalization typically requires a large and diverse set of labeled…

Computer Vision and Pattern Recognition · Computer Science 2024-12-12 Sumaiya Zoha , Jeong-Gun Lee , Young-Woong Ko

Domain generalization (DG), aiming at models able to work on multiple unseen domains, is a must-have characteristic of general artificial intelligence. DG based on single source domain training data is more challenging due to the lack of…

Computer Vision and Pattern Recognition · Computer Science 2023-04-17 Qingyue Yang , Hongjing Niu , Pengfei Xia , Wei Zhang , Bin Li