English
Related papers

Related papers: Automated Domain Discovery from Multiple Sources t…

200 papers

Deploying multimodal models in real-world scenarios requires generalization to new environments where recording conditions differ from training, a challenge known as multimodal domain generalization (MMDG). Standard architectures employ…

Machine Learning · Computer Science 2026-05-05 Yavuz Yarici , Ghassan AlRegib

Domain Generalization (DG) is a fundamental challenge for machine learning models, which aims to improve model generalization on various domains. Previous methods focus on generating domain invariant features from various source domains.…

Computer Vision and Pattern Recognition · Computer Science 2023-09-22 Daoan Zhang , Mingkai Chen , Chenming Li , Lingyun Huang , Jianguo Zhang

Domain generalization (DG) aims to learn models that perform well on unseen target domains by training on multiple source domains. Sharpness-Aware Minimization (SAM), known for finding flat minima that improve generalization, has therefore…

Machine Learning · Statistics 2025-07-01 Youngjun Song , Youngsik Hwang , Jonghun Lee , Heechang Lee , Dong-Young Lim

Most statistical learning algorithms rely on an over-simplified assumption, that is, the train and test data are independent and identically distributed. In real-world scenarios, however, it is common for models to encounter data from new…

Image and Video Processing · Electrical Eng. & Systems 2023-04-07 Zheyuan Zhang , Bin Wang , Lanhong Yao , Ugur Demir , Debesh Jha , Ismail Baris Turkbey , Boqing Gong , Ulas Bagci

Machine learning models fail to perform when facing out-of-distribution (OOD) domains, a challenging task known as domain generalization (DG). In this work, we develop a novel DG training strategy, we call PGrad, to learn a robust gradient…

Machine Learning · Computer Science 2023-05-03 Zhe Wang , Jake Grigsby , Yanjun Qi

Generalizing from a single labeled source domain to unseen target domains, without access to any target data during training, remains a fundamental challenge in robust machine learning. We address this underexplored setting, known as Single…

Machine Learning · Computer Science 2026-04-09 Marzi Heidari , Hanping Zhang , Hao Yan , Yuhong Guo

Domain generalization (DG) is about training models that generalize well under domain shift. Previous research on DG has been conducted mostly in single-source or multi-source settings. In this paper, we consider a third, lesser-known…

Machine Learning · Computer Science 2024-06-13 Han Gao , Kaican Li , Weiyan Xie , Zhi Lin , Yongxiang Huang , Luning Wang , Caleb Chen Cao , Nevin L. Zhang

Due to domain shift, deep neural networks (DNNs) usually fail to generalize well on unknown test data in practice. Domain generalization (DG) aims to overcome this issue by capturing domain-invariant representations from source domains.…

Machine Learning · Computer Science 2022-11-10 Feng Hou , Yao Zhang , Yang Liu , Jin Yuan , Cheng Zhong , Yang Zhang , Zhongchao Shi , Jianping Fan , Zhiqiang He

Domain generalization on graphs aims to develop models with robust generalization capabilities, ensuring effective performance on the testing set despite disparities between testing and training distributions. However, existing methods…

Machine Learning · Computer Science 2024-11-21 Qin Tian , Chen Zhao , Minglai Shao , Wenjun Wang , Yujie Lin , Dong Li

In this paper, we tackle the problem of domain shift. Most existing methods perform training on multiple source domains using a single model, and the same trained model is used on all unseen target domains. Such solutions are sub-optimal as…

Machine Learning · Computer Science 2023-01-13 Tao Zhong , Zhixiang Chi , Li Gu , Yang Wang , Yuanhao Yu , Jin Tang

Current state-of-the-art self-supervised approaches, are effective when trained on individual domains but show limited generalization on unseen domains. We observe that these models poorly generalize even when trained on a mixture of…

Computer Vision and Pattern Recognition · Computer Science 2023-12-14 Neha Kalibhat , Sam Sharpe , Jeremy Goodsitt , Bayan Bruss , Soheil Feizi

Data-driven machine learning (ML) is promoted as one potential technology to be used in next-generations wireless systems. This led to a large body of research work that applies ML techniques to solve problems in different layers of the…

Machine Learning · Computer Science 2023-03-15 Mohamed Akrout , Amal Feriani , Faouzi Bellili , Amine Mezghani , Ekram Hossain

Domain generalization (DG) is the challenging and topical problem of learning models that generalize to novel testing domains with different statistics than a set of known training domains. The simple approach of aggregating data from all…

Computer Vision and Pattern Recognition · Computer Science 2019-12-09 Da Li , Jianshu Zhang , Yongxin Yang , Cong Liu , Yi-Zhe Song , Timothy M. Hospedales

Beyond attaining domain generalization (DG), visual recognition models should also be data-efficient during learning by leveraging limited labels. We study the problem of Semi-Supervised Domain Generalization (SSDG) which is crucial for…

Computer Vision and Pattern Recognition · Computer Science 2024-09-26 Adnan Khan , Mai A. Shaaban , Muhammad Haris Khan

Recent years have witnessed significant progress in person re-identification (ReID). However, current ReID approaches still suffer from considerable performance degradation when unseen testing domains exhibit different characteristics from…

Computer Vision and Pattern Recognition · Computer Science 2021-09-14 Shijie Yu , Feng Zhu , Dapeng Chen , Rui Zhao , Haobin Chen , Shixiang Tang , Jinguo Zhu , Yu Qiao

Generalization under the distribution shift has been a great challenge in computer vision. The prevailing practice of directly employing the one-hot labels as the training targets in domain generalization~(DG) can lead to gradient…

Computer Vision and Pattern Recognition · Computer Science 2025-03-13 Shaocong Long , Qianyu Zhou , Chenhao Ying , Lizhuang Ma , Yuan Luo

Dense retrieval (DR) methods conduct text retrieval by first encoding texts in the embedding space and then matching them by nearest neighbor search. This requires strong locality properties from the representation space, i.e, the close…

Information Retrieval · Computer Science 2021-10-15 Ji Xin , Chenyan Xiong , Ashwin Srinivasan , Ankita Sharma , Damien Jose , Paul N. Bennett

Much of federated learning (FL) focuses on settings where local dataset statistics remain the same between training and testing. However, this assumption often does not hold in practice due to distribution shifts, motivating the development…

Machine Learning · Computer Science 2026-02-02 Shahryar Zehtabi , Dong-Jun Han , Seyyedali Hosseinalipour , Christopher G. Brinton

Distribution shift presents a significant challenge in machine learning, where models often underperform during the test stage when faced with a different distribution than the one they were trained on. This paper focuses on domain shifts,…

Machine Learning · Computer Science 2024-03-19 Huaxiu Yao , Xinyu Yang , Xinyi Pan , Shengchao Liu , Pang Wei Koh , Chelsea Finn

In this paper we propose a sequential learning framework for Domain Generalization (DG), the problem of training a model that is robust to domain shift by design. Various DG approaches have been proposed with different motivating…

Computer Vision and Pattern Recognition · Computer Science 2020-04-06 Da Li , Yongxin Yang , Yi-Zhe Song , Timothy Hospedales