English
Related papers

Related papers: LFME: A Simple Framework for Learning from Multipl…

200 papers

Deep neural networks suffer from significant performance deterioration when there exists distribution shift between deployment and training. Domain Generalization (DG) aims to safely transfer a model to unseen target domains by only relying…

Computer Vision and Pattern Recognition · Computer Science 2023-08-09 Xin Zhang , Ying-Cong Chen

Recent advancements in Large Multi-modal Models (LMMs) underscore the importance of scaling by increasing image-text paired data, achieving impressive performance on general tasks. Despite their effectiveness in broad applications,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Tianshuo Peng , Mingsheng Li , Jiakang Yuan , Hongbin Zhou , Renqiu Xia , Renrui Zhang , Lei Bai , Song Mao , Bin Wang , Aojun Zhou , Botian Shi , Tao Chen , Bo Zhang , Xiangyu Yue

Recent years have witnessed significant progress in person re-identification (ReID). However, current ReID approaches still suffer from considerable performance degradation when unseen testing domains exhibit different characteristics from…

Computer Vision and Pattern Recognition · Computer Science 2021-09-14 Shijie Yu , Feng Zhu , Dapeng Chen , Rui Zhao , Haobin Chen , Shixiang Tang , Jinguo Zhu , Yu Qiao

Domain generalization (DG) intends to train a model on multiple source domains to ensure that it can generalize well to an arbitrary unseen target domain. The acquisition of domain-invariant representations is pivotal for DG as they possess…

Computer Vision and Pattern Recognition · Computer Science 2024-01-12 Na Wang , Lei Qi , Jintao Guo , Yinghuan Shi , Yang Gao

The coverage and composition of the pretraining data significantly impacts the generalization ability of Large Language Models (LLMs). Despite its importance, recent LLMs still rely on heuristics and trial and error to increase or reduce…

Machine Learning · Computer Science 2024-02-06 Simin Fan , Matteo Pagliardini , Martin Jaggi

Domain Generalization (DG) aims to learn models whose performance remains high on unseen domains encountered at test-time by using data from multiple related source domains. Many existing DG algorithms reduce the divergence between source…

Machine Learning · Computer Science 2022-06-27 Akshay Mehra , Bhavya Kailkhura , Pin-Yu Chen , Jihun Hamm

Domain Generalization (DG) aims to train a model, from multiple observed source domains, in order to perform well on unseen target domains. To obtain the generalization capability, prior DG approaches have focused on extracting…

Machine Learning · Computer Science 2021-10-19 Manh-Ha Bui , Toan Tran , Anh Tuan Tran , Dinh Phung

Deep learning models often struggle to maintain performance when deployed on data distributions different from their training data, particularly in real-world applications where environmental conditions frequently change. While Multi-source…

Machine Learning · Computer Science 2025-05-30 Shohei Enomoto

While deep neural networks demonstrate state-of-the-art performance on a variety of learning tasks, their performance relies on the assumption that train and test distributions are the same, which may not hold in real-world applications.…

Machine Learning · Computer Science 2021-02-18 Wenyu Zhang , Mohamed Ragab , Ramon Sagarna

Deep Neural Networks (DNNs) suffer from domain shift when the test dataset follows a distribution different from the training dataset. Domain generalization aims to tackle this issue by learning a model that can generalize to unseen…

Computer Vision and Pattern Recognition · Computer Science 2022-12-15 Yu Ding , Lei Wang , Bin Liang , Shuming Liang , Yang Wang , Fang Chen

Global variations in terrain appearance raise a major challenge for satellite image analysis, leading to poor model performance when training on locations that differ from those encountered at test time. This remains true even with recent…

Computer Vision and Pattern Recognition · Computer Science 2025-04-29 Abhishek Kuriyal , Elliot Vincent , Mathieu Aubry , Loic Landrieu

Human visual perception can easily generalize to out-of-distributed visual data, which is far beyond the capability of modern machine learning models. Domain generalization (DG) aims to close this gap, with existing DG methods mainly…

Computer Vision and Pattern Recognition · Computer Science 2023-01-30 Bo Li , Yifei Shen , Jingkang Yang , Yezhen Wang , Jiawei Ren , Tong Che , Jun Zhang , Ziwei Liu

The problem of domain generalization is to learn from multiple training domains, and extract a domain-agnostic model that can then be applied to an unseen domain. Domain generalization (DG) has a clear motivation in contexts where there are…

Computer Vision and Pattern Recognition · Computer Science 2017-10-10 Da Li , Yongxin Yang , Yi-Zhe Song , Timothy M. Hospedales

Domain generalization (DG) strives to address distribution shifts across diverse environments to enhance model's generalizability. Current DG approaches are confined to acquiring robust representations with continuous features, specifically…

Computer Vision and Pattern Recognition · Computer Science 2025-04-10 Shaocong Long , Qianyu Zhou , Xikun Jiang , Chenhao Ying , Lizhuang Ma , Yuan Luo

Domain generalization (DG) is about training models that generalize well under domain shift. Previous research on DG has been conducted mostly in single-source or multi-source settings. In this paper, we consider a third, lesser-known…

Machine Learning · Computer Science 2024-06-13 Han Gao , Kaican Li , Weiyan Xie , Zhi Lin , Yongxiang Huang , Luning Wang , Caleb Chen Cao , Nevin L. Zhang

Domain generalization aims to learn a prediction model on multi-domain source data such that the model can generalize to a target domain with unknown statistics. Most existing approaches have been developed under the assumption that the…

Computer Vision and Pattern Recognition · Computer Science 2021-09-01 Jin Kim , Jiyoung Lee , Jungin Park , Dongbo Min , Kwanghoon Sohn

The single domain generalization(SDG) based on meta-learning has emerged as an effective technique for solving the domain-shift problem. However, the inadequate match of data distribution between source and augmented domains and difficult…

Computer Vision and Pattern Recognition · Computer Science 2023-11-28 Can Sun , Hao Zheng , Zhigang Hu , Liu Yang , Meiguang Zheng , Bo Xu

In this work, we investigate the unexplored intersection of domain generalization (DG) and data-free learning. In particular, we address the question: How can knowledge contained in models trained on different source domains be merged into…

Machine Learning · Computer Science 2022-11-15 Ahmed Frikha , Haokun Chen , Denis Krompaß , Thomas Runkler , Volker Tresp

Mixture-of-Experts (MoEs) achieve scalability by dynamically activating subsets of their components. Yet, understanding how expertise emerges through joint training of gating mechanisms and experts remains incomplete, especially in…

Domain generalization aims to build generalized models that perform well on unseen domains when only source domains are available for model optimization. Recent studies have shown that large-scale pre-trained models can enhance domain…

Machine Learning · Computer Science 2023-09-12 Byounggyu Lew , Donghyun Son , Buru Chang