English
Related papers

Related papers: Meta Adaptive Task Sampling for Few-Domain General…

200 papers

Deep networks are prone to performance degradation when there is a domain shift between the source (training) data and target (test) data. Recent test-time adaptation methods update batch normalization layers of pre-trained source models…

Computer Vision and Pattern Recognition · Computer Science 2022-10-25 Wenyu Zhang , Li Shen , Wanyue Zhang , Chuan-Sheng Foo

Much of federated learning (FL) focuses on settings where local dataset statistics remain the same between training and testing. However, this assumption often does not hold in practice due to distribution shifts, motivating the development…

Machine Learning · Computer Science 2026-02-02 Shahryar Zehtabi , Dong-Jun Han , Seyyedali Hosseinalipour , Christopher G. Brinton

When there is a distributional shift between data used to train a predictive algorithm and current data, performance can suffer. This is known as the domain adaptation problem. Bootstrap aggregating, or bagging, is a popular method for…

Methodology · Statistics 2020-06-17 Meimei Liu , David B. Dunson

Domain generalization is the problem of machine learning when the training data and the test data come from different data domains. We present a simple theoretical model of learning to generalize across domains in which there is a…

Machine Learning · Computer Science 2020-02-14 Vikas K. Garg , Adam Kalai , Katrina Ligett , Zhiwei Steven Wu

Foundation models (FMs) have shown prominent success in a wide range of tasks. Their applicability to specific domain-task pairings relies on the availability of, both, high-quality data and significant computational resources. These…

Machine Learning · Computer Science 2023-11-10 Lekang Jiang , Filip Svoboda , Nicholas D. Lane

Handling distribution shifts from training data, known as out-of-distribution (OOD) generalization, poses a significant challenge in the field of machine learning. While a pre-trained vision-language model like CLIP has demonstrated…

Computer Vision and Pattern Recognition · Computer Science 2024-07-04 Bac Nguyen , Stefan Uhlich , Fabien Cardinaux , Lukas Mauch , Marzieh Edraki , Aaron Courville

Machine learning models fail to perform when facing out-of-distribution (OOD) domains, a challenging task known as domain generalization (DG). In this work, we develop a novel DG training strategy, we call PGrad, to learn a robust gradient…

Machine Learning · Computer Science 2023-05-03 Zhe Wang , Jake Grigsby , Yanjun Qi

Few-shot classification aims to recognize unseen classes with few labeled samples from each class. Many meta-learning models for few-shot classification elaborately design various task-shared inductive bias (meta-knowledge) to solve such…

Computer Vision and Pattern Recognition · Computer Science 2021-05-04 Haoqing Wang , Zhi-Hong Deng

In the problem of domain generalization (DG), there are labeled training data sets from several related prediction problems, and the goal is to make accurate predictions on future unlabeled data sets that are not known to the learner. This…

Machine Learning · Statistics 2021-01-08 Gilles Blanchard , Aniket Anand Deshmukh , Urun Dogan , Gyemin Lee , Clayton Scott

Many few-shot learning approaches have been designed under the meta-learning framework, which learns from a variety of learning tasks and generalizes to new tasks. These meta-learning approaches achieve the expected performance in the…

Machine Learning · Computer Science 2022-01-05 Yongchun Zhu , Fuzhen Zhuang , Xiangliang Zhang , Zhiyuan Qi , Zhiping Shi , Juan Cao , Qing He

Federated Domain Generalization (FedDG) aims to train the global model for generalization ability to unseen domains with multi-domain training samples. However, clients in federated learning networks are often confined to a single, non-IID…

Artificial Intelligence · Computer Science 2024-09-24 Yuan Liu , Shu Wang , Zhe Qu , Xingyu Li , Shichao Kan , Jianxin Wang

The task of open-set domain generalization (OSDG) involves recognizing novel classes within unseen domains, which becomes more challenging with multiple modalities as input. Existing works have only addressed unimodal OSDG within the…

Computer Vision and Pattern Recognition · Computer Science 2024-07-02 Hao Dong , Eleni Chatzi , Olga Fink

Though remarkable progress has been achieved in various vision tasks, deep neural networks still suffer obvious performance degradation when tested in out-of-distribution scenarios. We argue that the feature statistics (mean and standard…

Computer Vision and Pattern Recognition · Computer Science 2022-04-25 Xiaotong Li , Yongxing Dai , Yixiao Ge , Jun Liu , Ying Shan , Ling-Yu Duan

The objective of Domain Generalization (DG) is to devise algorithms and models capable of achieving high performance on previously unseen test distributions. In the pursuit of this objective, average measure has been employed as the…

Machine Learning · Computer Science 2024-06-04 Duhun Hwang , Suhyun Kang , Moonjung Eo , Jimyeong Kim , Wonjong Rhee

Recent empirical studies on domain generalization (DG) have shown that DG algorithms that perform well on some distribution shifts fail on others, and no state-of-the-art DG algorithm performs consistently well on all shifts. Moreover,…

Machine Learning · Computer Science 2024-05-21 Jivat Neet Kaur , Emre Kiciman , Amit Sharma

In recent years, numerous domain adaptive strategies have been proposed to help deep learning models overcome the challenges posed by domain shift. However, even unsupervised domain adaptive strategies still require a large amount of target…

Image and Video Processing · Electrical Eng. & Systems 2024-07-11 Sumayya Inayat , Nimra Dilawar , Waqas Sultani , Mohsen Ali

The reliability of artificial intelligence (AI) systems in open-world settings depends heavily on their ability to flag out-of-distribution (OOD) inputs unseen during training. Recent advances in large-scale vision-language models (VLMs)…

Machine Learning · Computer Science 2025-10-14 Faizul Rakib Sayem , Shahana Ibrahim

The annotation scarcity of medical image segmentation poses challenges in collecting sufficient training data for deep learning models. Specifically, models trained on limited data may not generalize well to other unseen data domains,…

Image and Video Processing · Electrical Eng. & Systems 2023-07-19 Heng Li , Haojin Li , Wei Zhao , Huazhu Fu , Xiuyun Su , Yan Hu , Jiang Liu

Federated Domain Adaptation (FDA) is a federated learning (FL) approach that improves model performance at the target client by collaborating with source clients while preserving data privacy. FDA faces two primary challenges: domain shifts…

Machine Learning · Computer Science 2025-09-16 Mrinmay Sen , Ankita Das , Sidhant Nair , C Krishna Mohan

Deep neural networks (DNNs) usually fail to generalize well to outside of distribution (OOD) data, especially in the extreme case of single domain generalization (single-DG) that transfers DNNs from single domain to multiple unseen domains.…

Computer Vision and Pattern Recognition · Computer Science 2023-03-14 Sanqing Qu , Yingwei Pan , Guang Chen , Ting Yao , Changjun Jiang , Tao Mei