English
Related papers

Related papers: Domain Generalization using Pretrained Models with…

200 papers

Domain generalization (DG) aims at learning a model on source domains to well generalize on the unseen target domain. Although it has achieved great success, most of existing methods require the label information for all training samples in…

Computer Vision and Pattern Recognition · Computer Science 2024-04-30 Lei Qi , Hongpeng Yang , Yinghuan Shi , Xin Geng

Federated domain generalization aims to train a global model from multiple source domains and ensure its generalization ability to unseen target domains. Due to the target domain being with unknown domain shifts, attempting to approximate…

Computer Vision and Pattern Recognition · Computer Science 2025-01-28 Haoxuan Che , Yifei Wu , Haibo Jin , Yong Xia , Hao Chen

Supervised fine-tuning (SFT) on domain-specific data is the dominant approach for adapting foundation models to specialized tasks. However, it has been observed that SFT models tend to forget knowledge acquired during pretraining. In vision…

Artificial Intelligence · Computer Science 2025-06-03 Yifan Hao , Xingyuan Pan , Hanning Zhang , Chenlu Ye , Rui Pan , Tong Zhang

While originally designed for image generation, diffusion models have recently shown to provide excellent pretrained feature representations for semantic segmentation. Intrigued by this result, we set out to explore how well…

Computer Vision and Pattern Recognition · Computer Science 2023-07-06 Rui Gong , Martin Danelljan , Han Sun , Julio Delgado Mangas , Luc Van Gool

The problem of generalizing deep neural networks from multiple source domains to a target one is studied under two settings: When unlabeled target data is available, it is a multi-source unsupervised domain adaptation (UDA) problem,…

Computer Vision and Pattern Recognition · Computer Science 2021-10-04 Kaiyang Zhou , Yongxin Yang , Yu Qiao , Tao Xiang

To generalize the model trained in source domains to unseen target domains, domain generalization (DG) has recently attracted lots of attention. Since target domains can not be involved in training, overfitting source domains is inevitable.…

Computer Vision and Pattern Recognition · Computer Science 2022-08-09 Jian Zhang , Lei Qi , Yinghuan Shi , Yang Gao

Aiming to generalize the well-trained gaze estimation model to new target domains, Cross-domain Gaze Estimation (CDGE) is developed for real-world application scenarios. Existing CDGE methods typically extract the domain-invariant features…

Computer Vision and Pattern Recognition · Computer Science 2025-10-29 Hao-Ran Yang , Xiaohui Chen , Chuan-Xian Ren

As a recent noticeable topic, domain generalization (DG) aims to first learn a generic model on multiple source domains and then directly generalize to an arbitrary unseen target domain without any additional adaption. In previous DG…

Computer Vision and Pattern Recognition · Computer Science 2022-02-17 Yue Wang , Lei Qi , Yinghuan Shi , Yang Gao

Deep learning models for medical image analysis easily suffer from distribution shifts caused by dataset artifacts bias, camera variations, differences in the imaging station, etc., leading to unreliable diagnoses in real-world clinical…

Image and Video Processing · Electrical Eng. & Systems 2024-01-09 Siyuan Yan , Chi Liu , Zhen Yu , Lie Ju , Dwarikanath Mahapatra , Brigid Betz-Stablein , Victoria Mar , Monika Janda , Peter Soyer , Zongyuan Ge

Federated domain generalization (FedDG) addresses distribution shifts among clients in a federated learning framework. FedDG methods aggregate the parameters of locally trained client models to form a global model that generalizes to unseen…

Machine Learning · Computer Science 2025-12-12 Ragja Palakkadavath , Hung Le , Thanh Nguyen-Tang , Svetha Venkatesh , Sunil Gupta

By pretraining to synthesize coherent images from perturbed inputs, generative models inherently learn to understand object boundaries and scene compositions. How can we repurpose these generative representations for general-purpose…

Computer Vision and Pattern Recognition · Computer Science 2026-04-06 Om Khangaonkar , Hamed Pirsiavash

Machine learning models typically suffer from the domain shift problem when trained on a source dataset and evaluated on a target dataset of different distribution. To overcome this problem, domain generalisation (DG) methods aim to…

Computer Vision and Pattern Recognition · Computer Science 2020-03-16 Kaiyang Zhou , Yongxin Yang , Timothy Hospedales , Tao Xiang

Semi-supervised domain generalization (SSDG) leverages a small fraction of labeled data alongside unlabeled data to enhance model generalization. Most of the existing SSDG methods rely on pseudo-labeling (PL) for unlabeled data, often…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Venuri Amarasinghe , Kalinga Bandara , Isun Randila , Asini Jayakody , Chamuditha Jayanga Galappaththige , Ranga Rodrigo

In this paper we propose a sequential learning framework for Domain Generalization (DG), the problem of training a model that is robust to domain shift by design. Various DG approaches have been proposed with different motivating…

Computer Vision and Pattern Recognition · Computer Science 2020-04-06 Da Li , Yongxin Yang , Yi-Zhe Song , Timothy Hospedales

In sequence labeling, previous domain adaptation methods focus on the adaptation from the source domain to the entire target domain without considering the diversity of individual target domain samples, which may lead to negative transfer…

Computation and Language · Computer Science 2019-09-11 Huiyun Yang , Shujian Huang , Xinyu Dai , Jiajun Chen

The generalization capability of machine learning models, which refers to generalizing the knowledge for an "unseen" domain via learning from one or multiple seen domain(s), is of great importance to develop and deploy machine learning…

Machine Learning · Computer Science 2022-02-17 Keyu Chen , Di Zhuang , J. Morris Chang

In domain generalization (DG), the target domain is unknown when the model is being trained, and the trained model should successfully work on an arbitrary (and possibly unseen) target domain during inference. This is a difficult problem,…

Computer Vision and Pattern Recognition · Computer Science 2023-06-14 Jungwuk Park , Dong-Jun Han , Soyeong Kim , Jaekyun Moon

Domain adaptation (DA) mitigates the domain shift problem when transferring knowledge from one annotated domain to another similar but different unlabeled domain. However, existing models often utilize one of the ImageNet models as the…

Computer Vision and Pattern Recognition · Computer Science 2021-05-04 Youshan Zhang , Brian D. Davison

The "pre-train, prompt-tuning'' paradigm has demonstrated impressive performance for tuning pre-trained heterogeneous graph neural networks (HGNNs) by mitigating the gap between pre-trained models and downstream tasks. However, most…

Machine Learning · Computer Science 2024-11-05 Yujie Mo , Runpeng Yu , Xiaofeng Zhu , Xinchao Wang

Preference tuning aligns pretrained language models to human judgments of quality, helpfulness, or safety by optimizing over explicit preference signals rather than likelihood alone. Prior work has shown that preference-tuning degrades…

Computation and Language · Computer Science 2026-01-12 Constantinos Karouzos , Xingwei Tan , Nikolaos Aletras