English
Related papers

Related papers: Domain Generalization using Pretrained Models with…

200 papers

Domain generalization is the task of learning models that generalize to unseen target domains. We propose a simple yet effective method for domain generalization, named cross-domain ensemble distillation (XDED), that learns domain-invariant…

Computer Vision and Pattern Recognition · Computer Science 2022-11-28 Kyungmoon Lee , Sungyeon Kim , Suha Kwak

The distribution shifts between training and test data typically undermine the performance of models. In recent years, lots of work pays attention to domain generalization (DG) where distribution shifts exist, and target data are unseen.…

Machine Learning · Computer Science 2024-01-05 Wang Lu , Jindong Wang , Yidong Wang , Xing Xie

With the goal of directly generalizing trained model to unseen target domains, domain generalization (DG), a newly proposed learning paradigm, has attracted considerable attention. Previous DG models usually require a sufficient quantity of…

Computer Vision and Pattern Recognition · Computer Science 2022-08-18 Ruiqi Wang , Lei Qi , Yinghuan Shi , Yang Gao

Transferring the knowledge of pretrained networks to new domains by means of finetuning is a widely used practice for applications based on discriminative models. To the best of our knowledge this practice has not been studied within the…

Computer Vision and Pattern Recognition · Computer Science 2018-10-03 Yaxing Wang , Chenshen Wu , Luis Herranz , Joost van de Weijer , Abel Gonzalez-Garcia , Bogdan Raducanu

Considerable progress has been made in domain generalization (DG) which aims to learn a generalizable model from multiple well-annotated source domains to unknown target domains. However, it can be prohibitively expensive to obtain…

Computer Vision and Pattern Recognition · Computer Science 2022-08-09 Junkun Yuan , Xu Ma , Defang Chen , Kun Kuang , Fei Wu , Lanfen Lin

Leveraging datasets available to learn a model with high generalization ability to unseen domains is important for computer vision, especially when the unseen domain's annotated data are unavailable. We study a novel and practical problem…

Computer Vision and Pattern Recognition · Computer Science 2021-04-09 Yang Shu , Zhangjie Cao , Chenyu Wang , Jianmin Wang , Mingsheng Long

Unarguably, deep learning models capable of generalizing to unseen domain data while leveraging a few labels are of great practical significance due to low developmental costs. In search of this endeavor, we study the challenging problem of…

Computer Vision and Pattern Recognition · Computer Science 2024-09-06 Chamuditha Jayanaga Galappaththige , Zachary Izzo , Xilin He , Honglu Zhou , Muhammad Haris Khan

The well known domain shift issue causes model performance to degrade when deployed to a new target domain with different statistics to training. Domain adaptation techniques alleviate this, but need some instances from the target domain to…

Machine Learning · Computer Science 2019-06-11 Yiying Li , Yongxin Yang , Wei Zhou , Timothy M. Hospedales

Ideally, visual learning algorithms should be generalizable, for dealing with any unseen domain shift when deployed in a new target environment; and data-efficient, for reducing development costs by using as little labels as possible. To…

Computer Vision and Pattern Recognition · Computer Science 2021-12-17 Kaiyang Zhou , Chen Change Loy , Ziwei Liu

Domain generalization (DG) methods aim to maintain good performance in an unseen target domain by using training data from multiple source domains. While success on certain occasions are observed, enhancing the baseline across most…

Machine Learning · Computer Science 2024-10-28 Liang Chen , Yong Zhang , Yibing Song , Zhiqiang Shen , Lingqiao Liu

Machine learning models are intrinsically vulnerable to domain shift between training and testing data, resulting in poor performance in novel domains. Domain generalization (DG) aims to overcome the problem by leveraging multiple source…

Computer Vision and Pattern Recognition · Computer Science 2022-10-27 Tingwei Wang , Da Li , Kaiyang Zhou , Tao Xiang , Yi-Zhe Song

Deep neural networks often suffer performance drops when test data distribution differs from training data. Domain Generalization (DG) aims to address this by focusing on domain-invariant features or augmenting data for greater diversity.…

Computer Vision and Pattern Recognition · Computer Science 2025-09-09 Nam Duong Tran , Nam Nguyen Phuong , Hieu H. Pham , Phi Le Nguyen , My T. Thai

The goal of domain generalization is to learn from multiple source domains to generalize to unseen target domains under distribution discrepancy. Current state-of-the-art methods in this area are fully supervised, but for many real-world…

Machine Learning · Computer Science 2020-10-01 Hossein Sharifi-Noghabi , Hossein Asghari , Nazanin Mehrasa , Martin Ester

We study the problem of transfer learning and fine-tuning in linear models for both regression and binary classification. In particular, we consider the use of stochastic gradient descent (SGD) on a linear model initialized with pretrained…

Machine Learning · Computer Science 2025-02-25 Reza Ghane , Danil Akhtiamov , Babak Hassibi

Domain generalization aims to learn a generalization model that can perform well on unseen test domains by only training on limited source domains. However, existing domain generalization approaches often bring in prediction-irrelevant…

Computer Vision and Pattern Recognition · Computer Science 2023-08-02 Chia-Yuan Chang , Yu-Neng Chuang , Guanchu Wang , Mengnan Du , Na Zou

Domain adaptive semantic segmentation is recognized as a promising technique to alleviate the domain shift between the labeled source domain and the unlabeled target domain in many real-world applications, such as automatic pilot. However,…

Computer Vision and Pattern Recognition · Computer Science 2021-10-14 Fuming You , Jingjing Li , Lei Zhu , Ke Lu , Zhi Chen , Zi Huang

With the increasing utilization of deep learning in outdoor settings, its robustness needs to be enhanced to preserve accuracy in the face of distribution shifts, such as compression artifacts. Data augmentation is a widely used technique…

Computer Vision and Pattern Recognition · Computer Science 2023-10-03 Shohei Enomoto , Monikka Roslianna Busto , Takeharu Eda

Human visual perception can easily generalize to out-of-distributed visual data, which is far beyond the capability of modern machine learning models. Domain generalization (DG) aims to close this gap, with existing DG methods mainly…

Computer Vision and Pattern Recognition · Computer Science 2023-01-30 Bo Li , Yifei Shen , Jingkang Yang , Yezhen Wang , Jiawei Ren , Tong Che , Jun Zhang , Ziwei Liu

Domain adaptation seeks to leverage the abundant label information in a source domain to improve classification performance in a target domain with limited labels. While the field has seen extensive methodological development, its…

Machine Learning · Statistics 2025-07-31 Elif Vural , Huseyin Karaca

Source-free domain adaptation (SFDA) aims to adapt a well-trained source model to an unlabelled target domain without accessing the source dataset, making it applicable in a variety of real-world scenarios. Existing SFDA methods ONLY assess…

Computer Vision and Pattern Recognition · Computer Science 2023-10-10 Longxiang Tang , Kai Li , Chunming He , Yulun Zhang , Xiu Li