English
Related papers

Related papers: Preserving Domain Generalization in Fine-Tuning vi…

200 papers

Deep learning has achieved state-of-the-art performance on several computer vision tasks and domains. Nevertheless, it still has a high computational cost and demands a significant amount of parameters. Such requirements hinder the use in…

Computer Vision and Pattern Recognition · Computer Science 2024-07-08 Samuel Felipe dos Santos , Rodrigo Berriel , Thiago Oliveira-Santos , Nicu Sebe , Jurandy Almeida

In real-world applications, the sample distribution at the inference stage often differs from the one at the training stage, causing performance degradation of trained deep models. The research on domain generalization (DG) aims to develop…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Jiao Zhang , Jian Xu , Xu-Yao Zhang , Cheng-Lin Liu

Data augmentation is one of the most effective techniques for regularizing deep learning models and improving their recognition performance in a variety of tasks and domains. However, this holds for standard in-domain settings, in which the…

Remote sensing enables a wide range of critical applications such as land cover and land use mapping, crop yield prediction, and environmental monitoring. Advances in satellite technology have expanded remote sensing datasets, yet…

Computer Vision and Pattern Recognition · Computer Science 2025-05-06 Anan Yaghmour , Melba M. Crawford , Saurabh Prasad

Despite the success, the process of fine-tuning large-scale PLMs brings prohibitive adaptation costs. In fact, fine-tuning all the parameters of a colossal model and retaining separate instances for different tasks are practically…

Vision foundation models (VFMs) have demonstrated remarkable capabilities in learning universal visual representations. However, adapting these models to downstream tasks conventionally requires parameter updates, with even…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Jiahuan Long , Tingsong Jiang , Wen Yao , Yizhe Xiong , Zhengqin Xu , Shuai Jia , Hanqing Liu , Chao Ma

Single Domain Generalization (SDG) tackles the problem of training a model on a single source domain so that it generalizes to any unseen target domain. While this has been well studied for image classification, the literature on SDG object…

Computer Vision and Pattern Recognition · Computer Science 2023-03-07 Vidit Vidit , Martin Engilberge , Mathieu Salzmann

The goal of Deep Domain Adaptation is to make it possible to use Deep Nets trained in one domain where there is enough annotated training data in another where there is little or none. Most current approaches have focused on learning…

Computer Vision and Pattern Recognition · Computer Science 2017-11-22 Artem Rozantsev , Mathieu Salzmann , Pascal Fua

Few-shot segmentation (FSS) expects models trained on base classes to work on novel classes with the help of a few support images. However, when there exists a domain gap between the base and novel classes, the state-of-the-art FSS methods…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Yuhang Lu , Xinyi Wu , Zhenyao Wu , Song Wang

Fine-tuning pre-trained neural network models has become a widely adopted approach across various domains. However, it can lead to the distortion of pre-trained feature extractors that already possess strong generalization capabilities.…

Machine Learning · Computer Science 2024-03-27 Seokhyeon Ha , Sunbeom Jung , Jungwoo Lee

Point-cloud-based 3D object detection suffers from performance degradation when encountering data with novel domain gaps. To tackle it, the single-domain generalization (SDG) aims to generalize the detection model trained in a limited…

Computer Vision and Pattern Recognition · Computer Science 2024-02-29 Shuangzhi Li , Lei Ma , Xingyu Li

Single domain generalization aims to enhance the ability of the model to generalize to unknown domains when trained on a single source domain. However, the limited diversity in the training data hampers the learning of domain-invariant…

Computer Vision and Pattern Recognition · Computer Science 2024-06-10 Dongjia Zhao , Lei Qi , Xiao Shi , Yinghuan Shi , Xin Geng

In this work, we tackle the problem of domain generalization for object detection, specifically focusing on the scenario where only a single source domain is available. We propose an effective approach that involves two key steps:…

Computer Vision and Pattern Recognition · Computer Science 2024-05-24 Muhammad Sohail Danish , Muhammad Haris Khan , Muhammad Akhtar Munir , M. Saquib Sarfraz , Mohsen Ali

We study the problem of choosing algorithm hyper-parameters in unsupervised domain adaptation, i.e., with labeled data in a source domain and unlabeled data in a target domain, drawn from a different input distribution. We follow the…

Domain generalization requires identifying stable representations that support reliable classification across domains. Most existing methods seek such stability through improving the training process, for example, through model selection…

Computer Vision and Pattern Recognition · Computer Science 2026-05-08 Dat Nguyen , Duc-Duy Nguyen

In this paper, we look at cross-domain few-shot classification which presents the challenging task of learning new classes in previously unseen domains with few labelled examples. Existing methods, though somewhat effective, encounter…

Computer Vision and Pattern Recognition · Computer Science 2024-04-04 Rashindrie Perera , Saman Halgamuge

Deep neural networks require a large amount of labeled training data during supervised learning. However, collecting and labeling so much data might be infeasible in many cases. In this paper, we introduce a source-target selective joint…

Computer Vision and Pattern Recognition · Computer Science 2018-03-06 Weifeng Ge , Yizhou Yu

Deep learning has revolutionized neuroimage analysis by delivering unprecedented speed and accuracy. However, the narrow scope of many training datasets constrains model robustness and generalizability. This challenge is particularly acute…

Image and Video Processing · Electrical Eng. & Systems 2025-12-08 Malte Hoffmann

Domain generalization is the task of learning models that generalize to unseen target domains. We propose a simple yet effective method for domain generalization, named cross-domain ensemble distillation (XDED), that learns domain-invariant…

Computer Vision and Pattern Recognition · Computer Science 2022-11-28 Kyungmoon Lee , Sungyeon Kim , Suha Kwak

For medical image analysis, segmentation models trained on one or several domains lack generalization ability to unseen domains due to discrepancies between different data acquisition policies. We argue that the degeneration in segmentation…

Computer Vision and Pattern Recognition · Computer Science 2022-08-09 Ziqi Zhou , Lei Qi , Yinghuan Shi