English
Related papers

Related papers: Domain-Aware Fine-Tuning of Foundation Models

200 papers

Modern visual systems have a wide range of potential applications in vision tasks for natural science research, such as aiding in species discovery, monitoring animals in the wild, and so on. However, real-world vision tasks may experience…

Computer Vision and Pattern Recognition · Computer Science 2024-03-13 Kai Yi , Paul Janson , Wenxuan Zhang , Mohamed Elhoseiny

The generalization of deep neural networks to unknown domains is a major challenge despite their tremendous progress in recent years. For this reason, the dynamic area of domain generalization (DG) has emerged. In contrast to unsupervised…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Manuel Schwonberg , Hanno Gottschalk

Domain adaptation for sentiment analysis is challenging due to the fact that supervised classifiers are very sensitive to changes in domain. The two most prominent approaches to this problem are structural correspondence learning and…

Computation and Language · Computer Science 2018-06-15 Jeremy Barnes , Roman Klinger , Sabine Schulte im Walde

Domain adaptive object detection is challenging due to distinctive data distribution between source domain and target domain. In this paper, we propose a unified multi-granularity alignment based object detection framework towards…

Computer Vision and Pattern Recognition · Computer Science 2022-04-01 Wenzhang Zhou , Dawei Du , Libo Zhang , Tiejian Luo , Yanjun Wu

Deep Neural Networks have shown great promise on a variety of downstream applications; but their ability to adapt and generalize to new data and tasks remains a challenge. However, the ability to perform few or zero-shot adaptation to novel…

Machine Learning · Computer Science 2020-10-14 Samarth Sinha , Karsten Roth , Anirudh Goyal , Marzyeh Ghassemi , Hugo Larochelle , Animesh Garg

Domain generalization aims at training machine learning models to perform robustly across different and unseen domains. Several recent methods use multiple datasets to train models to extract domain-invariant features, hoping to generalize…

Machine Learning · Computer Science 2021-05-19 Mattia Segu , Alessio Tonioni , Federico Tombari

Deep learning-based methods have been widely researched in the areas of language and vision, demonstrating their capacity to understand long sequences of data and their usefulness in numerous helio-physics applications. Foundation models…

Machine learning models are prone to overfitting their training (source) domains, which is commonly believed to be the reason why they falter in novel target domains. Here we examine the contrasting view that multi-source domain…

Computation and Language · Computer Science 2022-10-26 Md Arafat Sultan , Avirup Sil , Radu Florian

Unsupervised domain adaptation algorithms aim to transfer the knowledge learned from one domain to another (e.g., synthetic to real images). The adapted representations often do not capture pixel-level domain shifts that are crucial for…

Computer Vision and Pattern Recognition · Computer Science 2020-01-13 Yun-Chun Chen , Yen-Yu Lin , Ming-Hsuan Yang , Jia-Bin Huang

Invariant approaches have been remarkably successful in tackling the problem of domain generalization, where the objective is to perform inference on data distributions different from those used in training. In our work, we investigate…

Computer Vision and Pattern Recognition · Computer Science 2021-03-31 Abhimanyu Dubey , Vignesh Ramanathan , Alex Pentland , Dhruv Mahajan

We explore the zero-shot setting for day-night domain adaptation. The traditional domain adaptation setting is to train on one domain and adapt to the target domain by exploiting unlabeled data samples from the test set. As gathering…

Computer Vision and Pattern Recognition · Computer Science 2021-10-12 Attila Lengyel , Sourav Garg , Michael Milford , Jan C. van Gemert

In real-life applications, machine learning models often face scenarios where there is a change in data distribution between training and test domains. When the aim is to make predictions on distributions different from those seen at…

Machine Learning · Computer Science 2021-11-04 Lucas Mansilla , Rodrigo Echeveste , Diego H. Milone , Enzo Ferrante

Universal domain adaptation aims to align the classes and reduce the feature gap between the same category of the source and target domains. The target private category is set as the unknown class during the adaptation process, as it is not…

Computer Vision and Pattern Recognition · Computer Science 2024-02-07 Yuxiang Lai , Yi Zhou , Xinghong Liu , Tao Zhou

Domain shift, the mismatch between training and testing data characteristics, causes significant degradation in the predictive performance in multi-source imaging scenarios. In medical imaging, the heterogeneity of population, scanners and…

Machine Learning · Computer Science 2021-12-21 Rongguang Wang , Pratik Chaudhari , Christos Davatzikos

End-to-end learning methods have achieved impressive results in many areas of computer vision. At the same time, these methods still suffer from a degradation in performance when testing on new datasets that stem from a different…

Computer Vision and Pattern Recognition · Computer Science 2016-03-24 Rahaf Aljundi , Tinne Tuytelaars

Existing unsupervised domain adaptation methods based on adversarial learning have achieved good performance in several medical imaging tasks. However, these methods focus only on global distribution adaptation and ignore distribution…

Computer Vision and Pattern Recognition · Computer Science 2022-07-11 Wei Feng , Lin Wang , Lie Ju , Xin Zhao , Xin Wang , Xiaoyu Shi , Zongyuan Ge

Off-the-shelf models are widely used by computational social science researchers to measure properties of text, such as sentiment. However, without access to source data it is difficult to account for domain shift, which represents a threat…

Computation and Language · Computer Science 2022-05-02 Junshen K. Chen , Dallas Card , Dan Jurafsky

Domain Generalization aims to develop models that can generalize to novel and unseen data distributions. In this work, we study how model architectures and pre-training objectives impact feature richness and propose a method to effectively…

Machine Learning · Computer Science 2025-04-30 Xavier Thomas , Deepti Ghadiyaram

Recently, considerable effort has been devoted to deep domain adaptation in computer vision and machine learning communities. However, most of existing work only concentrates on learning shared feature representation by minimizing the…

Machine Learning · Computer Science 2019-04-24 Chao Chen , Zhihong Chen , Boyuan Jiang , Xinyu Jin

Vision Foundation Models (VFMs) excel in generalization due to large-scale pretraining, but fine-tuning them for Domain Generalized Semantic Segmentation (DGSS) while maintaining this ability remains challenging. Existing approaches either…

Computer Vision and Pattern Recognition · Computer Science 2025-04-02 Dong Zhao , Jinlong Li , Shuang Wang , Mengyao Wu , Qi Zang , Nicu Sebe , Zhun Zhong