English
Related papers

Related papers: Training-Free Model Merging for Multi-target Domai…

200 papers

Medical Foundation Models (MFMs), trained on large-scale datasets, have demonstrated superior performance across various tasks. However, these models still struggle with domain gaps in practical applications. Specifically, even after…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Jia-Xuan Jiang , Wenhui Lei , Yifeng Wu , Hongtao Wu , Furong Li , Yining Xie , Xiaofan Zhang , Zhong Wang

Domain adaptation for semantic segmentation has recently been actively studied to increase the generalization capabilities of deep learning models. The vast majority of the domain adaptation methods tackle single-source case, where the…

Image and Video Processing · Electrical Eng. & Systems 2020-04-16 Onur Tasar , Yuliya Tarabalka , Alain Giros , Pierre Alliez , Sébastien Clerc

This work tackles the unsupervised cross-domain object detection problem which aims to generalize a pre-trained object detector to a new target domain without labels. We propose an uncertainty-aware model adaptation method, which is based…

Computer Vision and Pattern Recognition · Computer Science 2021-08-31 Minjie Cai , Minyi Luo , Xionghu Zhong , Hao Chen

This paper is concerned with data-driven unsupervised domain adaptation, where it is unknown in advance how the joint distribution changes across domains, i.e., what factors or modules of the data distribution remain invariant or change…

Machine Learning · Computer Science 2020-10-26 Kun Zhang , Mingming Gong , Petar Stojanov , Biwei Huang , Qingsong Liu , Clark Glymour

Unsupervised domain adaptation enables to alleviate the need for pixel-wise annotation in the semantic segmentation. One of the most common strategies is to translate images from the source domain to the target domain and then align their…

Computer Vision and Pattern Recognition · Computer Science 2020-08-25 Jinyu Yang , Weizhi An , Sheng Wang , Xinliang Zhu , Chaochao Yan , Junzhou Huang

From a multi-model compression perspective, model merging enables memory-efficient serving of multiple models fine-tuned from the same base, but suffers from degraded performance due to interference among their task-specific parameter…

Machine Learning · Computer Science 2025-05-19 Hangyu Zhou , Aaron Gokaslan , Volodymyr Kuleshov , Bharath Hariharan

The major approaches of transfer learning in computer vision have tried to adapt the source domain to the target domain one-to-one. However, this scenario is difficult to apply to real applications such as video surveillance systems. As…

Computer Vision and Pattern Recognition · Computer Science 2020-03-04 Tetsuo Inoshita , Yuichi Nakatani , Katsuhiko Takahashi , Asuka Ishii , Gaku Nakano

Unsupervised domain adaptation for semantic segmentation aims to make models trained on synthetic data (source domain) adapt to real images (target domain). Previous feature-level adversarial learning methods only consider adapting models…

Computer Vision and Pattern Recognition · Computer Science 2021-09-21 Hongruixuan Chen , Chen Wu , Yonghao Xu , Bo Du

The high sample complexity of reinforcement learning challenges its use in practice. A promising approach is to quickly adapt pre-trained policies to new environments. Existing methods for this policy adaptation problem typically rely on…

Machine Learning · Computer Science 2020-06-16 Yuda Song , Aditi Mavalankar , Wen Sun , Sicun Gao

In this paper, we introduce a realistic and challenging domain adaptation problem called Universal Semi-supervised Model Adaptation (USMA), which i) requires only a pre-trained source model, ii) allows the source and target domain to have…

Computer Vision and Pattern Recognition · Computer Science 2023-11-06 Zizheng Yan , Yushuang Wu , Yipeng Qin , Xiaoguang Han , Shuguang Cui , Guanbin Li

Fine-tuning pre-trained models provides significant advantages in downstream performance. The ubiquitous nature of pre-trained models such as BERT and its derivatives in natural language processing has also led to a proliferation of…

Computation and Language · Computer Science 2024-05-06 Thennal D K , Ganesh Nathan , Suchithra M S

Domain Generalization aims to develop models that can generalize to novel and unseen data distributions. In this work, we study how model architectures and pre-training objectives impact feature richness and propose a method to effectively…

Machine Learning · Computer Science 2025-04-30 Xavier Thomas , Deepti Ghadiyaram

Domain adaptive pose estimation aims to enable deep models trained on source domain (synthesized) datasets produce similar results on the target domain (real-world) datasets. The existing methods have made significant progress by conducting…

Computer Vision and Pattern Recognition · Computer Science 2024-04-26 Yugan Chen , Lin Zhao , Yalong Xu , Honglei Zu , Xiaoqi An , Guangyu Li

In object detection, data amount and cost are a trade-off, and collecting a large amount of data in a specific domain is labor intensive. Therefore, existing large-scale datasets are used for pre-training. However, conventional transfer…

Computer Vision and Pattern Recognition · Computer Science 2022-09-01 Yuzuru Nakamura , Yasunori Ishii , Yuki Maruyama , Takayoshi Yamashita

Domain adaptation seeks to mitigate the shift between training on the \emph{source} domain and testing on the \emph{target} domain. Most adaptation methods rely on the source data by joint optimization over source data and target data.…

Computer Vision and Pattern Recognition · Computer Science 2021-09-03 Dequan Wang , Shaoteng Liu , Sayna Ebrahimi , Evan Shelhamer , Trevor Darrell

Deep learning models tend to underperform in the presence of domain shifts. Domain transfer has recently emerged as a promising approach wherein images exhibiting a domain shift are transformed into other domains for augmentation or…

Image and Video Processing · Electrical Eng. & Systems 2022-10-27 Weinan Song , Gaurav Fotedar , Nima Tajbakhsh , Ziheng Zhou , Lei He , Xiaowei Ding

Histopathological images are essential for medical diagnosis and treatment planning, but interpreting them accurately using machine learning can be challenging due to variations in tissue preparation, staining and imaging protocols. Domain…

Computer Vision and Pattern Recognition · Computer Science 2023-11-01 Vaibhav Khamankar , Sutanu Bera , Saumik Bhattacharya , Debashis Sen , Prabir Kumar Biswas

Model merging aims to integrate the strengths of multiple fine-tuned models into a unified model while preserving task-specific capabilities. Existing methods, represented by task arithmetic, are typically classified into global- and…

Machine Learning · Computer Science 2025-06-17 Kunda Yan , Min Zhang , Sen Cui , Zikun Qu , Bo Jiang , Feng Liu , Changshui Zhang

The performance of machine learning algorithms is known to be negatively affected by possible mismatches between training (source) and test (target) data distributions. In fact, this problem emerges whenever an acoustic scene classification…

Audio and Speech Processing · Electrical Eng. & Systems 2020-05-04 Alessandro Ilic Mezza , Emanuël A. P. Habets , Meinard Müller , Augusto Sarti

Most domain adaptation methods focus on single-source-single-target adaptation settings. Multi-target domain adaptation is a powerful extension in which a single classifier is learned for multiple unlabeled target domains. To build a…

Computer Vision and Pattern Recognition · Computer Science 2022-02-02 Sudipan Saha , Shan Zhao , Nasrullah Sheikh , Xiao Xiang Zhu