English
Related papers

Related papers: Layer-wise Model Merging for Unsupervised Domain A…

200 papers

Combining multiple machine learning models has long been a technique for enhancing performance, particularly in distributed settings. Traditional approaches, such as model ensembles, work well, but are expensive in terms of memory and…

Machine Learning · Computer Science 2024-12-23 Albert Manuel Orozco Camacho , Stefan Horoi , Guy Wolf , Eugene Belilovsky

In this paper, we study multi-target domain adaptation of scene understanding models. While previous methods achieved commendable results through inter-domain consistency losses, they often assumed unrealistic simultaneous access to images…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Wenyi Li , Huan-ang Gao , Mingju Gao , Beiwen Tian , Rong Zhi , Hao Zhao

Learning across domains is challenging when data cannot be centralized due to privacy or heterogeneity, which limits the ability to train a single comprehensive model. Model merging provides an appealing alternative by consolidating…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-04-16 Junming Liu , Yusen Zhang , Rongchao Zhang , Wenkai Zhu , Tian Wu

Merging multiple expert models offers a promising approach for performing multi-task learning without accessing their original data. Existing methods attempt to alleviate task conflicts by sparsifying task vectors or promoting orthogonality…

Machine Learning · Computer Science 2025-05-27 Yongxian Wei , Anke Tang , Li Shen , Zixuan Hu , Chun Yuan , Xiaochun Cao

The aim of this paper is to give an overview of the recent advancements in the Unsupervised Domain Adaptation (UDA) of deep networks for semantic segmentation. This task is attracting a wide interest, since semantic segmentation models…

Computer Vision and Pattern Recognition · Computer Science 2020-05-25 Marco Toldo , Andrea Maracani , Umberto Michieli , Pietro Zanuttigh

Unsupervised domain adaptation (UDA) for semantic segmentation seeks to transfer models from a labeled source domain to an unlabeled target domain. While auxiliary self-supervised tasks such as contrastive learning have enhanced feature…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Wenlve Zhou , Zhiheng Zhou , Tiantao Xian , Yikui Zhai , Weibin Wu , Biyun Ma

Unsupervised domain adaptation (UDA) is important for applications where large scale annotation of representative data is challenging. For semantic segmentation in particular, it helps deploy on real "target domain" data models that are…

Computer Vision and Pattern Recognition · Computer Science 2019-08-20 Tuan-Hung Vu , Himalaya Jain , Maxime Bucher , Matthieu Cord , Patrick Pérez

The success of large language models has garnered widespread attention for model merging techniques, especially training-free methods which combine model capabilities within the parameter space. However, two challenges remain: (1) uniform…

Artificial Intelligence · Computer Science 2025-03-28 Jiaqi Han , Jingwen Ye , Shunyu Liu , Haofei Zhang , Jie Song , Zunlei Feng , Mingli Song

Scene understanding is a pivotal task for autonomous vehicles to safely navigate in the environment. Recent advances in deep learning enable accurate semantic reconstruction of the surroundings from LiDAR data. However, these models…

Computer Vision and Pattern Recognition · Computer Science 2022-03-01 Borna Bešić , Nikhil Gosala , Daniele Cattaneo , Abhinav Valada

We develop an algorithm for adapting a semantic segmentation model that is trained using a labeled source domain to generalize well in an unlabeled target domain. A similar problem has been studied extensively in the unsupervised domain…

Machine Learning · Computer Science 2021-01-12 Serban Stan , Mohammad Rostami

Model merging combines the parameters of multiple neural networks into a single model without additional training. As fine-tuned large language models (LLMs) proliferate, merging offers a computationally efficient alternative to ensembles…

Computation and Language · Computer Science 2026-03-31 Mingyang Song , Mao Zheng

Unsupervised domain adaptive segmentation aims to improve the segmentation accuracy of models on target domains without relying on labeled data from those domains. This approach is crucial when labeled target domain data is scarce or…

Computer Vision and Pattern Recognition · Computer Science 2024-07-25 Mu Chen , Zhedong Zheng , Yi Yang

The growing deployment of low-cost, distributed sensor networks in environmental and biomedical domains has enabled continuous, large-scale health monitoring. However, these systems often face challenges related to degraded data quality…

Machine Learning · Computer Science 2025-08-07 Keivan Faghih Niresi , Ismail Nejjar , Olga Fink

Deep learning frameworks allowed for a remarkable advancement in semantic segmentation, but the data hungry nature of convolutional networks has rapidly raised the demand for adaptation techniques able to transfer learned knowledge from…

Computer Vision and Pattern Recognition · Computer Science 2020-11-26 Marco Toldo , Umberto Michieli , Pietro Zanuttigh

We introduce an unsupervised domain adaption (UDA) strategy that combines multiple image translations, ensemble learning and self-supervised learning in one coherent approach. We focus on one of the standard tasks of UDA in which a semantic…

Computer Vision and Pattern Recognition · Computer Science 2021-07-14 Fabrizio J. Piva , Gijs Dubbelman

This paper challenges the cross-domain semantic segmentation task, aiming to improve the segmentation accuracy on the unlabeled target domain without incurring additional annotation. Using the pseudo-label-based unsupervised domain…

Computer Vision and Pattern Recognition · Computer Science 2021-12-02 Kai Zhang , Yifan Sun , Rui Wang , Haichang Li , Xiaohui Hu

The recent prevalence of deep neural networks has lead semantic segmentation networks to achieve human-level performance in the medical field when sufficient training data is provided. Such networks however fail to generalize when tasked…

Computer Vision and Pattern Recognition · Computer Science 2023-08-01 Serban Stan , Mohammad Rostami

Achieving robust generalization across diverse data domains remains a significant challenge in computer vision. This challenge is important in safety-critical applications, where deep-neural-network-based systems must perform reliably under…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Brunó B. Englert , Fabrizio J. Piva , Tommie Kerssies , Daan de Geus , Gijs Dubbelman

Multi-task model merging aims to consolidate knowledge from multiple fine-tuned task-specific experts into a unified model while minimizing performance degradation. Existing methods primarily approach this by minimizing differences between…

Machine Learning · Computer Science 2025-10-28 Wenju Sun , Qingyong Li , Wen Wang , Yang Liu , Yangli-ao Geng , Boyang Li

Unsupervised domain adaptation (UDA) aims to adapt a model of the labeled source domain to an unlabeled target domain. Existing UDA-based semantic segmentation approaches always reduce the domain shifts in pixel level, feature level, and…

Computer Vision and Pattern Recognition · Computer Science 2022-09-20 Qianyu Zhou , Zhengyang Feng , Qiqi Gu , Jiangmiao Pang , Guangliang Cheng , Xuequan Lu , Jianping Shi , Lizhuang Ma
‹ Prev 1 2 3 10 Next ›