English
Related papers

Related papers: SoMA: Singular Value Decomposed Minor Components A…

200 papers

Domain adaptive detection aims to improve the generalization of detectors on target domain. To reduce discrepancy in feature distributions between two domains, recent approaches achieve domain adaption through feature alignment in different…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Libo Zhang , Wenzhang Zhou , Heng Fan , Tiejian Luo , Haibin Ling

This paper addresses classification tasks on a particular target domain in which labeled training data are only available from source domains different from (but related to) the target. Two closely related frameworks, domain adaptation and…

Computer Vision and Pattern Recognition · Computer Science 2016-07-28 Muhammad Ghifary , David Balduzzi , W. Bastiaan Kleijn , Mengjie Zhang

Parameter-efficient fine-tuning (PEFT) methods, such as LoRA, enable scalable adaptation of foundation models by injecting low-rank adapters. However, their communication and storage costs remain a major bottleneck in resource-constrained…

Machine Learning · Computer Science 2026-04-10 Seyed Mahmoud Sajjadi Mohammadabadi , Xiaolong Ma , Lei Yang , Feng Yan , Junshan Zhang

The Segment Anything Model (SAM) has emerged as a powerful visual foundation model for image segmentation. However, adapting SAM to specific downstream tasks, such as medical and agricultural imaging, remains a significant challenge. To…

Computer Vision and Pattern Recognition · Computer Science 2025-12-04 Renqi Chen , Haoyang Su , Shixiang Tang

Parameter-Efficient Fine-Tuning (PEFT) of text-to-image models has become an increasingly popular technique with many applications. Among the various PEFT methods, Low-Rank Adaptation (LoRA) and its variants have gained significant…

Machine Learning · Computer Science 2025-08-01 Zerui Tao , Yuhta Takida , Naoki Murata , Qibin Zhao , Yuki Mitsufuji

Domain generalization (DG) aims to enhance the model robustness against domain shifts without accessing target domains. A prevalent category of methods for DG is data augmentation, which focuses on generating virtual samples to simulate…

Computer Vision and Pattern Recognition · Computer Science 2024-10-22 Jintao Guo , Lei Qi , Yinghuan Shi , Yang Gao

The cost of large scale data collection and annotation often makes the application of machine learning algorithms to new tasks or datasets prohibitively expensive. One approach circumventing this cost is training models on synthetic data…

Computer Vision and Pattern Recognition · Computer Science 2016-08-23 Konstantinos Bousmalis , George Trigeorgis , Nathan Silberman , Dilip Krishnan , Dumitru Erhan

Freezing the pre-trained backbone has become a standard paradigm to avoid overfitting in few-shot segmentation. In this paper, we rethink the paradigm and explore a new regime: {\em fine-tuning a small part of parameters in the backbone}.…

Computer Vision and Pattern Recognition · Computer Science 2022-10-14 Yanpeng Sun , Qiang Chen , Xiangyu He , Jian Wang , Haocheng Feng , Junyu Han , Errui Ding , Jian Cheng , Zechao Li , Jingdong Wang

Deep neural networks are typically trained in a single shot for a specific task and data distribution, but in real world settings both the task and the domain of application can change. The problem becomes even more challenging in dense…

Computer Vision and Pattern Recognition · Computer Science 2022-06-29 Donald Shenaj , Francesco Barbato , Umberto Michieli , Pietro Zanuttigh

Domain generalization (DG) aims to learn models that perform well on unseen target domains by training on multiple source domains. Sharpness-Aware Minimization (SAM), known for finding flat minima that improve generalization, has therefore…

Machine Learning · Statistics 2025-07-01 Youngjun Song , Youngsik Hwang , Jonghun Lee , Heechang Lee , Dong-Young Lim

Despite their exceptional performance on various tasks after fine-tuning, pre-trained language models (PLMs) face significant challenges due to growing privacy concerns with data in centralized training methods. We consider federated…

Machine Learning · Computer Science 2024-05-28 Yuxuan Yan , Qianqian Yang , Shunpu Tang , Zhiguo Shi

Domain Generalization (DG) aims to reduce domain shifts between domains to achieve promising performance on the unseen target domain, which has been widely practiced in medical image segmentation. Single-source domain generalization (SDG)…

Computer Vision and Pattern Recognition · Computer Science 2024-01-05 Hanhui Wang , Huaize Ye , Yi Xia , Xueyan Zhang

Parameter-Efficient Fine-Tuning (PEFT) methods have transformed the approach to fine-tuning large models for downstream tasks by enabling the adjustment of significantly fewer parameters than those in the original model matrices. In this…

Computer Vision and Pattern Recognition · Computer Science 2025-03-12 Alessio Quercia , Zhuo Cao , Arya Bangun , Richard D. Paul , Abigail Morrison , Ira Assent , Hanno Scharr

Domain adaptation (DA) paves the way for label annotation and dataset bias issues by the knowledge transfer from a label-rich source domain to a related but unlabeled target domain. A mainstream of DA methods is to align the feature…

Computer Vision and Pattern Recognition · Computer Science 2021-08-13 Shuang Li , Mixue Xie , Fangrui Lv , Chi Harold Liu , Jian Liang , Chen Qin , Wei Li

Multi-task dense prediction, which aims to jointly solve tasks like semantic segmentation and depth estimation, is crucial for robotics applications but suffers from domain shift when deploying models in new environments. While unsupervised…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Beomseok Kang , Niluthpol Chowdhury Mithun , Mikhail Sizintsev , Han-Pang Chiu , Supun Samarasekera

Semi-supervised domain adaptation (SSDA) adapts a learner to a new domain by effectively utilizing source domain data and a few labeled target samples. It is a practical yet under-investigated research topic. In this paper, we analyze the…

Computer Vision and Pattern Recognition · Computer Science 2023-03-31 Wenqiao Zhang , Changshuo Liu , Can Cui , Beng Chin Ooi

Domain adaption (DA) and domain generalization (DG) are two closely related methods which are both concerned with the task of assigning labels to an unlabeled data set. The only dissimilarity between these approaches is that DA can access…

Computer Vision and Pattern Recognition · Computer Science 2018-12-27 Mohammad Mahfujur Rahman , Clinton Fookes , Mahsa Baktashmotlagh , Sridha Sridharan

Domain adaptive object detection (DAOD) aims to generalize an object detector trained on labeled source-domain data to a target domain without annotations, the core principle of which is \emph{source-target feature alignment}. Typically,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-18 Xinyu He , Xinhui Li , Xiaojie Guo

Monocular depth estimation (MDE) has attracted intense study due to its low cost and critical functions for robotic tasks such as localization, mapping and obstacle detection. Supervised approaches have led to great success with the advance…

Computer Vision and Pattern Recognition · Computer Science 2022-08-02 Shao-Yuan Lo , Wei Wang , Jim Thomas , Jingjing Zheng , Vishal M. Patel , Cheng-Hao Kuo

Real-world applications of machine learning models often confront data distribution shifts, wherein discrepancies exist between the training and test data distributions. In the common multi-domain multi-class setup, as the number of classes…

Computer Vision and Pattern Recognition · Computer Science 2024-05-24 Haoxiang Wang , Haozhe Si , Huajie Shao , Han Zhao