English
Related papers

Related papers: Separating Shared and Domain-Specific LoRAs for Mu…

200 papers

In this paper, we propose a novel learning framework for the problem of domain transfer learning. We map the data of two domains to one single common space, and learn a classifier in this common space. Then we adapt the common classifier to…

Machine Learning · Computer Science 2016-08-17 Ru-Ze Liang , Wei Xie , Weizhi Li , Hongqi Wang , Jim Jing-Yan Wang , Lisa Taylor

Transfer learning aims to learn robust classifiers for the target domain by leveraging knowledge from a source domain. Since the source and the target domains are usually from different distributions, existing methods mainly focus on…

Machine Learning · Computer Science 2019-09-19 Jindong Wang , Yiqiang Chen , Wenjie Feng , Han Yu , Meiyu Huang , Qiang Yang

We propose a new learning method for heterogeneous domain adaptation (HDA), in which the data from the source domain and the target domain are represented by heterogeneous features with different dimensions. Using two different projection…

Machine Learning · Computer Science 2012-06-22 Lixin Duan , Dong Xu , Ivor Tsang

Domain adaptation is an important task to enable learning when labels are scarce. While most works focus only on the image modality, there are many important multi-modal datasets. In order to leverage multi-modality for domain adaptation,…

Computer Vision and Pattern Recognition · Computer Science 2022-06-23 Maximilian Jaritz , Tuan-Hung Vu , Raoul de Charette , Émilie Wirbel , Patrick Pérez

In this work, we investigate the potential of weights to serve as effective representations, focusing on neural fields. Our key insight is that constraining the optimization space through a pre-trained base model and low-rank adaptation…

Machine Learning · Computer Science 2026-03-05 Zhuoqian Yang , Mathieu Salzmann , Sabine Süsstrunk

The main progress for action segmentation comes from densely-annotated data for fully-supervised learning. Since manual annotation for frame-level actions is time-consuming and challenging, we propose to exploit auxiliary unlabeled videos,…

Computer Vision and Pattern Recognition · Computer Science 2021-04-19 Min-Hung Chen , Baopu Li , Yingze Bao , Ghassan AlRegib

Personalizing visual generative models to meet specific user needs has gained increasing attention, yet current methods like Low-Rank Adaptation (LoRA) remain impractical due to their demand for task-specific data and lengthy optimization.…

Computer Vision and Pattern Recognition · Computer Science 2025-12-10 Yiming Hao , Mutian Xu , Chongjie Ye , Jie Qin , Shunlin Lu , Yipeng Qin , Xiaoguang Han

Low-rank Adaptation (LoRA) models have revolutionized the personalization of pre-trained diffusion models by enabling fine-tuning through low-rank, factorized weight matrices specifically optimized for attention layers. These models…

Computer Vision and Pattern Recognition · Computer Science 2025-12-18 Mert Sonmezer , Matthew Zheng , Pinar Yanardag

Domain adaptation for visual recognition has undergone great progress in the past few years. Nevertheless, most existing methods work in the so-called closed-set scenario, assuming that the classes depicted by the target images are exactly…

Computer Vision and Pattern Recognition · Computer Science 2018-06-01 Mahsa Baktashmotlagh , Masoud Faraki , Tom Drummond , Mathieu Salzmann

Domain adaptation (DA) aims to generalize a learning model across training and testing data despite the mismatch of their data distributions. In light of a theoretical estimation of upper error bound, we argue in this paper that an…

Computer Vision and Pattern Recognition · Computer Science 2018-01-01 Lingkun Luo , Liming Chen , Shiqiang Hu , Ying Lu , Xiaofang Wang

Domain adaptation is transfer learning which aims to generalize a learning model across training and testing data with different distributions. Most previous research tackle this problem in seeking a shared feature representation between…

Machine Learning · Computer Science 2017-04-17 Lingkun Luo , Xiaofang Wang , Shiqiang Hu , Chao Wang , Yuxing Tang , Liming Chen

In this paper, we show that Low Rank Adaptation (LoRA) as originally introduced in Hu et al. (2021) leads to suboptimal finetuning of models with large width (embedding dimension). This is due to the fact that adapter matrices A and B in…

Machine Learning · Computer Science 2024-07-08 Soufiane Hayou , Nikhil Ghosh , Bin Yu

Domain Adaptation aiming to learn a transferable feature between different but related domains has been well investigated and has shown excellent empirical performances. Previous works mainly focused on matching the marginal feature…

Machine Learning · Computer Science 2020-05-26 Fan Zhou , Changjian Shui , Bincheng Huang , Boyu Wang , Brahim Chaib-draa

Recent advances on unsupervised domain adaptation (UDA) rely on adversarial learning to disentangle the explanatory and transferable features for domain adaptation. However, there are two issues with the existing methods. First, the…

Machine Learning · Computer Science 2020-07-20 Yuan Wu , Diana Inkpen , Ahmed El-Roby

This paper introduces a learning scheme to construct a Hilbert space (i.e., a vector space along its inner product) to address both unsupervised and semi-supervised domain adaptation problems. This is achieved by learning projections from…

Computer Vision and Pattern Recognition · Computer Science 2017-04-18 Samitha Herath , Mehrtash Harandi , Fatih Porikli

In this work, we present a novel method to learn a local cross-domain descriptor for 2D image and 3D point cloud matching. Our proposed method is a dual auto-encoder neural network that maps 2D and 3D input into a shared latent space…

Computer Vision and Pattern Recognition · Computer Science 2019-11-22 Quang-Hieu Pham , Mikaela Angelina Uy , Binh-Son Hua , Duc Thanh Nguyen , Gemma Roig , Sai-Kit Yeung

In this paper, we aim at tackling a general but interesting cross-modality feature learning question in remote sensing community --- can a limited amount of highly-discrimin-ative (e.g., hyperspectral) training data improve the performance…

Computer Vision and Pattern Recognition · Computer Science 2019-12-19 Danfeng Hong , Naoto Yokoya , Nan Ge , Jocelyn Chanussot , Xiao Xiang Zhu

Transfer learning approaches in reinforcement learning aim to assist agents in learning their target domains by leveraging the knowledge learned from other agents that have been trained on similar source domains. For example, recent…

Machine Learning · Computer Science 2022-04-25 Nathan Beck , Abhiramon Rajasekharan , Hieu Tran

We focus on bridging domain discrepancy in lane detection among different scenarios to greatly reduce extra annotation and re-training costs for autonomous driving. Critical factors hinder the performance improvement of cross-domain lane…

Computer Vision and Pattern Recognition · Computer Science 2022-11-10 Chenguang Li , Boheng Zhang , Jia Shi , Guangliang Cheng

Low-Rank Adaptation (LoRA) has become a widely adopted technique in text-to-image diffusion models, enabling the personalisation of visual concepts such as characters, styles, and objects. However, existing approaches struggle to…

Computer Vision and Pattern Recognition · Computer Science 2025-08-18 Niki Foteinopoulou , Ignas Budvytis , Stephan Liwicki