English
Related papers

Related papers: Separating Shared and Domain-Specific LoRAs for Mu…

200 papers

Class-Incremental Learning (CIL) aims to learn new classes sequentially while retaining the knowledge of previously learned classes. Recently, pre-trained models (PTMs) combined with parameter-efficient fine-tuning (PEFT) have shown…

Computer Vision and Pattern Recognition · Computer Science 2025-06-02 Jiangpeng He , Zhihao Duan , Fengqing Zhu

Practical real world datasets with plentiful categories introduce new challenges for unsupervised domain adaptation like small inter-class discriminability, that existing approaches relying on domain invariance alone cannot handle…

Computer Vision and Pattern Recognition · Computer Science 2023-10-13 Tarun Kalluri , Astuti Sharma , Manmohan Chandraker

In this paper, we propose to develop a method to address unsupervised domain adaptation (UDA) in a practical setting of continual learning (CL). The goal is to update the model on continually changing domains while preserving…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Prasanna B , Sunandini Sanyal , R. Venkatesh Babu

We introduce a new representation learning approach for domain adaptation, in which data at training and test time come from similar but different distributions. Our approach is directly inspired by the theory on domain adaptation…

Multi-label multi-view action recognition aims to recognize multiple concurrent or sequential actions from untrimmed videos captured by multiple cameras. Existing work has focused on multi-view action recognition in a narrow area with…

Computer Vision and Pattern Recognition · Computer Science 2024-10-21 Trung Thanh Nguyen , Yasutomo Kawanishi , Takahiro Komamizu , Ichiro Ide

Deep learning approaches for semantic segmentation rely primarily on supervised learning approaches and require substantial efforts in producing pixel-level annotations. Further, such approaches may perform poorly when applied to unseen…

Computer Vision and Pattern Recognition · Computer Science 2021-10-22 Ying Chen , Xu Ouyang , Kaiyue Zhu , Gady Agam

Deep learning (DL) has been the primary approach used in various computer vision tasks due to its relevant results achieved on many tasks. However, on real-world scenarios with partially or no labeled data, DL methods are also prone to the…

Computer Vision and Pattern Recognition · Computer Science 2022-08-25 Lucas Fernando Alvarenga e Silva , Daniel Carlos Guimarães Pedronette , Fábio Augusto Faria , João Paulo Papa , Jurandy Almeida

Domain adaptation problems arise in a variety of applications, where a training dataset from the \textit{source} domain and a test dataset from the \textit{target} domain typically follow different distributions. The primary difficulty in…

Machine Learning · Computer Science 2017-08-11 Wenhao Jiang , Cheng Deng , Wei Liu , Feiping Nie , Fu-lai Chung , Heng Huang

Transferring the ImageNet pre-trained weights to the various remote sensing tasks has produced acceptable results and reduced the need for labeled samples. However, the domain differences between ground imageries and remote sensing images…

Computer Vision and Pattern Recognition · Computer Science 2023-02-06 Ali Ghanbarzade , Hossein Soleimani

Semantic segmentation models only perform well on the domain they are trained on and datasets for training are scarce and often have a small label-spaces, because the pixel level annotations required are expensive to make. Thus training…

Computer Vision and Pattern Recognition · Computer Science 2021-07-12 Floris Naber

Few-shot domain adaptation to multiple domains aims to learn a complex image distribution across multiple domains from a few training images. A na\"ive solution here is to train a separate model for each domain using few-shot domain…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Seongtae Kim , Kyoungkook Kang , Geonung Kim , Seung-Hwan Baek , Sunghyun Cho

Unsupervised Domain Adaptation (UDA) refers to the problem of learning a model in a target domain where labeled data are not available by leveraging information from annotated data in a source domain. Most deep UDA approaches operate in a…

Computer Vision and Pattern Recognition · Computer Science 2021-03-26 Massimiliano Mancini , Lorenzo Porzi , Samuel Rota Bulò , Barbara Caputo , Elisa Ricci

In real-world applications, speaker recognition models often face various domain-mismatch challenges, leading to a significant drop in performance. Although numerous domain adaptation techniques have been developed to address this issue,…

Sound · Computer Science 2023-09-26 Wan Lin , Lantian Li , Dong Wang

Most real world language problems require learning from heterogenous corpora, raising the problem of learning robust models which generalise well to both similar (in domain) and dissimilar (out of domain) instances to those seen in…

Computation and Language · Computer Science 2018-05-17 Yitong Li , Timothy Baldwin , Trevor Cohn

Incorporating various modes of information into the machine learning procedure is becoming a new trend. And data from various source can provide more information than single one no matter they are heterogeneous or homogeneous. Existing deep…

Computer Vision and Pattern Recognition · Computer Science 2018-11-28 Xiao Wang , Tao Sun , Rui Yang , Chenglong Li , Bin Luo , Jin Tang

Recent advances in molecular representation integrates molecular topological and visual modalities, opening new avenues for precise Molecular Relational Learning (MRL). Existing MRL methods focus on intra-domain modeling, and their inherent…

Machine Learning · Computer Science 2026-05-25 Peiliang Zhang , Jingling Yuan , Shiqing Wu , Mengqing Hu , Chao Che , Yongjun Zhu , Lin Li

With the increase in the business scale and number of domains in online advertising, multi-domain ad recommendation has become a mainstream solution in the industry. The core of multi-domain recommendation is effectively modeling the…

Information Retrieval · Computer Science 2025-05-19 Yuang Zhao , Zhaocheng Du , Qinglin Jia , Linxuan Zhang , Zhenhua Dong , Ruiming Tang

Fine-tuning large language models (LLMs) with low-rank adaptation (LoRA) is a cost-effective way to incorporate information from a specific dataset. However, when a problem requires incorporating information from multiple datasets - as in…

Machine Learning · Computer Science 2026-04-03 Liyi Zhang , Jake Snell , Thomas L. Griffiths

This paper investigates the application of Low-Rank Adaptation (LoRA) to small models for cross-domain few-shot object detection in aerial images. Originally designed for large-scale models, LoRA helps mitigate overfitting, making it a…

Computer Vision and Pattern Recognition · Computer Science 2025-04-10 Hicham Talaoubrid , Anissa Mokraoui , Ismail Ben Ayed , Axel Prouvost , Sonimith Hang , Monit Korn , Rémi Harvey

Low-rank adaptation (LoRA) is a widely used method for parameter-efficient finetuning. However, existing LoRA variants lack mechanisms to explicitly disambiguate task-relevant information within the learned low-rank subspace, potentially…

Machine Learning · Computer Science 2025-10-23 Shashi Kumar , Yacouba Kaloga , John Mitros , Petr Motlicek , Ina Kodrasi