English
Related papers

Related papers: Multi-label classification for multi-temporal, mul…

200 papers

Deploying Vision-Language-Action (VLA) models in real-world robotics exposes a core multi-task learning challenge: reconciling task interference in multi-task robotic learning. When multiple tasks are jointly fine-tuned in a single stage,…

Robotics · Computer Science 2026-03-11 Yuankai Luo , Woping Chen , Tong Liang , Zhenguo Li

We present a multi-head vision transformer approach for multi-label plant species prediction in vegetation plot images, addressing the PlantCLEF 2025 challenge. The task involves training models on single-species plant images while testing…

Computer Vision and Pattern Recognition · Computer Science 2025-08-15 Hanna Herasimchyk , Robin Labryga , Tomislav Prusina

The rapid proliferation of Deep Neural Networks (DNNs) is driving a surge in model watermarking technologies, as the trained models themselves constitute valuable intellectual property. Existing watermarking approaches primarily focus on…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Dongdong Lin , Yue Li , Benedetta Tondi , Kaiqing Lin , Bin Li , Mauro Barni

Visual analogy learning enables image manipulation through demonstration rather than textual description, allowing users to specify complex transformations difficult to articulate in words. Given a triplet $\{\mathbf{a}$, $\mathbf{a}'$,…

Computer Vision and Pattern Recognition · Computer Science 2026-02-18 Hila Manor , Rinon Gal , Haggai Maron , Tomer Michaeli , Gal Chechik

Accurate tissue motion tracking is critical to ensure treatment outcome and safety in 2D-Cine MRI-guided radiotherapy. This is typically achieved by registration of sequential images, but existing methods often face challenges with large…

Image and Video Processing · Electrical Eng. & Systems 2025-08-15 Soorena Salari , Catherine Spino , Laurie-Anne Pharand , Fabienne Lathuiliere , Hassan Rivaz , Silvain Beriault , Yiming Xiao

Low-rank adaptation (LoRA) has emerged as the de facto standard for parameter-efficient fine-tuning (PEFT) of foundation models, enabling the adaptation of billion-parameter networks with minimal computational and memory overhead. Despite…

Machine Learning · Computer Science 2026-04-24 Bingcong Li , Yilang Zhang , Georgios B. Giannakis

The rapid growth of large models has raised concerns about their environmental impact and equity in accessibility due to significant computational costs. Low-Rank Adapters (LoRA) offer a lightweight solution for finetuning large models,…

Machine Learning · Computer Science 2026-02-06 Prakhar Kaushik , Ankit Vaidya , Shravan Chaudhari , Alan Yuille

Low-Rank Adaptation (LoRA) has recently gained attention for fine-tuning foundation models by incorporating trainable low-rank matrices, thereby reducing the number of trainable parameters. While LoRA offers numerous advantages, its…

Machine Learning · Computer Science 2024-04-29 Yeming Wen , Swarat Chaudhuri

Source-Free Domain Adaptation (SFDA) seeks to adapt a source model, which is pre-trained on a supervised source domain, for a target domain, with only access to unlabeled target training data. Relying on pseudo labeling and/or auxiliary…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Song Tang , Yunxiang Bai , Wenxin Su , Mao Ye , Jianwei Zhang , Xiatian Zhu

This paper investigates how to better leverage large-scale pre-trained uni-modal models to further enhance discriminative multi-modal learning. Even when fine-tuned with only uni-modal data, these models can outperform previous multi-modal…

Computer Vision and Pattern Recognition · Computer Science 2023-10-10 Chenzhuang Du , Yue Zhao , Chonghua Liao , Jiacheng You , Jie Fu , Hang Zhao

Personalized text-to-image generation aims to synthesize novel images of a specific subject or style using only a few reference images. Recent methods based on Low-Rank Adaptation (LoRA) enable efficient single-concept customization by…

Computer Vision and Pattern Recognition · Computer Science 2025-08-13 Yuqi Peng , Lingtao Zheng , Yufeng Yang , Yi Huang , Mingfu Yan , Jianzhuang Liu , Shifeng Chen

Foundation models are beginning to impact stellar spectroscopy, where spectra encode rich physical information in a structured, language-like form. A key challenge is adapting these models across heterogeneous surveys with differing…

Instrumentation and Methods for Astrophysics · Physics 2025-07-29 Xiaosheng Zhao , Yuan-Sen Ting , Alexander S. Szalay , Yang Huang

Low-Rank Adaptation (LoRA) has emerged as a widely adopted technique in text-to-image models, enabling precise rendering of multiple distinct elements, such as characters and styles, in multi-concept image generation. However, current…

Computer Vision and Pattern Recognition · Computer Science 2025-02-10 Xiandong Zou , Mingzhu Shen , Christos-Savvas Bouganis , Yiren Zhao

Large language models (LLMs) have not yet effectively leveraged the vast amounts of edge-device data, and federated learning (FL) offers a promising paradigm to collaboratively fine-tune LLMs without transferring private edge data to the…

Machine Learning · Computer Science 2026-02-02 Arian Raje , Baris Askin , Divyansh Jhunjhunwala , Gauri Joshi

Low-rank adaptation (LoRA) and its variants are widely employed in fine-tuning large models, including large language models for natural language processing and diffusion models for computer vision. This paper proposes a generalized…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Xiangyu Chen , Jing Liu , Ye Wang , Pu Perry Wang , Matthew Brand , Guanghui Wang , Toshiaki Koike-Akino

Foundation models pre-trained on large-scale datasets demonstrate strong transfer learning capabilities; however, their adaptation to complex multi-label diagnostic tasks-such as comprehensive head CT finding detection-remains understudied.…

Low-rank adaptation (LoRA) has been developed as an efficient approach for adapting large language models (LLMs) by fine-tuning two low-rank matrices, thereby reducing the number of trainable parameters. However, prior research indicates…

Computation and Language · Computer Science 2026-04-13 Lin Mu , Xiaoyu Wang , Li Ni , Yang Li , Zhize Wu , Peiquan Jin , Yiwen Zhang

Adaptability has been regarded as a central feature in the foundation models, enabling them to effectively acclimate to unseen downstream tasks. Parameter-efficient fine-tuning methods such as celebrated LoRA facilitate efficient adaptation…

Machine Learning · Computer Science 2026-02-10 Gagik Magakyan , Amirhossein Reisizadeh , Chanwoo Park , Pablo A. Parrilo , Asuman Ozdaglar

As a parameter efficient fine-tuning (PEFT) method, low-rank adaptation (LoRA) can save significant costs in storage and computing, but its strong adaptability to a single task is often accompanied by insufficient cross-task generalization…

Machine Learning · Computer Science 2025-09-24 Shaoheng Wang , Yao Lu , Yuqi Li , Yaxin Gao , Jiaqi Nie , Shanqing Yu , Yingli Tian , Qi Xuan

Integrating deep learning into medical imaging is poised to greatly advance diagnostic methods but it faces challenges with generalizability. Foundation models, based on self-supervised learning, address these issues and improve data…