English
Related papers

Related papers: When LoRA Betrays: Backdooring Text-to-Image Model…

200 papers

In fine-tuning large language models (LLMs), conserving computational resources while maintaining effectiveness and improving outcomes within the same computational constraints is crucial. The Low-Rank Adaptation (LoRA) strategy balances…

Machine Learning · Computer Science 2024-09-05 Xiaojun Xiao , Sen Shen , Qiming Bao , Hongfei Rong , Kairui Liu , Zhongsheng Wang , Jiamou Liu

Low-Rank Adaptation (LoRA) is an efficient fine-tuning method that has been extensively applied in areas such as natural language processing and computer vision. Existing LoRA fine-tuning approaches excel in static environments but struggle…

Machine Learning · Computer Science 2025-02-26 Xin Zhang , Liang Bai , Xian Yang , Jiye Liang

Low-Rank Adaptation (LoRA) has emerged as a popular parameter-efficient fine-tuning (PEFT) method for Large Language Models (LLMs), yet it still incurs notable overhead and suffers from parameter interference in multi-task scenarios. We…

Machine Learning · Computer Science 2025-08-05 Juzheng Zhang , Jiacheng You , Ashwinee Panda , Tom Goldstein

Low-Rank Adaptation (LoRA) has become a widely used mechanism for customizing diffusion models, enabling users to inject new visual concepts or styles through lightweight parameter updates. However, LoRAs can memorize training images,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Yu Zhe , Yang Jiayan , Wei Junhao , Yu-Lin Tsai , Wang Chen

Low-Rank Adaptation (LoRA) has emerged as a powerful and popular technique for personalization, enabling efficient adaptation of pre-trained image generation models for specific tasks without comprehensive retraining. While employing…

Computer Vision and Pattern Recognition · Computer Science 2025-07-31 Tuna Han Salih Meral , Enis Simsar , Federico Tombari , Pinar Yanardag

While Low-Rank Adaptation (LoRA) has proven beneficial for efficiently fine-tuning large models, LoRA fine-tuned text-to-image diffusion models lack diversity in the generated images, as the model tends to copy data from the observed…

Low-Rank Adaptation (LoRA) is a widely used parameter-efficient fine-tuning method for foundation models, but it suffers from parameter interference, resulting in suboptimal performance. Although Mixture-of-Experts (MoE)-based LoRA variants…

Machine Learning · Computer Science 2025-10-24 Heming Zou , Yunliang Zang , Wutong Xu , Yao Zhu , Xiangyang Ji

Low-Rank Adaptation (LoRA) offers an efficient paradigm for customizing diffusion models, but its ease of redistribution raises concerns over unauthorized use and the generation of untraceable content. Existing watermarking techniques…

Cryptography and Security · Computer Science 2025-11-27 Fangming Shi , Li Li , Kejiang Chen , Guorui Feng , Xinpeng Zhang

Low-Rank Adaptation (LoRA) is widely adopted for downstream fine-tuning of foundation models due to its efficiency and zero additional inference cost. Many real-world applications require foundation models to specialize in several specific…

Machine Learning · Computer Science 2025-09-30 Jian Liang , Wenke Huang , Xianda Guo , Guancheng Wan , Bo Du , Mang Ye

Language Models (LMs) typically adhere to a "pre-training and fine-tuning" paradigm, where a universal pre-trained model can be fine-tuned to cater to various specialized domains. Low-Rank Adaptation (LoRA) has gained the most widespread…

Cryptography and Security · Computer Science 2025-07-25 Delong Ran , Xinlei He , Tianshuo Cong , Anyu Wang , Qi Li , Xiaoyun Wang

Low-Rank Adaptation (LoRA) has become a widely adopted technique in text-to-image diffusion models, enabling the personalisation of visual concepts such as characters, styles, and objects. However, existing approaches struggle to…

Computer Vision and Pattern Recognition · Computer Science 2025-08-18 Niki Foteinopoulou , Ignas Budvytis , Stephan Liwicki

Low-Rank Adaptation (LoRA) is a crucial method for efficiently fine-tuning large language models (LLMs), with its effectiveness influenced by two key factors: rank selection and weight initialization. While numerous LoRA variants have been…

Machine Learning · Computer Science 2025-10-27 Haonan He , Peng Ye , Yuchen Ren , Yuan Yuan , Luyang Zhou , Shucun Ju , Lei Chen

Backdoored and privacy-leaking deep neural networks pose a serious threat to the deployment of machine learning systems in security-critical settings. Existing defenses for backdoor detection and membership inference typically require…

Cryptography and Security · Computer Science 2026-01-19 Marco Arazzi , Antonino Nocera

Low-Rank Adaptation (LoRA) has emerged as a widely adopted technique in text-to-image models, enabling precise rendering of multiple distinct elements, such as characters and styles, in multi-concept image generation. However, current…

Computer Vision and Pattern Recognition · Computer Science 2025-02-10 Xiandong Zou , Mingzhu Shen , Christos-Savvas Bouganis , Yiren Zhao

Recent works demonstrate a remarkable ability to customize text-to-image diffusion models while only providing a few example images. What happens if you try to customize such models using multiple, fine-grained concepts in a sequential…

Computer Vision and Pattern Recognition · Computer Science 2024-05-03 James Seale Smith , Yen-Chang Hsu , Lingyu Zhang , Ting Hua , Zsolt Kira , Yilin Shen , Hongxia Jin

Fine-tuning adapts a pre-trained model to downstream tasks using a small amount of labeled data. Low-Rank Adaptation (LoRA) is an efficient fine-tuning method that reduces memory and computation costs while often achieving performance close…

Machine Learning · Computer Science 2026-05-20 Ali Zindari , Rotem Mulayoff , Sebastian U. Stich

An important paradigm of natural language processing consists of large-scale pre-training on general domain data and adaptation to particular tasks or domains. As we pre-train larger models, full fine-tuning, which retrains all model…

Computation and Language · Computer Science 2021-10-19 Edward J. Hu , Yelong Shen , Phillip Wallis , Zeyuan Allen-Zhu , Yuanzhi Li , Shean Wang , Lu Wang , Weizhu Chen

In order to streamline the fine-tuning of foundation models, Low-Rank Adapters (LoRAs) have been substantially adopted across various fields, including instruction tuning and domain adaptation. The underlying concept of LoRA involves…

Machine Learning · Computer Science 2025-02-25 Mengyang Sun , Yihao Wang , Tao Feng , Dan Zhang , Yifan Zhu , Jie Tang

Low-rank adaptations (LoRAs) have revolutionized the finetuning of large foundation models, enabling efficient adaptation even with limited computational resources. The resulting proliferation of LoRAs presents exciting opportunities for…

Machine Learning · Computer Science 2024-10-16 Theo Putterman , Derek Lim , Yoav Gelberg , Stefanie Jegelka , Haggai Maron

Low-rank adaptation (LoRA) is a popular method for fine-tuning large-scale pre-trained models in downstream tasks by learning low-rank incremental matrices. Though LoRA and its variants effectively reduce the number of trainable parameters…

Machine Learning · Computer Science 2024-03-21 Rushi Qiang , Ruiyi Zhang , Pengtao Xie