English
Related papers

Related papers: Mix-of-Show: Decentralized Low-Rank Adaptation for…

200 papers

Customization generation techniques have significantly advanced the synthesis of specific concepts across varied contexts. Multi-concept customization emerges as the challenging task within this domain. Existing approaches often rely on…

Computer Vision and Pattern Recognition · Computer Science 2024-07-12 Yang Yang , Wen Wang , Liang Peng , Chaotian Song , Yao Chen , Hengjia Li , Xiaolong Yang , Qinglin Lu , Deng Cai , Boxi Wu , Wei Liu

Recent diffusion model customization has shown impressive results in incorporating subject or style concepts with a handful of images. However, the modular composition of multiple concepts into a customized model, aimed to efficiently merge…

Computer Vision and Pattern Recognition · Computer Science 2025-03-12 Mingkang Zhu , Xi Chen , Zhongdao Wang , Bei Yu , Hengshuang Zhao , Jiaya Jia

Personalized image generation requires effectively balancing content fidelity with stylistic consistency when synthesizing images based on text and reference examples. Low-Rank Adaptation (LoRA) offers an efficient personalization approach,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-04 Yu Li , Yujun Cai , Chi Zhang

While diffusion model fine-tuning offers a powerful approach for customizing pre-trained models to generate specific objects, it frequently suffers from overfitting when training samples are limited, compromising both generalization…

Computer Vision and Pattern Recognition · Computer Science 2026-01-26 Vera Soboleva , Aibek Alanov , Andrey Kuznetsov , Konstantin Sobolev

Personalized text-to-image generation aims to synthesize novel images of a specific subject or style using only a few reference images. Recent methods based on Low-Rank Adaptation (LoRA) enable efficient single-concept customization by…

Computer Vision and Pattern Recognition · Computer Science 2025-08-13 Yuqi Peng , Lingtao Zheng , Yufeng Yang , Yi Huang , Mingfu Yan , Jianzhuang Liu , Shifeng Chen

In this paper, we introduce a subspace-inspired Low-Rank Adaptation (LoRA) method, which is computationally efficient, easy to implement, and readily applicable to large language, multimodal, and diffusion models. Initially, we equivalently…

Machine Learning · Computer Science 2025-03-04 Taiqiang Wu , Jiahao Wang , Zhe Zhao , Ngai Wong

Low-Rank Adaptation (LoRA) has emerged as one of the most effective, computationally tractable fine-tuning approaches for training Vision-Language Models (VLMs) and Large Language Models (LLMs). LoRA accomplishes this by freezing the…

Machine Learning · Computer Science 2025-05-28 Nastaran Saadati , Zhanhong Jiang , Joshua R. Waite , Shreyan Ganguly , Aditya Balu , Chinmay Hegde , Soumik Sarkar

Recent works demonstrate a remarkable ability to customize text-to-image diffusion models while only providing a few example images. What happens if you try to customize such models using multiple, fine-grained concepts in a sequential…

Computer Vision and Pattern Recognition · Computer Science 2024-05-03 James Seale Smith , Yen-Chang Hsu , Lingyu Zhang , Ting Hua , Zsolt Kira , Yilin Shen , Hongxia Jin

Decentralized federated learning (DFL), a serverless variant of federated learning, poses unique challenges for parameter-efficient fine-tuning due to the factorized structure of low-rank adaptation (LoRA). Unlike linear parameters,…

Machine Learning · Computer Science 2026-02-03 Xiaoyu Wang , Xiaotian Li , Zhixiang Zhou , Chen Li , Yong Liu

In recent years, multi-concept personalization for text-to-image (T2I) diffusion models to represent several subjects in an image has gained much more attention. The main challenge of this task is "concept mixing", where multiple learned…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Habin Lim , Yeongseob Won , Juwon Seo , Gyeong-Moon Park

The objective of personalization and stylization in text-to-image is to instruct a pre-trained diffusion model to analyze new concepts introduced by users and incorporate them into expected styles. Recently, parameter-efficient fine-tuning…

Computer Vision and Pattern Recognition · Computer Science 2024-03-13 Likun Li , Haoqi Zeng , Changpeng Yang , Haozhe Jia , Di Xu

Low-Rank Adaptation (LoRA) has emerged as a widely adopted technique in text-to-image models, enabling precise rendering of multiple distinct elements, such as characters and styles, in multi-concept image generation. However, current…

Computer Vision and Pattern Recognition · Computer Science 2025-02-10 Xiandong Zou , Mingzhu Shen , Christos-Savvas Bouganis , Yiren Zhao

Low-Rank Adaptation (LoRA) is extensively utilized in text-to-image models for the accurate rendition of specific elements like distinct characters or unique styles in generated images. Nonetheless, existing methods face challenges in…

Computer Vision and Pattern Recognition · Computer Science 2024-11-20 Ming Zhong , Yelong Shen , Shuohang Wang , Yadong Lu , Yizhu Jiao , Siru Ouyang , Donghan Yu , Jiawei Han , Weizhu Chen

In order to streamline the fine-tuning of foundation models, Low-Rank Adapters (LoRAs) have been substantially adopted across various fields, including instruction tuning and domain adaptation. The underlying concept of LoRA involves…

Machine Learning · Computer Science 2025-02-25 Mengyang Sun , Yihao Wang , Tao Feng , Dan Zhang , Yifan Zhu , Jie Tang

Low-rank Adaptation (LoRA) models have revolutionized the personalization of pre-trained diffusion models by enabling fine-tuning through low-rank, factorized weight matrices specifically optimized for attention layers. These models…

Computer Vision and Pattern Recognition · Computer Science 2025-12-18 Mert Sonmezer , Matthew Zheng , Pinar Yanardag

In recent years, image editing has garnered growing attention. However, general image editing models often fail to produce satisfactory results when confronted with new styles. The challenge lies in how to effectively fine-tune general…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Cong Cao , Huanjing Yue , Yujie Xu , Xiaodong Xu

While parameter-efficient fine-tuning (PEFT) techniques like Low-Rank Adaptation (LoRA) offer computationally efficient adaptations of Large Language Models (LLMs), their practical deployment often assumes centralized data and training…

Machine Learning · Computer Science 2025-08-25 Sajjad Ghiasvand , Mahnoosh Alizadeh , Ramtin Pedarsani

Recent advances in text-to-image customization have enabled high-fidelity, context-rich generation of personalized images, allowing specific concepts to appear in a variety of scenarios. However, current methods struggle with combining…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Enis Simsar , Thomas Hofmann , Federico Tombari , Pinar Yanardag

Significant achievements in personalization of diffusion models have been witnessed. Conventional tuning-free methods mostly encode multiple reference images by averaging their image embeddings as the injection condition, but such an…

Computer Vision and Pattern Recognition · Computer Science 2024-12-13 Zhuofan Zong , Dongzhi Jiang , Bingqi Ma , Guanglu Song , Hao Shao , Dazhong Shen , Yu Liu , Hongsheng Li

Despite recent advances in photorealistic image generation through large-scale models like FLUX and Stable Diffusion v3, the practical deployment of these architectures remains constrained by their inherent intractability to parameter…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Zhiwen Li , Zhongjie Duan , Die Chen , Cen Chen , Daoyuan Chen , Yaliang Li , Yingda Chen
‹ Prev 1 2 3 10 Next ›