English
Related papers

Related papers: DiffLoRA: Generating Personalized Low-Rank Adaptat…

200 papers

Fine-tuning pre-trained diffusion models under limited budgets has gained great success. In particular, the recent advances that directly fine-tune the quantized weights using Low-rank Adaptation (LoRA) further reduces training costs.…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Hang Guo , Yawei Li , Tao Dai , Shu-Tao Xia , Luca Benini

The recent wave of large-scale text-to-image diffusion models has dramatically increased our text-based image generation abilities. These models can generate realistic images for a staggering variety of prompts and exhibit impressive…

Machine Learning · Computer Science 2023-09-14 Alexander C. Li , Mihir Prabhudesai , Shivam Duggal , Ellis Brown , Deepak Pathak

Creating human avatars is a highly desirable yet challenging task. Recent advancements in radiance field rendering have achieved unprecedented photorealism and real-time performance for personalized dynamic human avatars. However, these…

Graphics · Computer Science 2025-09-09 Dongliang Cao , Guoxing Sun , Marc Habermann , Florian Bernard

In the realm of subject-driven text-to-image (T2I) generative models, recent developments like DreamBooth and BLIP-Diffusion have led to impressive results yet encounter limitations due to their intensive fine-tuning demands and substantial…

Computer Vision and Pattern Recognition · Computer Science 2024-02-29 Shyam Marjit , Harshit Singh , Nityanand Mathur , Sayak Paul , Chia-Mu Yu , Pin-Yu Chen

Style transfer involves transferring the style from a reference image to the content of a target image. Recent advancements in LoRA-based (Low-Rank Adaptation) methods have shown promise in effectively capturing the style of a single image.…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Bolin Chen , Baoquan Zhao , Haoran Xie , Yi Cai , Qing Li , Xudong Mao

Diffusion-based text-to-image models have achieved remarkable results in synthesizing diverse images from text prompts and can capture specific artistic styles via style personalization. However, their entangled latent space and lack of…

Computer Vision and Pattern Recognition · Computer Science 2025-08-06 Jaehyun Lee , Wonhark Park , Wonsik Shin , Hyunho Lee , Hyoung Min Na , Nojun Kwak

As deep learning technology continues to advance, image generation models, especially models like Stable Diffusion, are finding increasingly widespread application in visual arts creation. However, these models often face challenges such as…

Computer Vision and Pattern Recognition · Computer Science 2024-06-14 Chengcheng Feng , Mu He , Qiuyu Tian , Haojie Yin , Xiaofang Zhao , Hongwei Tang , Xingqiang Wei

Personalizing visual generative models to meet specific user needs has gained increasing attention, yet current methods like Low-Rank Adaptation (LoRA) remain impractical due to their demand for task-specific data and lengthy optimization.…

Computer Vision and Pattern Recognition · Computer Science 2025-12-10 Yiming Hao , Mutian Xu , Chongjie Ye , Jie Qin , Shunlin Lu , Yipeng Qin , Xiaoguang Han

The persistent challenge of medical image synthesis posed by the scarcity of annotated data and the need to synthesize `missing modalities' for multi-modal analysis, underscored the imperative development of effective synthesis methods.…

Computer Vision and Pattern Recognition · Computer Science 2024-08-15 Yuchen Mao , Hongwei Li , Wei Pang , Giorgos Papanastasiou , Guang Yang , Chengjia Wang

With the growing availability of open-sourced adapters trained on the same diffusion backbone for diverse scenes and objects, combining these pretrained weights enables low-cost customized generation. However, most existing model merging…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Shenghe Zheng , Minyu Zhang , Tianhao Liu , Hongzhi Wang

Modern cameras' performance in low-light conditions remains suboptimal due to fundamental limitations in photon shot noise and sensor read noise. Generative image restoration methods have shown promising results compared to traditional…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Xijun Wang , Prateek Chennuri , Dilshan Godaliyadda , Yu Yuan , Bole Ma , Xingguang Zhang , Hamid R. Sheikh , Stanley Chan

Image Generation models are a trending topic nowadays, with many people utilizing Artificial Intelligence models in order to generate images. There are many such models which, given a prompt of a text, will generate an image which depicts…

Machine Learning · Computer Science 2025-05-20 Udaya Shreyas , L. N. Aadarsh

Diffusion-based image synthesis has emerged as a promising source of synthetic training data for AI-based object detection and classification. In this work, we investigate whether images generated with diffusion can improve military vehicle…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Ella P. Fokkinga , Jan Erik van Woerden , Thijs A. Eker , Sebastiaan P. Snel , Elfi I. S. Hofmeijer , Klamer Schutte , Friso G. Heslinga

The objective of personalization and stylization in text-to-image is to instruct a pre-trained diffusion model to analyze new concepts introduced by users and incorporate them into expected styles. Recently, parameter-efficient fine-tuning…

Computer Vision and Pattern Recognition · Computer Science 2024-03-13 Likun Li , Haoqi Zeng , Changpeng Yang , Haozhe Jia , Di Xu

Image restoration aims to enhance low quality images, producing high quality images that exhibit natural visual characteristics and fine semantic attributes. Recently, the diffusion model has emerged as a powerful technique for image…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Jiangtong Tan , Feng Zhao

Personalized text-to-image generation aims to synthesize novel images of a specific subject or style using only a few reference images. Recent methods based on Low-Rank Adaptation (LoRA) enable efficient single-concept customization by…

Computer Vision and Pattern Recognition · Computer Science 2025-08-13 Yuqi Peng , Lingtao Zheng , Yufeng Yang , Yi Huang , Mingfu Yan , Jianzhuang Liu , Shifeng Chen

Recent personalization methods for diffusion models, such as Dreambooth and LoRA, allow fine-tuning pre-trained models to generate new concepts. However, applying these techniques across consecutive tasks in order to include, e.g., new…

Machine Learning · Computer Science 2025-03-14 Łukasz Staniszewski , Katarzyna Zaleska , Kamil Deja

Developing robust deep learning models for fetal ultrasound image analysis requires comprehensive, high-quality datasets to effectively learn informative data representations within the domain. However, the scarcity of labelled ultrasound…

Image and Video Processing · Electrical Eng. & Systems 2024-07-30 Fangyijie Wang , Kevin Whelan , Guénolé Silvestre , Kathleen M. Curran

Personalized diffusion models have shown remarkable success in Text-to-Image (T2I) generation by enabling the injection of user-defined concepts into diverse contexts. However, balancing concept fidelity with contextual alignment remains a…

Computer Vision and Pattern Recognition · Computer Science 2025-05-28 Shamil Ayupov , Maksim Nakhodnov , Anastasia Yaschenko , Andrey Kuznetsov , Aibek Alanov

Text-driven person image generation is an emerging and challenging task in cross-modality image generation. Controllable person image generation promotes a wide range of applications such as digital human interaction and virtual try-on.…

Computer Vision and Pattern Recognition · Computer Science 2022-11-14 Kaiduo Zhang , Muyi Sun , Jianxin Sun , Binghao Zhao , Kunbo Zhang , Zhenan Sun , Tieniu Tan