English
Related papers

Related papers: DiffuseKronA: A Parameter Efficient Fine-tuning Me…

200 papers

In recent years, image editing has garnered growing attention. However, general image editing models often fail to produce satisfactory results when confronted with new styles. The challenge lies in how to effectively fine-tune general…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Cong Cao , Huanjing Yue , Yujie Xu , Xiaodong Xu

The ability to fine-tune generative models for text-to-image generation tasks is crucial, particularly facing the complexity involved in accurately interpreting and visualizing textual inputs. While LoRA is efficient for language model…

Computer Vision and Pattern Recognition · Computer Science 2024-05-13 Mohan Zhou , Yalong Bai , Qing Yang , Tiejun Zhao

Low-Rank Adaptation (LoRA) and other parameter-efficient fine-tuning (PEFT) methods provide low-memory, storage-efficient solutions for personalizing text-to-image models. However, these methods offer little to no improvement in wall-clock…

Machine Learning · Computer Science 2024-12-04 Ethan Smith , Rami Seid , Alberto Hojel , Paramita Mishra , Jianbo Wu

Aligning large language models with human preferences has emerged as a critical focus in language modeling research. Yet, integrating preference learning into Text-to-Image (T2I) generative models is still relatively uncharted territory.…

Computer Vision and Pattern Recognition · Computer Science 2024-06-11 Yi Gu , Zhendong Wang , Yueqin Yin , Yujia Xie , Mingyuan Zhou

Fine-tuning Diffusion Models remains an underexplored frontier in generative artificial intelligence (GenAI), especially when compared with the remarkable progress made in fine-tuning Large Language Models (LLMs). While cutting-edge…

Machine Learning · Computer Science 2024-02-16 Huizhuo Yuan , Zixiang Chen , Kaixuan Ji , Quanquan Gu

Personalized text-to-image (T2I) synthesis based on diffusion models has attracted significant attention in recent research. However, existing methods primarily concentrate on customizing subjects or styles, neglecting the exploration of…

Computer Vision and Pattern Recognition · Computer Science 2023-11-09 Hai Wang , Xiaoyu Xiang , Yuchen Fan , Jing-Hao Xue

Generative modeling is widely regarded as one of the most essential problems in today's AI community, with text-to-image generation having gained unprecedented real-world impacts. Among various approaches, diffusion models have achieved…

Computer Vision and Pattern Recognition · Computer Science 2026-01-26 Xuyang Guo , Jiayan Huo , Yingyu Liang , Zhenmei Shi , Zhao Song , Jiahao Zhang , Zhen Zhuang

Due to the demand for efficient fine-tuning of large language models, Low-Rank Adaptation (LoRA) has been widely adopted as one of the most effective parameter-efficient fine-tuning methods. Nevertheless, while LoRA improves efficiency,…

Computation and Language · Computer Science 2025-06-13 Naibin Gu , Zhenyu Zhang , Xiyu Liu , Peng Fu , Zheng Lin , Shuohuan Wang , Yu Sun , Hua Wu , Weiping Wang , Haifeng Wang

Recent advances in diffusion models have significantly improved the synthesis of materials, textures, and 3D shapes. By conditioning these models via text or images, users can guide the generation, reducing the time required to create…

Computer Vision and Pattern Recognition · Computer Science 2026-01-28 Marzia Riso , Giuseppe Vecchio , Fabio Pellacini

LoRA-based large model parameter-efficient fine-tuning (PEFT) methods use low-rank de- composition to approximate updates to model parameters. However, compared to full- parameter fine-tuning, low-rank updates often lead to a performance…

Computation and Language · Computer Science 2025-08-26 Haojie Zhang

Text-to-image generative models have garnered immense attention for their ability to produce high-fidelity images from text prompts. Among these, Stable Diffusion distinguishes itself as a leading open-source model in this fast-growing…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Shih-Ying Yeh , Yu-Guan Hsieh , Zhidong Gao , Bernard B W Yang , Giyeong Oh , Yanmin Gong

Fine-tuning large-scale pre-trained models is inherently a resource-intensive task. While it can enhance the capabilities of the model, it also incurs substantial computational costs, posing challenges to the practical application of…

Computation and Language · Computer Science 2024-06-27 Yulong Mao , Kaiyu Huang , Changhao Guan , Ganglin Bao , Fengran Mo , Jinan Xu

Recent advancement in text-to-image models (e.g., Stable Diffusion) and corresponding personalized technologies (e.g., DreamBooth and LoRA) enables individuals to generate high-quality and imaginative images. However, they often suffer from…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Jiaxiang Cheng , Pan Xie , Xin Xia , Jiashi Li , Jie Wu , Yuxi Ren , Huixia Li , Xuefeng Xiao , Min Zheng , Lean Fu

Diffusion Transformer (DiT) has demonstrated remarkable performance in text-to-image generation; however, its large parameter size results in substantial inference overhead. Existing parameter compression methods primarily focus on pruning,…

Computer Vision and Pattern Recognition · Computer Science 2025-10-13 Youwei Zheng , Yuxi Ren , Xin Xia , Xuefeng Xiao , Xiaohua Xie

Fine-tuning a Pre-trained Language Model (PLM) on a specific downstream task has been a well-known paradigm in Natural Language Processing. However, with the ever-growing size of PLMs, training the entire model on several downstream tasks…

Computation and Language · Computer Science 2022-12-22 Ali Edalati , Marzieh Tahaei , Ivan Kobyzev , Vahid Partovi Nia , James J. Clark , Mehdi Rezagholizadeh

Diffusion-based image synthesis has emerged as a promising source of synthetic training data for AI-based object detection and classification. In this work, we investigate whether images generated with diffusion can improve military vehicle…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Ella P. Fokkinga , Jan Erik van Woerden , Thijs A. Eker , Sebastiaan P. Snel , Elfi I. S. Hofmeijer , Klamer Schutte , Friso G. Heslinga

Video Diffusion Models (VDMs) have demonstrated remarkable capabilities in synthesizing realistic videos by learning from large-scale data. Although vanilla Low-Rank Adaptation (LoRA) can learn specific spatial or temporal movement to…

Computer Vision and Pattern Recognition · Computer Science 2025-07-09 Yisu Zhang , Chenjie Cao , Chaohui Yu , Jianke Zhu

This paper explores advancements in high-fidelity personalized image generation through the utilization of pre-trained text-to-image diffusion models. While previous approaches have made significant strides in generating versatile scenes…

Computer Vision and Pattern Recognition · Computer Science 2023-12-04 Zhonghao Wang , Wei Wei , Yang Zhao , Zhisheng Xiao , Mark Hasegawa-Johnson , Humphrey Shi , Tingbo Hou

Generative diffusion models offer a natural choice for data augmentation when training complex vision models. However, ensuring reliability of their generative content as augmentation samples remains an open challenge. Despite a number of…

Computer Vision and Pattern Recognition · Computer Science 2025-03-17 Khawar Islam , Naveed Akhtar

Despite the rapid adoption of text-to-image (T2I) diffusion models, causal and representation-level analysis remains fragmented and largely limited to isolated probing techniques. To address this gap, we introduce DreamReader: a unified…