English
Related papers

Related papers: Training-free Stylized Text-to-Image Generation wi…

200 papers

The personalized text-to-image generation has rapidly advanced with the emergence of Stable Diffusion. Existing methods, which typically fine-tune models using embedded identifiers, often struggle with insufficient stylization and…

Computer Vision and Pattern Recognition · Computer Science 2025-04-23 Anran Yu , Wei Feng , Yaochen Zhang , Xiang Li , Lei Meng , Lei Wu , Xiangxu Meng

Adapting pretrained diffusion-based generative models for text-driven image editing with negligible tuning overhead has demonstrated remarkable potential. A classical adaptation paradigm, as followed by these methods, first infers the…

Computer Vision and Pattern Recognition · Computer Science 2025-11-10 Jiahuan Wang , Yuxin Chen , Jun Yu , Guangming Lu , Wenjie Pei

Diffusion-based models have demonstrated impressive capabilities for text-to-image generation and are expected for personalized applications of subject-driven generation, which require the generation of customized concepts with one or a few…

Computer Vision and Pattern Recognition · Computer Science 2023-12-22 Miao Hua , Jiawei Liu , Fei Ding , Wei Liu , Jie Wu , Qian He

Diffusion models, such as Stable Diffusion, have shown incredible performance on text-to-image generation. Since text-to-image generation often requires models to generate visual concepts with fine-grained details and attributes specified…

Computer Vision and Pattern Recognition · Computer Science 2024-04-26 Xuehai He , Weixi Feng , Tsu-Jui Fu , Varun Jampani , Arjun Akula , Pradyumna Narayana , Sugato Basu , William Yang Wang , Xin Eric Wang

A significant research effort is focused on exploiting the amazing capacities of pretrained diffusion models for the editing of images.They either finetune the model, or invert the image in the latent space of the pretrained model. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-09 Senmao Li , Joost van de Weijer , Taihang Hu , Fahad Shahbaz Khan , Qibin Hou , Yaxing Wang , Jian Yang , Ming-Ming Cheng

Personalized text-to-image generation aims to create images tailored to user-defined concepts and textual descriptions. Balancing the fidelity of the learned concept with its ability for generation in various contexts presents a significant…

Computer Vision and Pattern Recognition · Computer Science 2025-02-11 Vera Soboleva , Maksim Nakhodnov , Aibek Alanov

Diffusion probabilistic models have shown great success in generating high-quality images controllably, and researchers have tried to utilize this controllability into text generation domain. Previous works on diffusion-based language…

Computation and Language · Computer Science 2023-06-13 Yiwei Lyu , Tiange Luo , Jiacheng Shi , Todd C. Hollon , Honglak Lee

In the evolving domain of text-to-image generation, diffusion models have emerged as powerful tools in content creation. Despite their remarkable capability, existing models still face challenges in achieving controlled generation with a…

Computer Vision and Pattern Recognition · Computer Science 2024-02-22 Jaeseok Jeong , Junho Kim , Yunjey Choi , Gayoung Lee , Youngjung Uh

The demand for stereo images increases as manufacturers launch more XR devices. To meet this demand, we introduce StereoDiffusion, a method that, unlike traditional inpainting pipelines, is trainning free, remarkably straightforward to use,…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Lezhong Wang , Jeppe Revall Frisvad , Mark Bo Jensen , Siavash Arjomand Bigdeli

With the rise of large, publicly-available text-to-image diffusion models, text-guided real image editing has garnered much research attention recently. Existing methods tend to either rely on some form of per-instance or per-task…

Computer Vision and Pattern Recognition · Computer Science 2022-11-16 Adham Elarabawy , Harish Kamath , Samuel Denton

Diffusion models have demonstrated high-quality performance in conditional text-to-image generation, particularly with structural cues such as edges, layouts, and depth. However, lighting conditions have received limited attention and…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Ryugo Morita , Stanislav Frolov , Brian Bernhard Moser , Ko Watanabe , Riku Takahashi , Andreas Dengel

Image inpainting aims to fill in the missing pixels with visually coherent and semantically plausible content. Despite the great progress brought from deep generative models, this task still suffers from i. the difficulties in large-scale…

Computer Vision and Pattern Recognition · Computer Science 2023-10-05 Siyuan Yang , Lu Zhang , Liqian Ma , Yu Liu , JingJing Fu , You He

Stylized text-to-image generation focuses on creating images from textual descriptions while adhering to a style specified by a few reference images. However, subtle style variations within different reference images can hinder the model…

Computer Vision and Pattern Recognition · Computer Science 2024-07-15 Xing Cui , Zekun Li , Pei Pei Li , Huaibo Huang , Xuannan Liu , Zhaofeng He

Fashionable image generation aims to synthesize images of diverse fashion prevalent around the globe, helping fashion designers in real-time visualization by giving them a basic customized structure of how a specific design preference would…

Computer Vision and Pattern Recognition · Computer Science 2023-06-14 Krishna Sri Ipsit Mantri , Nevasini Sasikumar

Fine-tuning Diffusion Models remains an underexplored frontier in generative artificial intelligence (GenAI), especially when compared with the remarkable progress made in fine-tuning Large Language Models (LLMs). While cutting-edge…

Machine Learning · Computer Science 2024-02-16 Huizhuo Yuan , Zixiang Chen , Kaixuan Ji , Quanquan Gu

Generative models have been very popular in the recent years for their image generation capabilities. GAN-based models are highly regarded for their disentangled latent space, which is a key feature contributing to their success in…

Computer Vision and Pattern Recognition · Computer Science 2023-12-12 Yusuf Dalva , Pinar Yanardag

In image processing, one of the most challenging tasks is to render an image's semantic meaning using a variety of artistic approaches. Existing techniques for arbitrary style transfer (AST) frequently experience mode-collapse,…

Computer Vision and Pattern Recognition · Computer Science 2024-08-08 Onkar Susladkar , Gayatri Deshmukh , Sparsh Mittal , Parth Shastri

The artistic style within a painting is the means of expression, which includes not only the painting material, colors, and brushstrokes, but also the high-level attributes including semantic elements, object shapes, etc. Previous arbitrary…

Computer Vision and Pattern Recognition · Computer Science 2023-03-21 Yuxin Zhang , Nisha Huang , Fan Tang , Haibin Huang , Chongyang Ma , Weiming Dong , Changsheng Xu

Diffusion models have shown remarkable performance in image synthesis, but they demand extensive computational and memory resources for training, fine-tuning and inference. Although advanced quantization techniques have successfully…

Computer Vision and Pattern Recognition · Computer Science 2025-03-20 Hoigi Seo , Wongi Jeong , Kyungryeol Lee , Se Young Chun

Personalizing text-to-image diffusion models involves integrating novel visual concepts from a small set of reference images while retaining the model's original generative capabilities. However, this process often leads to overfitting,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Gihoon Kim , Hyungjin Park , Taesup Kim