English
Related papers

Related papers: ImPoster: Text and Frequency Guidance for Subject …

200 papers

Image compression technology eliminates redundant information to enable efficient transmission and storage of images, serving both machine vision and human visual perception. For years, image coding focused on human perception has been…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Takahiro Shindo , Yui Tatsumi , Taiju Watanabe , Hiroshi Watanabe

Recent advancements in Text-to-Image (T2I) diffusion models have demonstrated impressive success in generating high-quality images with zero-shot generalization capabilities. Yet, current models struggle to closely adhere to prompt…

Computer Vision and Pattern Recognition · Computer Science 2024-01-31 Hyun Kang , Dohae Lee , Myungjin Shin , In-Kwon Lee

This paper explores advancements in high-fidelity personalized image generation through the utilization of pre-trained text-to-image diffusion models. While previous approaches have made significant strides in generating versatile scenes…

Computer Vision and Pattern Recognition · Computer Science 2023-12-04 Zhonghao Wang , Wei Wei , Yang Zhao , Zhisheng Xiao , Mark Hasegawa-Johnson , Humphrey Shi , Tingbo Hou

We present Readout Guidance, a method for controlling text-to-image diffusion models with learned signals. Readout Guidance uses readout heads, lightweight networks trained to extract signals from the features of a pre-trained, frozen…

Computer Vision and Pattern Recognition · Computer Science 2024-04-04 Grace Luo , Trevor Darrell , Oliver Wang , Dan B Goldman , Aleksander Holynski

Despite the impressive results of arbitrary image-guided style transfer methods, text-driven image stylization has recently been proposed for transferring a natural image into a stylized one according to textual descriptions of the target…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 Nisha Huang , Yuxin Zhang , Fan Tang , Chongyang Ma , Haibin Huang , Yong Zhang , Weiming Dong , Changsheng Xu

With the advancements in denoising diffusion probabilistic models (DDPMs), image inpainting has significantly evolved from merely filling information based on nearby regions to generating content conditioned on various prompts such as text,…

Computer Vision and Pattern Recognition · Computer Science 2026-02-25 Lingzhi Pan , Tong Zhang , Bingyuan Chen , Qi Zhou , Wei Ke , Sabine Süsstrunk , Mathieu Salzmann

Text-to-image (T2I) diffusion models have made remarkable strides in generating and editing high-fidelity images from text. Yet, these models remain fundamentally generic, failing to adapt to the nuanced aesthetic preferences of individual…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Connor Dunlop , Matthew Zheng , Kavana Venkatesh , Pinar Yanardag

Diffusion models emerged as a leading approach in text-to-image generation, producing high-quality images from textual descriptions. However, attempting to achieve detailed control to get a desired image solely through text remains a…

Computer Vision and Pattern Recognition · Computer Science 2026-02-12 Pablo Domingo-Gregorio , Javier Ruiz-Hidalgo

Diffusion models have shown superior performance in image generation and manipulation, but the inherent stochasticity presents challenges in preserving and manipulating image content and identity. While previous approaches like DreamBooth…

Computer Vision and Pattern Recognition · Computer Science 2023-04-20 Inhwa Han , Serin Yang , Taesung Kwon , Jong Chul Ye

Image composition and generation are processes where the artists need control over various parts of the generated images. However, the current state-of-the-art generation models, like Stable Diffusion, cannot handle fine-grained part-level…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Harsh Rangwani , Aishwarya Agarwal , Kuldeep Kulkarni , R. Venkatesh Babu , Srikrishna Karanam

Image generation has recently seen tremendous advances, with diffusion models allowing to synthesize convincing images for a large variety of text prompts. In this article, we propose DiffEdit, a method to take advantage of text-conditioned…

Computer Vision and Pattern Recognition · Computer Science 2022-10-21 Guillaume Couairon , Jakob Verbeek , Holger Schwenk , Matthieu Cord

Diffusion models have achieved remarkable success in high-quality image synthesis, sparking interest in image-guided generation tasks such as subject-driven image personalization. Despite their impressive personalization results, existing…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Huy Duong , Trong-Tung Nguyen , Cuong Pham , Anh Tran , Khoi Nguyen , Minh Hoai

Large-scale Text-to-Image (T2I) diffusion models have revolutionized image generation over the last few years. Although owning diverse and high-quality generation capabilities, translating these abilities to fine-grained image editing…

Computer Vision and Pattern Recognition · Computer Science 2024-02-06 Chong Mou , Xintao Wang , Jiechong Song , Ying Shan , Jian Zhang

Diffusion models have demonstrated impressive image generation capabilities. Personalized approaches, such as textual inversion and Dreambooth, enhance model individualization using specific images. These methods enable generating images of…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Yan Zeng , Masanori Suganuma , Takayuki Okatani

In this paper, we introduce TextBoost, an efficient one-shot personalization approach for text-to-image diffusion models. Traditional personalization methods typically involve fine-tuning extensive portions of the model, leading to…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 NaHyeon Park , Kunhee Kim , Hyunjung Shim

Guided diffusion-model generation is a promising direction for customizing the generation process of a pre-trained diffusion model to address specific downstream tasks. Existing guided diffusion models either rely on training the guidance…

Machine Learning · Computer Science 2025-04-01 Kim Yong Tan , Yueming Lyu , Ivor Tsang , Yew-Soon Ong

The proposed method, Discriminator Guidance, aims to improve sample generation of pre-trained diffusion models. The approach introduces a discriminator that gives explicit supervision to a denoising sample path whether it is realistic or…

Computer Vision and Pattern Recognition · Computer Science 2023-06-06 Dongjun Kim , Yeongmin Kim , Se Jung Kwon , Wanmo Kang , Il-Chul Moon

Diffusion models have gained increasing attention for their impressive generation abilities but currently struggle with rendering accurate and coherent text. To address this issue, we introduce TextDiffuser, focusing on generating images…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Jingye Chen , Yupan Huang , Tengchao Lv , Lei Cui , Qifeng Chen , Furu Wei

Text-guided image editing has recently experienced rapid development. However, simultaneously performing multiple editing actions on a single image, such as background replacement and specific subject attribute changes, while maintaining…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Pengzhi Li , QInxuan Huang , Yikang Ding , Zhiheng Li

Text-to-image diffusion models generate realistic and coherent images but often fail to follow numerical instructions in text, revealing a gap between language and visual representation. Interestingly, we found that these models are not…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Hyemin Boo , Hyoryung Kim , Myungjin Lee , Seunghyeon Lee , Jiyoung Lee , Jang-Hwan Choi , Hyunsoo Cho