English
Related papers

Related papers: BlobCtrl: Taming Controllable Blob for Element-lev…

200 papers

Recent advancements in personalized image generation using diffusion models have been noteworthy. However, existing methods suffer from inefficiencies due to the requirement for subject-specific fine-tuning. This computationally intensive…

Computer Vision and Pattern Recognition · Computer Science 2023-12-12 Xu Peng , Junwei Zhu , Boyuan Jiang , Ying Tai , Donghao Luo , Jiangning Zhang , Wei Lin , Taisong Jin , Chengjie Wang , Rongrong Ji

The rapid advancement of diffusion models has increased the need for customized image generation. However, current customization methods face several limitations: 1) typically accept either image or text conditions alone; 2) customization…

Computer Vision and Pattern Recognition · Computer Science 2025-05-06 Han Yang , Chuanguang Yang , Qiuli Wang , Zhulin An , Weilun Feng , Libo Huang , Yongjun Xu

Recent advancements in language-guided diffusion models for image editing are often bottle-necked by cumbersome prompt engineering to precisely articulate desired changes. An intuitive alternative calls on guidance from in-the-wild image…

Computer Vision and Pattern Recognition · Computer Science 2025-01-20 Shristi Das Biswas , Matthew Shreve , Xuelu Li , Prateek Singhal , Kaushik Roy

The widespread deployment of text-to-image models is challenged by their potential to generate harmful content. While existing safety methods, such as prompt rewriting or model fine-tuning, provide valuable interventions, they often…

Computer Vision and Pattern Recognition · Computer Science 2025-08-19 Lingyun Zhang , Yu Xie , Yanwei Fu , Ping Chen

This work demonstrates that diffusion models can achieve font-controllable multilingual text rendering using just raw images without font label annotations.Visual text rendering remains a significant challenge. While recent methods…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Bowen Jiang , Yuan Yuan , Xinyi Bai , Zhuoqun Hao , Alyson Yin , Yaojie Hu , Wenyu Liao , Lyle Ungar , Camillo J. Taylor

Diffusion models have become prominent in creating high-quality images. However, unlike GAN models celebrated for their ability to edit images in a disentangled manner, diffusion-based text-to-image models struggle to achieve the same level…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Hidir Yesiltepe , Yusuf Dalva , Pinar Yanardag

Instruction-based image editing enables intuitive manipulation through natural language commands. However, text instructions alone often lack the precision required for fine-grained control over edit intensity. We introduce NumeriKontrol, a…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Zhenyu Xu , Xiaoqi Shen , Haotian Nan , Xinyu Zhang

Diffusion models emerged as a leading approach in text-to-image generation, producing high-quality images from textual descriptions. However, attempting to achieve detailed control to get a desired image solely through text remains a…

Computer Vision and Pattern Recognition · Computer Science 2026-02-12 Pablo Domingo-Gregorio , Javier Ruiz-Hidalgo

Colour is one of the most perceptually salient yet least controllable attributes in image generation. Although recent diffusion models can modify object colours from user instructions, their results often deviate from the intended hue,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-20 Yuqi Yang , Dongliang Chang , Yijia Ling , Ruoyi Du , Zhanyu Ma

Recently large-scale language-image models (e.g., text-guided diffusion models) have considerably improved the image generation capabilities to generate photorealistic images in various domains. Based on this success, current image editing…

Computer Vision and Pattern Recognition · Computer Science 2023-05-09 Wenkai Dong , Song Xue , Xiaoyue Duan , Shumin Han

In recent years, event cameras have gained significant attention due to their bio-inspired properties, such as high temporal resolution and high dynamic range. However, obtaining large-scale labeled ground-truth data for event-based vision…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Yixuan Hu , Yuxuan Xue , Simon Klenk , Daniel Cremers , Gerard Pons-Moll

Instruction-based image editing has made a great process in using natural human language to manipulate the visual content of images. However, existing models are limited by the quality of the dataset and cannot accurately localize editing…

Computer Vision and Pattern Recognition · Computer Science 2024-06-17 Tiancheng Li , Jinxiu Liu , Huajun Chen , Qi Liu

This paper explores image editing under the joint control of text and drag interactions. While recent advances in text-driven and drag-driven editing have achieved remarkable progress, they suffer from complementary limitations: text-driven…

Computer Vision and Pattern Recognition · Computer Science 2025-09-29 Qihang Wang , Yaxiong Wang , Lechao Cheng , Zhun Zhong

Recent pre-trained text-to-image flow models have enabled remarkable progress in text-based image editing. Mainstream approaches adopt a corruption-then-restoration paradigm, where the source image is first corrupted into an editable…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Yanghao Wang , Zhen Wang , Long Chen

Diffusion models have significantly improved text-to-image generation, producing high-quality, realistic images from textual descriptions. Beyond generation, object-level image editing remains a challenging problem, requiring precise…

Computer Vision and Pattern Recognition · Computer Science 2025-04-14 Marco Schouten , Mehmet Onurcan Kaya , Serge Belongie , Dim P. Papadopoulos

This study investigates the robustness of image classifiers to text-guided corruptions. We utilize diffusion models to edit images to different domains. Unlike other works that use synthetic or hand-picked data for benchmarking, we use…

Computer Vision and Pattern Recognition · Computer Science 2023-08-01 Mohammadreza Mofayezi , Yasamin Medghalchi

While large-scale text-to-image diffusion models have demonstrated impressive image-generation capabilities, there are significant concerns about their potential misuse for generating unsafe content, violating copyright, and perpetuating…

Computer Vision and Pattern Recognition · Computer Science 2024-05-30 Ruchika Chavhan , Da Li , Timothy Hospedales

We address the challenge of novel view synthesis from only two input images under large viewpoint changes. Existing regression-based methods lack the capacity to reconstruct unseen regions, while camera-guided diffusion models often deviate…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Liudi Yang , George Eskandar , Fengyi Shen , Mohammad Altillawi , Yang Bai , Chi Zhang , Ziyuan Liu , Abhinav Valada

Evaluating diffusion-based image-editing models is a crucial task in the field of Generative AI. Specifically, it is imperative to assess their capacity to execute diverse editing tasks while preserving the image content and realism. While…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Stefan Stefanache , Lluís Pastor Pérez , Julen Costa Watanabe , Ernesto Sanchez Tejedor , Thomas Hofmann , Enis Simsar

Image generation has recently seen tremendous advances, with diffusion models allowing to synthesize convincing images for a large variety of text prompts. In this article, we propose DiffEdit, a method to take advantage of text-conditioned…

Computer Vision and Pattern Recognition · Computer Science 2022-10-21 Guillaume Couairon , Jakob Verbeek , Holger Schwenk , Matthieu Cord