English
Related papers

Related papers: Text-Driven Image Editing via Learnable Regions

200 papers

Instruction-guided image editing consists in taking an image and an instruction and deliverring that image altered according to that instruction. State-of-the-art approaches to this task suffer from the typical scaling up and domain…

Computation and Language · Computer Science 2025-03-05 Rodrigo Santos , António Branco , João Silva , João Rodrigues

Text-to-image generation models have seen considerable advancement, catering to the increasing interest in personalized image creation. Current customization techniques often necessitate users to provide multiple images (typically 3-5) for…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Linhao Zhong , Yan Hong , Wentao Chen , Binglin Zhou , Yiyi Zhang , Jianfu Zhang , Liqing Zhang

Diffusion models emerged as a leading approach in text-to-image generation, producing high-quality images from textual descriptions. However, attempting to achieve detailed control to get a desired image solely through text remains a…

Computer Vision and Pattern Recognition · Computer Science 2026-02-12 Pablo Domingo-Gregorio , Javier Ruiz-Hidalgo

Recent advances in vision-language models like Stable Diffusion have shown remarkable power in creative image synthesis and editing.However, most existing text-to-image editing methods encounter two obstacles: First, the text prompt needs…

Computer Vision and Pattern Recognition · Computer Science 2024-04-15 Shanglin Li , Bohan Zeng , Yutang Feng , Sicheng Gao , Xuhui Liu , Jiaming Liu , Li Lin , Xu Tang , Yao Hu , Jianzhuang Liu , Baochang Zhang

Learning and improving large language models through human preference feedback has become a mainstream approach, but it has rarely been applied to the field of low-light image enhancement. Existing low-light enhancement evaluations…

Computer Vision and Pattern Recognition · Computer Science 2025-03-12 Jun Yin , Yangfan He , Miao Zhang , Pengyu Zeng , Tianyi Wang , Shuai Lu , Xueqian Wang

Text-to-image generation has recently seen remarkable success, granting users with the ability to create high-quality images through the use of text. However, contemporary methods face challenges in capturing the precise semantics conveyed…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Shay Shomer-Chai , Wenxuan Peng , Bharath Hariharan , Hadar Averbuch-Elor

Text-based image editing is typically approached as a static task that involves operations such as inserting, deleting, or modifying elements of an input image based on human instructions. Given the static nature of this task, in this…

Computer Vision and Pattern Recognition · Computer Science 2025-02-05 Maria Mihaela Trusca , Mingxiao Li , Marie-Francine Moens

We present a lighting-aware image editing pipeline that, given a portrait image and a text prompt, performs single image relighting. Our model modifies the lighting and color of both the foreground and background to align with the provided…

Computer Vision and Pattern Recognition · Computer Science 2024-12-19 Junuk Cha , Mengwei Ren , Krishna Kumar Singh , He Zhang , Yannick Hold-Geoffroy , Seunghyun Yoon , HyunJoon Jung , Jae Shin Yoon , Seungryul Baek

Text-to-image generation models have grown in popularity due to their ability to produce high-quality images from a text prompt. One use for this technology is to enable the creation of more accessible art creation software. In this paper,…

Human-Computer Interaction · Computer Science 2023-09-06 Atieh Taheri , Mohammad Izadi , Gururaj Shriram , Negar Rostamzadeh , Shaun Kane

Text-to-image generation models are powerful but difficult to use. Users craft specific prompts to get better images, though the images can be repetitive. This paper proposes a Prompt Expansion framework that helps users generate…

Computer Vision and Pattern Recognition · Computer Science 2023-12-29 Siddhartha Datta , Alexander Ku , Deepak Ramachandran , Peter Anderson

Text-driven image generation methods have shown impressive results recently, allowing casual users to generate high quality images by providing textual descriptions. However, similar capabilities for editing existing images are still out of…

Computer Vision and Pattern Recognition · Computer Science 2023-07-06 Dani Valevski , Matan Kalman , Eyal Molad , Eyal Segalis , Yossi Matias , Yaniv Leviathan

Image colorization aims to bring colors back to grayscale images. Automatic image colorization methods, which requires no additional guidance, struggle to generate high-quality images due to color ambiguity, and provides limited user…

Computer Vision and Pattern Recognition · Computer Science 2025-03-20 Yifan Li , Shuai Yang , Jiaying Liu

Text-to-image models give rise to workflows which often begin with an exploration step, where users sift through a large collection of generated images. The global nature of the text-to-image generation process prevents users from narrowing…

Computer Vision and Pattern Recognition · Computer Science 2023-08-15 Or Patashnik , Daniel Garibi , Idan Azuri , Hadar Averbuch-Elor , Daniel Cohen-Or

Large-scale Text-to-Image (T2I) diffusion models demonstrate significant generation capabilities based on textual prompts. Based on the T2I diffusion models, text-guided image editing research aims to empower users to manipulate generated…

Computer Vision and Pattern Recognition · Computer Science 2024-05-03 Chuanming Tang , Kai Wang , Fei Yang , Joost van de Weijer

Text-to-image synthesis has achieved high-quality results with recent advances in diffusion models. However, text input alone has high spatial ambiguity and limited user controllability. Most existing methods allow spatial control through…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Yuki Endo

Editing 2D icon images can require significant manual effort from designers. It involves manipulating multiple geometries while maintaining the logical or physical coherence of the objects depicted in the image. Previous language driven…

Graphics · Computer Science 2024-05-31 Xianghao Xu , Aditya Ganeshan , Karl D. D. Willis , Yewen Pu , Daniel Ritchie

Diffusion-based image editing is a composite process of preserving the source image content and generating new content or applying modifications. While current editing approaches have made improvements under text guidance, most of them have…

Computer Vision and Pattern Recognition · Computer Science 2024-03-18 Tianrui Huang , Pu Cao , Lu Yang , Chun Liu , Mengjie Hu , Zhiwei Liu , Qing Song

A significant research effort is focused on exploiting the amazing capacities of pretrained diffusion models for the editing of images.They either finetune the model, or invert the image in the latent space of the pretrained model. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-09 Senmao Li , Joost van de Weijer , Taihang Hu , Fahad Shahbaz Khan , Qibin Hou , Yaxing Wang , Jian Yang , Ming-Ming Cheng

We present a simple but effective training-free approach for text-driven image-to-image translation based on a pretrained text-to-image diffusion model. Our goal is to generate an image that aligns with the target task while preserving the…

Computer Vision and Pattern Recognition · Computer Science 2024-12-23 Hyunsoo Lee , Minsoo Kang , Bohyung Han

The use of denoising diffusion models is becoming increasingly popular in the field of image editing. However, current approaches often rely on either image-guided methods, which provide a visual reference but lack control over semantic…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Zhanbo Feng , Zenan Ling , Xinyu Lu , Ci Gong , Feng Zhou , Wugedele Bao , Jie Li , Fan Yang , Robert C. Qiu