English
Related papers

Related papers: AdapEdit: Spatio-Temporal Guided Adaptive Editing …

200 papers

Text-guided image editing can have a transformative impact in supporting creative applications. A key challenge is to generate edits that are faithful to input text prompts, while consistent with input images. We present Imagen Editor, a…

Sketch-guided image editing aims to achieve local fine-tuning of the image based on the sketch information provided by the user, while maintaining the original status of the unedited areas. Due to the high cost of acquiring human sketches,…

Computer Vision and Pattern Recognition · Computer Science 2023-11-15 Weihang Mao , Bo Han , Zihao Wang

Text-to-image diffusion models have emerged as powerful tools for high-quality image generation and editing. Many existing approaches rely on text prompts as editing guidance. However, these methods are constrained by the need for manual…

Computer Vision and Pattern Recognition · Computer Science 2025-05-21 Yuanyuan Chang , Yinghua Yao , Tao Qin , Mengmeng Wang , Ivor Tsang , Guang Dai

Diffusion-based image editing offers strong semantic controllability, but remains computationally expensive due to iterative high-resolution denoising over all spatial tokens. Dynamic-resolution sampling reduces this cost by performing…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Zhengan Yan , Shikang Zheng , Haoran Qin , Xiaobing Tu , Yinggui Wang , Jiacheng Liu , Jiaxuan Ren , Yuqi Lin , Peiliang Cai , Jinkui Ren , Xiantao Zhang , Linfeng Zhang

Visually-guided image editing, where edits are conditioned on both visual cues and textual prompts, has emerged as a powerful paradigm for fine-grained, controllable content generation. Although recent generative models have shown…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Sara Ghazanfari , Wei-An Lin , Haitong Tian , Ersin Yumer

Instruction-guided 3D editing is a rapidly emerging field with the potential to broaden access to 3D content creation. However, existing methods face critical limitations: optimization-based approaches are prohibitively slow, while…

Computer Vision and Pattern Recognition · Computer Science 2025-11-24 Weiwei Cai , Shuangkang Fang , Weicai Ye , Xin Dong , Yunhan Yang , Xuanyang Zhang , Wei Cheng , Yanpei Cao , Gang Yu , Tao Chen

Large-scale Text-to-Image (T2I) diffusion models have revolutionized image generation over the last few years. Although owning diverse and high-quality generation capabilities, translating these abilities to fine-grained image editing…

Computer Vision and Pattern Recognition · Computer Science 2024-02-06 Chong Mou , Xintao Wang , Jiechong Song , Ying Shan , Jian Zhang

The rapid advancement of pretrained text-driven diffusion models has significantly enriched applications in image generation and editing. However, as the demand for personalized content editing increases, new challenges emerge especially…

Computer Vision and Pattern Recognition · Computer Science 2025-03-07 Rui Jiang , Xinghe Fu , Guangcong Zheng , Teng Li , Taiping Yao , Xi Li

Visual editing with diffusion models has made significant progress but often struggles with complex scenarios that textual guidance alone could not adequately describe, highlighting the need for additional non-text editing prompts. In this…

Computer Vision and Pattern Recognition · Computer Science 2025-08-29 Hyeonyu Kim , Seokhoon Jeong , Seonghee Han , Chanhyuk Choi , Taehwan Kim

Text-guided image editing faces significant challenges when considering training and inference flexibility. Much literature collects large amounts of annotated image-text pairs to train text-conditioned generative models from scratch, which…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Yueming Lyu , Kang Zhao , Bo Peng , Huafeng Chen , Yue Jiang , Yingya Zhang , Jing Dong , Caifeng Shan

Recent large-scale text-guided diffusion models provide powerful image-generation capabilities. Currently, a significant effort is given to enable the modification of these images using text only as means to offer intuitive and versatile…

Computer Vision and Pattern Recognition · Computer Science 2023-07-04 Linoy Tsaban , Apolinário Passos

Instruction-based image editing aims to modify specific content within existing images according to user-provided instructions while preserving non-target regions. Beyond traditional object- and style-centric manipulation, text-centric…

Computer Vision and Pattern Recognition · Computer Science 2026-03-13 Hui Zhang , Juntao Liu , Zongkai Liu , Liqiang Niu , Fandong Meng , Zuxuan Wu , Yu-Gang Jiang

Recently, text-guided image manipulation has received increasing attention in the research field of multimedia processing and computer vision due to its high flexibility and controllability. Its goal is to semantically manipulate parts of…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Ryugo Morita , Zhiqiang Zhang , Man M. Ho , Jinjia Zhou

While neural fields have made significant strides in view synthesis and scene reconstruction, editing them poses a formidable challenge due to their implicit encoding of geometry and texture information from multi-view inputs. In this…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Umar Khalid , Hasan Iqbal , Nazmul Karim , Jing Hua , Chen Chen

Editing images using natural language instructions has become a natural and expressive way to modify visual content; yet, evaluating the performance of such models remains challenging. Existing evaluation approaches often rely on image-text…

Computer Vision and Pattern Recognition · Computer Science 2025-07-28 Yusu Qian , Jiasen Lu , Tsu-Jui Fu , Xinze Wang , Chen Chen , Yinfei Yang , Wenze Hu , Zhe Gan

Traditional point-based image editing methods rely on iterative latent optimization or geometric transformations, which are either inefficient in their processing or fail to capture the semantic relationships within the image. These methods…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Biao Yang , Muqi Huang , Yuhui Zhang , Yun Xiong , Kun Zhou , Xi Chen , Shiyang Zhou , Huishuai Bao , Chuan Li , Feng Shi , Hualei Liu

Recent advances in diffusion models have significantly improved image editing. However, challenges persist in handling geometric transformations, such as translation, rotation, and scaling, particularly in complex scenes. Existing…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Shuo Zhang , Wenzhuo Wu , Huayu Zhang , Jiarong Cheng , Xianghao Zang , Chao Ban , Hao Sun , Zhongjiang He , Tianwei Cao , Kongming Liang , Zhanyu Ma

Despite the recent success of multi-view diffusion models for text/image-based 3D asset generation, instruction-based editing of 3D assets lacks surprisingly far behind the quality of generation models. The main reason is that recent…

Graphics · Computer Science 2025-12-15 Maria Parelli , Michael Oechsle , Michael Niemeyer , Federico Tombari , Andreas Geiger

Recent works have explored text-guided image editing using diffusion models and generated edited images based on text prompts. However, the models struggle to accurately locate the regions to be edited and faithfully perform precise edits.…

Computer Vision and Pattern Recognition · Computer Science 2023-05-30 Qian Wang , Biao Zhang , Michael Birsak , Peter Wonka

Image editing instructions are heterogeneous: a color swap, an object insertion, and a physical-action edit all demand different spatial coverage and different reasoning depth, yet existing reasoning-based editors apply a single fixed…

Computer Vision and Pattern Recognition · Computer Science 2026-05-04 Guandong Li , Mengxia Ye