English
Related papers

Related papers: AnyEdit: Mastering Unified High-Quality Image Edit…

200 papers

Typical diffusion models are trained to accept a particular form of conditioning, most commonly text, and cannot be conditioned on other modalities without retraining. In this work, we propose a universal guidance algorithm that enables…

Computer Vision and Pattern Recognition · Computer Science 2023-02-15 Arpit Bansal , Hong-Min Chu , Avi Schwarzschild , Soumyadip Sengupta , Micah Goldblum , Jonas Geiping , Tom Goldstein

We introduce SeedEdit, a diffusion model that is able to revise a given image with any text prompt. In our perspective, the key to such a task is to obtain an optimal balance between maintaining the original image, i.e. image…

Computer Vision and Pattern Recognition · Computer Science 2024-11-12 Yichun Shi , Peng Wang , Weilin Huang

Existing image editing tools, while powerful, typically disregard the underlying 3D geometry from which the image is projected. As a result, edits made using these tools may become detached from the geometry and lighting conditions that are…

Computer Vision and Pattern Recognition · Computer Science 2023-07-21 Oscar Michel , Anand Bhattad , Eli VanderBilt , Ranjay Krishna , Aniruddha Kembhavi , Tanmay Gupta

Text-guided audio editing aims to modify specific acoustic events while strictly preserving non-target content. Despite recent progress, existing approaches remain fundamentally limited. Training-free methods often suffer from signal…

Sound · Computer Science 2026-01-21 Ye Tao , Wen Wu , Chao Zhang , Mengyue Wu , Shuai Wang , Xuenan Xu

Scribble-guided image editing allows users to combine simple scribble annotations with text prompts to specify both where and how an image should be edited, enabling flexible interaction with precise spatial control. However, existing…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Mingyi Xu , Jinpeng Lin , Min Zhou , Tiezheng Ge , Ming Zeng

Diffusion-based image editing offers strong semantic controllability, but remains computationally expensive due to iterative high-resolution denoising over all spatial tokens. Dynamic-resolution sampling reduces this cost by performing…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Zhengan Yan , Shikang Zheng , Haoran Qin , Xiaobing Tu , Yinggui Wang , Jiacheng Liu , Jiaxuan Ren , Yuqi Lin , Peiliang Cai , Jinkui Ren , Xiantao Zhang , Linfeng Zhang

Despite recent advances in inversion-based editing, text-guided image manipulation remains challenging for diffusion models. The primary bottlenecks include 1) the time-consuming nature of the inversion process; 2) the struggle to balance…

Computer Vision and Pattern Recognition · Computer Science 2023-12-11 Sihan Xu , Yidong Huang , Jiayi Pan , Ziqiao Ma , Joyce Chai

Recent advances in image editing models have demonstrated remarkable capabilities in executing explicit instructions, such as attribute manipulation, style transfer, and pose synthesis. However, these models often face challenges when…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Wang Lin , Feng Wang , Majun Zhang , Wentao Hu , Tao Jin , Zhou Zhao , Fei Wu , Jingyuan Chen , Alan Yuille , Sucheng Ren

In recent years, instruction-based image editing methods have garnered significant attention in image editing. However, despite encompassing a wide range of editing priors, these methods are helpless when handling editing tasks that are…

Graphics · Computer Science 2024-03-28 Ruoyu Zhao , Qingnan Fan , Fei Kou , Shuai Qin , Hong Gu , Wei Wu , Pengcheng Xu , Mingrui Zhu , Nannan Wang , Xinbo Gao

Our goal is to develop fine-grained real-image editing methods suitable for real-world applications. In this paper, we first summarize four requirements for these methods and propose a novel diffusion-based image editing framework with…

Computer Vision and Pattern Recognition · Computer Science 2023-06-01 Naoki Matsunaga , Masato Ishii , Akio Hayakawa , Kenji Suzuki , Takuya Narihira

Instruction-guided 3D editing is a rapidly emerging field with the potential to broaden access to 3D content creation. However, existing methods face critical limitations: optimization-based approaches are prohibitively slow, while…

Computer Vision and Pattern Recognition · Computer Science 2025-11-24 Weiwei Cai , Shuangkang Fang , Weicai Ye , Xin Dong , Yunhan Yang , Xuanyang Zhang , Wei Cheng , Yanpei Cao , Gang Yu , Tao Chen

Multi-object images are prevalent in various real-world scenarios, including augmented reality, advertisement design, and medical imaging. Efficient and precise editing of these images is critical for these applications. With the advent of…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Yanfeng Li , Kahou Chan , Yue Sun , Chantong Lam , Tong Tong , Zitong Yu , Keren Fu , Xiaohong Liu , Tao Tan

The rapid advancement of large language models (LLMs) and multimodal learning has transformed digital content creation and manipulation. Traditional visual editing tools require significant expertise, limiting accessibility. Recent strides…

Computer Vision and Pattern Recognition · Computer Science 2024-11-22 Thanh Tam Nguyen , Zhao Ren , Trinh Pham , Thanh Trung Huynh , Phi Le Nguyen , Hongzhi Yin , Quoc Viet Hung Nguyen

Instruction-based image editing has garnered significant attention due to its direct interaction with users. However, real-world user instructions are immensely diverse, and existing methods often fail to generalize effectively to…

Computer Vision and Pattern Recognition · Computer Science 2025-09-17 Qifei Jia , Yu Liu , Yajie Chai , Xintong Yao , Qiming Lu , Yasen Zhang , Runyu Shi , Ying Huang , Guoquan Zhang

Instruction-based image editing has made a great process in using natural human language to manipulate the visual content of images. However, existing models are limited by the quality of the dataset and cannot accurately localize editing…

Computer Vision and Pattern Recognition · Computer Science 2024-06-17 Tiancheng Li , Jinxiu Liu , Huajun Chen , Qi Liu

Large-scale Text-to-Image (T2I) diffusion models have revolutionized image generation over the last few years. Although owning diverse and high-quality generation capabilities, translating these abilities to fine-grained image editing…

Computer Vision and Pattern Recognition · Computer Science 2024-02-06 Chong Mou , Xintao Wang , Jiechong Song , Ying Shan , Jian Zhang

A plethora of text-guided image editing methods have recently been developed by leveraging the impressive capabilities of large-scale diffusion-based generative models such as Imagen and Stable Diffusion. A standardized evaluation protocol,…

Computer Vision and Pattern Recognition · Computer Science 2023-10-05 Samyadeep Basu , Mehrdad Saberi , Shweta Bhardwaj , Atoosa Malemir Chegini , Daniela Massiceti , Maziar Sanjabi , Shell Xu Hu , Soheil Feizi

The remarkable generative capabilities of diffusion models have motivated extensive research in both image and video editing. Compared to video editing which faces additional challenges in the time dimension, image editing has witnessed the…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Wenqi Ouyang , Yi Dong , Lei Yang , Jianlou Si , Xingang Pan

Significant progress has been made in the field of Instruction-based Image Editing (IIE). However, evaluating these models poses a significant challenge. A crucial requirement in this field is the establishment of a comprehensive evaluation…

Computer Vision and Pattern Recognition · Computer Science 2024-09-30 Yiwei Ma , Jiayi Ji , Ke Ye , Weihuang Lin , Zhibin Wang , Yonghan Zheng , Qiang Zhou , Xiaoshuai Sun , Rongrong Ji

We introduce PhotoDoodle, a novel image editing framework designed to facilitate photo doodling by enabling artists to overlay decorative elements onto photographs. Photo doodling is challenging because the inserted elements must appear…

Computer Vision and Pattern Recognition · Computer Science 2025-02-25 Shijie Huang , Yiren Song , Yuxuan Zhang , Hailong Guo , Xueyin Wang , Mike Zheng Shou , Jiaming Liu