English
Related papers

Related papers: DirectEdit: Step-Level Accurate Inversion for Flow…

200 papers

Instruction-based image editing aims to modify specific content within existing images according to user-provided instructions while preserving non-target regions. Beyond traditional object- and style-centric manipulation, text-centric…

Computer Vision and Pattern Recognition · Computer Science 2026-03-13 Hui Zhang , Juntao Liu , Zongkai Liu , Liqiang Niu , Fandong Meng , Zuxuan Wu , Yu-Gang Jiang

Although natural language instructions offer an intuitive way to guide automated image editing, deep-learning models often struggle to achieve high-quality results, largely due to the difficulty of creating large, high-quality training…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Sherry X. Chen , Misha Sra , Pradeep Sen

Text driven diffusion models have shown remarkable capabilities in editing images. However, when editing 3D scenes, existing works mostly rely on training a NeRF for 3D editing. Recent NeRF editing methods leverages edit operations by…

Computer Vision and Pattern Recognition · Computer Science 2024-12-18 Vivek Madhavaram , Shivangana Rawat , Chaitanya Devaguptapu , Charu Sharma , Manohar Kaul

Instruction-based image editing aims to modify specific image elements with natural language instructions. However, current models in this domain often struggle to accurately execute complex user instructions, as they are trained on…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Qifan Yu , Wei Chow , Zhongqi Yue , Kaihang Pan , Yang Wu , Xiaoyang Wan , Juncheng Li , Siliang Tang , Hanwang Zhang , Yueting Zhuang

The emergence of text-to-image generation models has led to the recognition that image enhancement, performed as post-processing, would significantly improve the visual quality of the generated images. Exploring diffusion models to enhance…

Computer Vision and Pattern Recognition · Computer Science 2024-09-12 Yang Luo , Yiheng Zhang , Zhaofan Qiu , Ting Yao , Zhineng Chen , Yu-Gang Jiang , Tao Mei

We present a simple but effective training-free approach for text-driven image-to-image translation based on a pretrained text-to-image diffusion model. Our goal is to generate an image that aligns with the target task while preserving the…

Computer Vision and Pattern Recognition · Computer Science 2024-12-23 Hyunsoo Lee , Minsoo Kang , Bohyung Han

Recent advances in diffusion models have revolutionized text-guided image editing, yet existing editing methods face critical challenges in hyperparameter identification. To get the reasonable editing performance, these methods often…

Computer Vision and Pattern Recognition · Computer Science 2025-10-08 Chau Pham , Quan Dao , Mahesh Bhosale , Yunjie Tian , Dimitris Metaxas , David Doermann

Recent studies have demonstrated that the forward diffusion process is crucial for the effectiveness of diffusion models in terms of generative quality and sampling efficiency. We propose incorporating an analytical image attenuation…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Yuhang Huang , Zheng Qin , Xinwang Liu , Kai Xu

Text-to-Image (T2I) diffusion models have recently gained traction for their versatility and user-friendliness in 2D content generation and editing. However, training a diffusion model specifically for 3D scene editing is challenging due to…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Nazmul Karim , Hasan Iqbal , Umar Khalid , Jing Hua , Chen Chen

Diffusion and flow-based generative models have shown strong potential for image restoration. However, image denoising under unknown and varying noise conditions remains challenging, because the learned vector fields may become inconsistent…

Computer Vision and Pattern Recognition · Computer Science 2026-04-06 Jigang Duan , Genwei Ma , Xu Jiang , Wenfeng Xu , Ping Yang , Xing Zhao

Recent works have explored text-guided image editing using diffusion models and generated edited images based on text prompts. However, the models struggle to accurately locate the regions to be edited and faithfully perform precise edits.…

Computer Vision and Pattern Recognition · Computer Science 2023-05-30 Qian Wang , Biao Zhang , Michael Birsak , Peter Wonka

Text-to-image diffusion models have achieved remarkable success in generating high-quality and diverse images. Building on these advancements, diffusion models have also demonstrated exceptional performance in text-guided image editing. A…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Mingyu Kang , Yong Suk Choi

Despite recent advances in large-scale text-to-image generative models, manipulating real images with these models remains a challenging problem. The main limitations of existing editing methods are that they either fail to perform with…

Computer Vision and Pattern Recognition · Computer Science 2024-09-26 Vadim Titov , Madina Khalmatova , Alexandra Ivanova , Dmitry Vetrov , Aibek Alanov

Current instruction-based editing methods, such as InstructPix2Pix, often fail to produce satisfactory results in complex scenarios due to their dependence on the simple CLIP text encoder in diffusion models. To rectify this, this paper…

Computer Vision and Pattern Recognition · Computer Science 2023-12-13 Yuzhou Huang , Liangbin Xie , Xintao Wang , Ziyang Yuan , Xiaodong Cun , Yixiao Ge , Jiantao Zhou , Chao Dong , Rui Huang , Ruimao Zhang , Ying Shan

Recent advancements in diffusion-based generative image editing have sparked a profound revolution, reshaping the landscape of image outpainting and inpainting tasks. Despite these strides, the field grapples with inherent challenges,…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Yuxi Ren , Jie Wu , Yanzuo Lu , Huafeng Kuang , Xin Xia , Xionghui Wang , Qianqian Wang , Yixing Zhu , Pan Xie , Shiyin Wang , Xuefeng Xiao , Yitong Wang , Min Zheng , Lean Fu

Many real-world applications, such as interactive photo retouching, artistic content creation, and product design, require flexible and iterative image editing. However, existing image editing methods primarily focus on achieving the…

Computer Vision and Pattern Recognition · Computer Science 2025-05-08 Zijun Zhou , Yingying Deng , Xiangyu He , Weiming Dong , Fan Tang

Instruction-guided image editing methods have demonstrated significant potential by training diffusion models on automatically synthesized or manually annotated image editing pairs. However, these methods remain far from practical,…

Computer Vision and Pattern Recognition · Computer Science 2025-04-29 Cong Wei , Zheyang Xiong , Weiming Ren , Xinrun Du , Ge Zhang , Wenhu Chen

Large-scale diffusion models have achieved remarkable performance in generative tasks. Beyond their initial training applications, these models have proven their ability to function as versatile plug-and-play priors. For instance, 2D…

Computer Vision and Pattern Recognition · Computer Science 2025-02-21 Xiaofeng Yang , Cheng Chen , Xulei Yang , Fayao Liu , Guosheng Lin

Drag-based editing allows precise object manipulation through point-based control, offering user convenience. However, current methods often suffer from a geometric inconsistency problem by focusing exclusively on matching user-defined…

Graphics · Computer Science 2025-07-14 Gwanhyeong Koo , Sunjae Yoon , Younghwan Lee , Ji Woo Hong , Chang D. Yoo

Generative models have made remarkable advancements and are capable of producing high-quality content. However, performing controllable editing with generative models remains challenging, due to their inherent uncertainty in outputs. This…

Computer Vision and Pattern Recognition · Computer Science 2025-07-09 Yikun Ma , Yiqing Li , Jiawei Wu , Xing Luo , Zhi Jin