English
Related papers

Related papers: Iterative Multi-granular Image Editing using Diffu…

200 papers

Image enhancement finds wide-ranging applications in real-world scenarios due to complex environments and the inherent limitations of imaging devices. Recent diffusion-based methods yield promising outcomes but necessitate prolonged and…

Computer Vision and Pattern Recognition · Computer Science 2025-04-23 Yixuan Zhu , Haolin Wang , Ao Li , Wenliang Zhao , Yansong Tang , Jingxuan Niu , Lei Chen , Jie Zhou , Jiwen Lu

Images can be viewed as layered compositions, foreground objects over background, with potential occlusions. This layered representation enables independent editing of elements, offering greater flexibility for content creation. Despite the…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Jingxi Chen , Yixiao Zhang , Xiaoye Qian , Zongxia Li , Cornelia Fermuller , Caren Chen , Yiannis Aloimonos

The accelerated advancement of generative AI significantly enhance the viability and effectiveness of generative regional editing methods. This evolution render the image manipulation more accessible, thereby intensifying the risk of…

Computer Vision and Pattern Recognition · Computer Science 2023-12-01 Zhihao Sun , Haipeng Fang , Xinying Zhao , Danding Wang , Juan Cao

Recent advancements in diffusion and flow-matching models have demonstrated remarkable capabilities in high-fidelity image synthesis. A prominent line of research involves reward-guided guidance, which steers the generation process during…

Computer Vision and Pattern Recognition · Computer Science 2026-05-01 Jinho Chang , Jaemin Kim , Jong Chul Ye

Controllable image generation is fundamental to the success of modern generative AI, yet it faces a critical trade-off between semantic fidelity and inference speed. The RemEdit diffusion-based framework addresses this trade-off with two…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Eashan Adhikarla , Brian D. Davison

Scribble-guided image editing allows users to combine simple scribble annotations with text prompts to specify both where and how an image should be edited, enabling flexible interaction with precise spatial control. However, existing…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Mingyi Xu , Jinpeng Lin , Min Zhou , Tiezheng Ge , Ming Zeng

Video world models have shown immense promise for interactive simulation and entertainment, but current systems still struggle with two important aspects of interactivity: user control over the environment for reproducible, editable…

Artificial Intelligence · Computer Science 2026-04-01 Ryan Po , David Junhao Zhang , Amir Hertz , Gordon Wetzstein , Neal Wadhwa , Nataniel Ruiz

Image data augmentation constitutes a critical methodology in modern computer vision tasks, since it can facilitate towards enhancing the diversity and quality of training datasets; thereby, improving the performance and robustness of…

Computer Vision and Pattern Recognition · Computer Science 2025-01-13 Panagiotis Alimisis , Ioannis Mademlis , Panagiotis Radoglou-Grammatikis , Panagiotis Sarigiannidis , Georgios Th. Papadopoulos

Creative image generation has emerged as a compelling area of research, driven by the need to produce novel and high-quality images that expand the boundaries of imagination. In this work, we propose a novel framework for creative…

Computer Vision and Pattern Recognition · Computer Science 2026-02-04 Kunpeng Song , Ahmed Elgammal

Robust invisible watermarking aims to embed hidden messages into images such that they survive various manipulations while remaining imperceptible. However, powerful diffusion-based image generation and editing models now enable realistic…

Cryptography and Security · Computer Science 2025-11-11 Wenkai Fu , Finn Carter , Yue Wang , Emily Davis , Bo Zhang

The recent success of text-to-image generation diffusion models has also revolutionized semantic image editing, enabling the manipulation of images based on query/target texts. Despite these advancements, a significant challenge lies in the…

Computer Vision and Pattern Recognition · Computer Science 2023-10-06 Zuopeng Yang , Tianshu Chu , Xin Lin , Erdun Gao , Daqing Liu , Jie Yang , Chaoyue Wang

Recently, several point-based image editing methods (e.g., DragDiffusion, FreeDrag, DragNoise) have emerged, yielding precise and high-quality results based on user instructions. However, these methods often make insufficient use of…

Computer Vision and Pattern Recognition · Computer Science 2024-12-04 DuoSheng Chen , Binghui Chen , Yifeng Geng , Liefeng Bo

Diffusion-based Image Editing (DIE) is an emerging research hot-spot, which often applies a semantic mask to control the target area for diffusion-based editing. However, most existing solutions obtain these masks via manual operations or…

Computer Vision and Pattern Recognition · Computer Science 2024-01-24 Siyu Zou , Jiji Tang , Yiyi Zhou , Jing He , Chaoyi Zhao , Rongsheng Zhang , Zhipeng Hu , Xiaoshuai Sun

Diffusion models demonstrate impressive image generation performance with text guidance. Inspired by the learning process of diffusion, existing images can be edited according to text by DDIM inversion. However, the vanilla DDIM inversion…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Qi Qian , Haiyang Xu , Ming Yan , Juhua Hu

The traditional image inpainting task aims to restore corrupted regions by referencing surrounding background and foreground. However, the object erasure task, which is in increasing demand, aims to erase objects and generate harmonious…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Fan Li , Zixiao Zhang , Yi Huang , Jianzhuang Liu , Renjing Pei , Bin Shao , Songcen Xu

In recent years, significant progress has been made in the development of text-to-image generation models. However, these models still face limitations when it comes to achieving full controllability during the generation process. Often,…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Salaheldin Mohamed

Image generation and editing have seen a great deal of advancements with the rise of large-scale diffusion models that allow user control of different modalities such as text, mask, depth maps, etc. However, controlled editing of videos…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 AmirHossein Zamani , Amir G. Aghdam , Tiberiu Popa , Eugene Belilovsky

Recent advances in image editing, driven by image diffusion models, have shown remarkable progress. However, significant challenges remain, as these models often struggle to follow complex edit instructions accurately and frequently…

Computer Vision and Pattern Recognition · Computer Science 2025-03-21 Noam Rotstein , Gal Yona , Daniel Silver , Roy Velich , David Bensaïd , Ron Kimmel

Centred on content modification and style preservation, Scene Text Editing (STE) remains a challenging task despite considerable progress in text-to-image synthesis and text-driven image manipulation recently. GAN-based STE methods…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Weichao Zeng , Yan Shu , Zhenhang Li , Dongbao Yang , Yu Zhou

Diffusion-based generative modeling has been achieving state-of-the-art results on various generation tasks. Most diffusion models, however, are limited to a single-generation modeling. Can we generalize diffusion models with the ability of…

Computer Vision and Pattern Recognition · Computer Science 2024-09-26 Changyou Chen , Han Ding , Bunyamin Sisman , Yi Xu , Ouye Xie , Benjamin Z. Yao , Son Dinh Tran , Belinda Zeng