English
Related papers

Related papers: InverseMeetInsert: Robust Real Image Editing via G…

200 papers

While diffusion models have shown great success in image generation, their noise-inverting generative process does not explicitly consider the structure of images, such as their inherent multi-scale nature. Inspired by diffusion models and…

Computer Vision and Pattern Recognition · Computer Science 2023-04-14 Severi Rissanen , Markus Heinonen , Arno Solin

We introduce an inversion based method, denoted as IMAge-Guided model INvErsion (IMAGINE), to generate high-quality and diverse images from only a single training sample. We leverage the knowledge of image semantics from a pre-trained…

Computer Vision and Pattern Recognition · Computer Science 2021-04-14 Pei Wang , Yijun Li , Krishna Kumar Singh , Jingwan Lu , Nuno Vasconcelos

Adding Object into images based on text instructions is a challenging task in semantic image editing, requiring a balance between preserving the original scene and seamlessly integrating the new object in a fitting location. Despite…

Computer Vision and Pattern Recognition · Computer Science 2024-11-13 Yoad Tewel , Rinon Gal , Dvir Samuel , Yuval Atzmon , Lior Wolf , Gal Chechik

We present IntrinsicWeather, a diffusion-based framework for controllable weather editing in intrinsic space. Our framework includes two components based on diffusion priors: an inverse renderer that estimates material properties, scene…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 Yixin Zhu , Zuo-Liang Zhu , Jian Yang , Miloš Hašan , Jin Xie , Beibei Wang

The quality of the prompts provided to text-to-image diffusion models determines how faithful the generated content is to the user's intent, often requiring `prompt engineering'. To harness visual concepts from target images without prompt…

Computer Vision and Pattern Recognition · Computer Science 2023-12-20 Shweta Mahajan , Tanzila Rahman , Kwang Moo Yi , Leonid Sigal

Diffusion-based image editing models have achieved significant progress in real world applications. However, conventional models typically rely on natural language prompts, which often lack the precision required to localize target objects.…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Haohang Xu , Lin Liu , Zhibo Zhang , Rong Cong , Xiaopeng Zhang , Qi Tian

Consistent editing of real images is a challenging task, as it requires performing non-rigid edits (e.g., changing postures) to the main objects in the input image without changing their identity or attributes. To guarantee consistent…

Computer Vision and Pattern Recognition · Computer Science 2023-12-25 Xiaoyue Duan , Shuhao Cui , Guoliang Kang , Baochang Zhang , Zhengcong Fei , Mingyuan Fan , Junshi Huang

This paper presents a novel approach to improving text-guided image editing using diffusion-based models. Text-guided image editing task poses key challenge of precisly locate and edit the target semantic, and previous methods fall shorts…

Computer Vision and Pattern Recognition · Computer Science 2025-03-24 Yihan Hu , Jianing Peng , Yiheng Lin , Ting Liu , Xiaochao Qu , Luoqi Liu , Yao Zhao , Yunchao Wei

While learned image compression (LIC) focuses on efficient data transmission, generative image compression (GIC) extends this framework by integrating generative modeling to produce photo-realistic reconstructed images. In this paper, we…

Image and Video Processing · Electrical Eng. & Systems 2025-05-28 Minghao Han , Weiyi You , Jinhua Zhang , Leheng Zhang , Ce Zhu , Shuhang Gu

Recent inversion methods have shown that real images can be inverted into StyleGAN's latent space and numerous edits can be achieved on those images thanks to the semantically rich feature representations of well-trained GAN models.…

Computer Vision and Pattern Recognition · Computer Science 2023-07-28 Ahmet Burak Yildirim , Hamza Pehlivan , Bahri Batuhan Bilecen , Aysegul Dundar

Generative diffusion models offer a natural choice for data augmentation when training complex vision models. However, ensuring reliability of their generative content as augmentation samples remains an open challenge. Despite a number of…

Computer Vision and Pattern Recognition · Computer Science 2025-03-17 Khawar Islam , Naveed Akhtar

Text-guided image editing finds applications in various creative and practical fields. While recent studies in image generation have advanced the field, they often struggle with the dual challenges of coherent image transformation and…

Computer Vision and Pattern Recognition · Computer Science 2024-12-18 Rumeysa Bodur , Binod Bhattarai , Tae-Kyun Kim

Relighting a person from a single photo is an attractive but ill-posed task, as a 2D image ambiguously entangles 3D geometry, intrinsic appearance, and illumination. Current methods either use sequential pipelines that suffer from error…

Computer Vision and Pattern Recognition · Computer Science 2026-04-23 Yuxuan Xue , Ruofan Liang , Egor Zakharov , Timur Bagautdinov , Chen Cao , Giljoo Nam , Shunsuke Saito , Gerard Pons-Moll , Javier Romero

The diffusion-based generative models have achieved remarkable success in text-based image generation. However, since it contains enormous randomness in generation progress, it is still challenging to apply such models for real-world visual…

Computer Vision and Pattern Recognition · Computer Science 2023-10-12 Chenyang Qi , Xiaodong Cun , Yong Zhang , Chenyang Lei , Xintao Wang , Ying Shan , Qifeng Chen

While diffusion models show promising results in image editing given a target prompt, achieving both prompt fidelity and background preservation remains difficult. Recent works have introduced score distillation techniques that leverage the…

Implicit Neural Representations (INRs) are widely used for modeling continuous 2D images, enabling high-fidelity reconstruction, super-resolution, and compression. Architectures such as SIREN, WIRE, and FINER demonstrate their ability to…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Weronika Jakubowska , Mikołaj Zieliński , Rafał Tobiasz , Krzysztof Byrski , Maciej Zięba , Dominik Belter , Przemysław Spurek

Object-level manipulation, relocating or reorienting objects in images or videos while preserving scene realism, is central to film post-production, AR, and creative editing. Yet existing methods struggle to jointly achieve three core…

Computer Vision and Pattern Recognition · Computer Science 2026-02-13 Penghui Ruan , Bojia Zi , Xianbiao Qi , Youze Huang , Rong Xiao , Pichao Wang , Jiannong Cao , Yuhui Shi

Autoregressive models are structurally misaligned with the inherently parallel nature of geospatial understanding, forcing a rigid sequential narrative onto scenes and fundamentally hindering the generation of structured and coherent…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Jiaqi Liu , Ronghao Fu , Haoran Liu , Lang Sun , Bo Yang

Building on the success of text-to-image diffusion models (DPMs), image editing is an important application to enable human interaction with AI-generated content. Among various editing methods, editing within the prompt space gains more…

Computer Vision and Pattern Recognition · Computer Science 2025-01-28 Aosong Feng , Weikang Qiu , Jinbin Bai , Xiao Zhang , Zhen Dong , Kaicheng Zhou , Rex Ying , Leandros Tassiulas

Image restoration is a classic low-level problem aimed at recovering high-quality images from low-quality images with various degradations such as blur, noise, rain, haze, etc. However, due to the inherent complexity and non-uniqueness of…

Computer Vision and Pattern Recognition · Computer Science 2024-07-08 Yuhong Zhang , Hengsheng Zhang , Xinning Chai , Zhengxue Cheng , Rong Xie , Li Song , Wenjun Zhang