English
Related papers

Related papers: Inst-Inpaint: Instructing to Remove Objects with D…

200 papers

Image inpainting, the process of restoring corrupted images, has seen significant advancements with the advent of diffusion models (DMs). Despite these advancements, current DM adaptations for inpainting, which involve modifications to the…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Xuan Ju , Xian Liu , Xintao Wang , Yuxuan Bian , Ying Shan , Qiang Xu

We present Common Inpainted Objects In-N-Out of Context (COinCO), a novel dataset addressing the scarcity of out-of-context examples in existing vision datasets. By systematically replacing objects in COCO images through diffusion-based…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Tianze Yang , Tyson Jordan , Ruitong Sun , Ninghao Liu , Jin Sun

Despite the great success of large-scale text-to-image diffusion models in image generation and image editing, existing methods still struggle to edit the layout of real images. Although a few works have been proposed to tackle this…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Tao Xia , Yudi Zhang , Ting Liu Lei Zhang

Evaluating diffusion-based image-editing models is a crucial task in the field of Generative AI. Specifically, it is imperative to assess their capacity to execute diverse editing tasks while preserving the image content and realism. While…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Stefan Stefanache , Lluís Pastor Pérez , Julen Costa Watanabe , Ernesto Sanchez Tejedor , Thomas Hofmann , Enis Simsar

Diffusion models are the current state of the art for generating photorealistic images. Controlling the sampling process for constrained image generation tasks such as inpainting, however, remains challenging since exact conditioning on…

Computer Vision and Pattern Recognition · Computer Science 2024-12-12 Anji Liu , Mathias Niepert , Guy Van den Broeck

Image inpainting aims to restore the missing regions of corrupted images and make the recovery result identical to the originally complete image, which is different from the common generative task emphasizing the naturalness or realism of…

Computer Vision and Pattern Recognition · Computer Science 2021-10-19 Qing Guo , Xiaoguang Li , Felix Juefei-Xu , Hongkai Yu , Yang Liu , Song wang

Existing object removal tools often rely on manual masks or text prompts, making precise removal difficult for non-expert users in complex scenes and often leading to incomplete removal or unnatural background completion. To address this…

Computer Vision and Pattern Recognition · Computer Science 2026-05-15 Ledun Zhang , Yatu Ji , Xufei Zhuang , Xinying Yao

Image inpainting is a non-trivial task in computer vision due to multiple possibilities for filling the missing data, which may be dependent on the global information of the image. Most of the existing approaches use the attention mechanism…

Computer Vision and Pattern Recognition · Computer Science 2020-11-06 Gourav Wadhwa , Abhinav Dhall , Subrahmanyam Murala , Usman Tariq

Our task is to remove all facial parts (e.g., eyebrows, eyes, mouth and nose), and then impose visual elements onto the ``blank'' face for augmented reality. Conventional object removal methods rely on image inpainting techniques (e.g.,…

Computer Vision and Pattern Recognition · Computer Science 2021-10-25 Miao Hua , Lijie Liu , Ziyang Cheng , Qian He , Bingchuan Li , Zili Yi

We develop a method for user-controllable semantic image inpainting: Given an arbitrary set of observed pixels, the unobserved pixels can be imputed in a user-controllable range of possibilities, each of which is semantically coherent and…

Machine Learning · Statistics 2018-06-18 Jin Xu , Yee Whye Teh

Recent advancements in text-guided diffusion models have unlocked powerful image manipulation capabilities. However, applying these methods to real images necessitates the inversion of the images into the domain of the pretrained diffusion…

Computer Vision and Pattern Recognition · Computer Science 2024-03-22 Daniel Garibi , Or Patashnik , Andrey Voynov , Hadar Averbuch-Elor , Daniel Cohen-Or

Changing facial expressions, gestures, or background details may dramatically alter the meaning conveyed by an image. Notably, recent advances in diffusion models greatly improve the quality of image manipulation while also opening the door…

Computer Vision and Pattern Recognition · Computer Science 2025-06-13 Alex Costanzino , Woody Bayliss , Juil Sock , Marc Gorriz Blanch , Danijela Horak , Ivan Laptev , Philip Torr , Fabio Pizzati

Deep learning based image denoising methods have been recently popular due to their improved performance. Traditionally, these methods are trained in a supervised manner, requiring a set of noisy input and clean target image pairs. More…

Image and Video Processing · Electrical Eng. & Systems 2020-11-20 Burhaneddin Yaman , Seyed Amir Hossein Hosseini , Mehmet Akçakaya

Recently, great attention was intended toward overcomplete dictionaries and the sparse representations they can provide. In a wide variety of signal processing problems, sparsity serves a crucial property leading to high performance.…

Multimedia · Computer Science 2008-12-15 SeyyedMajid Valiollahzadeh , Mohammad Nazari , Massoud Babaie-Zadeh , Christian Jutten

Image generation has recently seen tremendous advances, with diffusion models allowing to synthesize convincing images for a large variety of text prompts. In this article, we propose DiffEdit, a method to take advantage of text-conditioned…

Computer Vision and Pattern Recognition · Computer Science 2022-10-21 Guillaume Couairon , Jakob Verbeek , Holger Schwenk , Matthieu Cord

Intrinsic image decomposition, which is an essential task in computer vision, aims to infer the reflectance and shading of the scene. It is challenging since it needs to separate one image into two components. To tackle this, conventional…

Computer Vision and Pattern Recognition · Computer Science 2020-05-28 Yunfei Liu , Yu Li , Shaodi You , Feng Lu

Recent advances in text-to-image diffusion models have substantially improved the quality of image customization, enabling the synthesis of highly realistic images. Despite this progress, achieving fast and efficient personalization remains…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Aniket Roy , Maitreya Suin , Rama Chellappa

As a special case of common object removal, image person removal is playing an increasingly important role in social media and criminal investigation domains. Due to the integrity of person area and the complexity of human posture, person…

Computer Vision and Pattern Recognition · Computer Science 2022-09-30 Yunliang Jiang , Chenyang Gu , Zhenfeng Xue , Xiongtao Zhang , Yong Liu

Facial image inpainting is a problem that is widely studied, and in recent years the introduction of Generative Adversarial Networks, has led to improvements in the field. Unfortunately some issues persists, in particular when blending the…

Computer Vision and Pattern Recognition · Computer Science 2020-11-10 Jireh Jam , Connah Kendrick , Vincent Drouard , Kevin Walker , Gee-Sern Hsu , Moi Hoon Yap

Image inpainting technology can patch images with missing pixels. Existing methods propose convolutional neural networks to repair corrupted images. The networks focus on the valid pixels around the missing pixels, use the encoder-decoder…

Computer Vision and Pattern Recognition · Computer Science 2020-02-06 Zhenghang Wu , Yidong Cui