English
Related papers

Related papers: Inst-Inpaint: Instructing to Remove Objects with D…

200 papers

Previous works on image inpainting mainly focus on inpainting background or partially missing objects, while the problem of inpainting an entire missing object remains unexplored. This work studies a new image inpainting task, i.e.…

Computer Vision and Pattern Recognition · Computer Science 2022-04-19 Yu Zeng , Zhe Lin , Vishal M. Patel

Semantic image inpainting is a challenging task where large missing regions have to be filled based on the available visual data. Existing methods which extract information from only a single image generally produce unsatisfactory results…

Computer Vision and Pattern Recognition · Computer Science 2017-07-14 Raymond A. Yeh , Chen Chen , Teck Yian Lim , Alexander G. Schwing , Mark Hasegawa-Johnson , Minh N. Do

This study introduces Text-Guided Subject-Driven Image Inpainting, a novel task that combines text and exemplar images for image inpainting. While both text and exemplar images have been used independently in previous efforts, their…

Computer Vision and Pattern Recognition · Computer Science 2023-12-08 Shaoan Xie , Yang Zhao , Zhisheng Xiao , Kelvin C. K. Chan , Yandong Li , Yanwu Xu , Kun Zhang , Tingbo Hou

Although image inpainting, or the art of repairing the old and deteriorated images, has been around for many years, it has gained even more popularity because of the recent development in image processing techniques. With the improvement of…

Computer Vision and Pattern Recognition · Computer Science 2019-12-11 Omar Elharrouss , Noor Almaadeed , Somaya Al-Maadeed , Younes Akbari

Image and video inpainting is a classic problem in computer vision and computer graphics, aiming to fill in the plausible and realistic content in the missing areas of images and videos. With the advance of deep learning, this problem has…

Computer Vision and Pattern Recognition · Computer Science 2024-01-09 Weize Quan , Jiaxi Chen , Yanli Liu , Dong-Ming Yan , Peter Wonka

In this work, we study the task of sketch-guided image inpainting. Unlike the well-explored natural language-guided image inpainting, which excels in capturing semantic details, the relatively less-studied sketch-guided inpainting offers…

Computer Vision and Pattern Recognition · Computer Science 2024-04-19 Nakul Sharma , Aditay Tripathi , Anirban Chakraborty , Anand Mishra

We initially proposed a deep learning approach for foreign objects inpainting in smartphone-camera captured chest radiographs utilizing the cheXphoto dataset. Foreign objects which can significantly affect the quality of a computer-aided…

Computer Vision and Pattern Recognition · Computer Science 2020-08-18 Hieu X. Le , Phuong D. Nguyen , Thang H. Nguyen , Khanh N. Q. Le , Thanh T. Nguyen

In this paper we present an end-to-end deep learning framework to turn images that show dynamic content, such as vehicles or pedestrians, into realistic static frames. This objective encounters two main challenges: detecting all the dynamic…

Computer Vision and Pattern Recognition · Computer Science 2019-02-18 Berta Bescos , José Neira , Roland Siegwart , Cesar Cadena

Image inpainting aims at restoring missing region of corrupted images, which has many applications such as image restoration and object removal. However, current GAN-based inpainting models fail to explicitly consider the semantic…

Computer Vision and Pattern Recognition · Computer Science 2019-12-17 Ang Li , Jianzhong Qi , Rui Zhang , Ramamohanarao Kotagiri

Inpainting is a learned interpolation technique that is based on generative modeling and used to populate masked or missing pieces in an image; it has wide applications in picture editing and retouching. Recently, inpainting started being…

Machine Learning · Computer Science 2021-06-02 David Khachaturov , Ilia Shumailov , Yiren Zhao , Nicolas Papernot , Ross Anderson

We provide a theoretical justification for sample recovery using diffusion based image inpainting in a linear model setting. While most inpainting algorithms require retraining with each new mask, we prove that diffusion based inpainting…

Machine Learning · Statistics 2023-02-03 Litu Rout , Advait Parulekar , Constantine Caramanis , Sanjay Shakkottai

The correct insertion of virtual objects in images of real-world scenes requires a deep understanding of the scene's lighting, geometry and materials, as well as the image formation process. While recent large-scale diffusion models have…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Ruofan Liang , Zan Gojcic , Merlin Nimier-David , David Acuna , Nandita Vijaykumar , Sanja Fidler , Zian Wang

Semantic inpainting or image completion alludes to the task of inferring arbitrary large missing regions in images based on image semantics. Since the prediction of image pixels requires an indication of high-level context, this makes it…

Computer Vision and Pattern Recognition · Computer Science 2023-07-28 Priyansh Saxena , Raahat Gupta , Akshat Maheshwari , Saumil Maheshwari

Diffusion models are now the undisputed state-of-the-art for image generation and image restoration. However, they require large amounts of computational power for training and inference. In this paper, we propose lightweight diffusion…

Computer Vision and Pattern Recognition · Computer Science 2024-06-07 Nicolas Cherel , Andrés Almansa , Yann Gousseau , Alasdair Newson

Erase inpainting, or object removal, aims to precisely remove target objects within masked regions while preserving the overall consistency of the surrounding content. Despite diffusion-based methods have made significant strides in the…

Computer Vision and Pattern Recognition · Computer Science 2025-03-17 Yi Liu , Hao Zhou , Wenxiang Shang , Ran Lin , Benlei Cui

Manipulating images of complex scenes to reconstruct, insert and/or remove specific object instances is a challenging task. Complex scenes contain multiple semantics and objects, which are frequently cluttered or ambiguous, thus hampering…

Computer Vision and Pattern Recognition · Computer Science 2020-10-20 Pierfrancesco Ardino , Yahui Liu , Elisa Ricci , Bruno Lepri , Marco De Nadai

Generative adversarial networks (GANs) have made great success in image inpainting yet still have difficulties tackling large missing regions. In contrast, iterative probabilistic algorithms, such as autoregressive and denoising diffusion…

Computer Vision and Pattern Recognition · Computer Science 2023-03-09 Wenbo Li , Xin Yu , Kun Zhou , Yibing Song , Zhe Lin , Jiaya Jia

Image inpainting is a restoration process which has numerous applications. Restoring of scanned old images with scratches, or removing objects in images are some of inpainting applications. Different approaches have been used for…

Image and Video Processing · Electrical Eng. & Systems 2018-01-03 Mehran Motmaen , Majid Mohrekesh , Mojtaba Akbari , Nader Karimi , Shadrokh Samavi

Denoising Diffusion Probabilistic Models (DDPMs) have recently achieved remarkable results in conditional and unconditional image generation. The pre-trained models can be adapted without further training to different downstream tasks, by…

Computer Vision and Pattern Recognition · Computer Science 2023-09-19 Asya Grechka , Guillaume Couairon , Matthieu Cord

3D photography renders a static image into a video with appealing 3D visual effects. Existing approaches typically first conduct monocular depth estimation, then render the input frame to subsequent frames with various viewpoints, and…

Computer Vision and Pattern Recognition · Computer Science 2023-02-22 Xiaodong Wang , Chenfei Wu , Shengming Yin , Minheng Ni , Jianfeng Wang , Linjie Li , Zhengyuan Yang , Fan Yang , Lijuan Wang , Zicheng Liu , Yuejian Fang , Nan Duan