English
Related papers

Related papers: Towards Coherent Image Inpainting Using Denoising …

200 papers

Recent advancements in large generative models, particularly diffusion-based methods, have significantly enhanced the capabilities of image editing. However, achieving precise control over image composition tasks remains a challenge.…

Computer Vision and Pattern Recognition · Computer Science 2024-11-28 Jinrui Yang , Qing Liu , Yijun Li , Soo Ye Kim , Daniil Pakhomov , Mengwei Ren , Jianming Zhang , Zhe Lin , Cihang Xie , Yuyin Zhou

Image outpainting seeks for a semantically consistent extension of the input image beyond its available content. Compared to inpainting -- filling in missing pixels in a way coherent with the neighboring pixels -- outpainting can be…

Computer Vision and Pattern Recognition · Computer Science 2021-04-02 Yen-Chi Cheng , Chieh Hubert Lin , Hsin-Ying Lee , Jian Ren , Sergey Tulyakov , Ming-Hsuan Yang

Image outpainting aims to generate the content of an input sub-image beyond its original boundaries. It is an important task in content generation yet remains an open problem for generative models. This paper pushes the technical frontier…

Computer Vision and Pattern Recognition · Computer Science 2024-01-30 Shaofeng Zhang , Jinfa Huang , Qiang Zhou , Zhibin Wang , Fan Wang , Jiebo Luo , Junchi Yan

Semantic inpainting or image completion alludes to the task of inferring arbitrary large missing regions in images based on image semantics. Since the prediction of image pixels requires an indication of high-level context, this makes it…

Computer Vision and Pattern Recognition · Computer Science 2023-07-28 Priyansh Saxena , Raahat Gupta , Akshat Maheshwari , Saumil Maheshwari

In this paper we review several algorithms for image inpainting based on the hypoelliptic diffusion naturally associated with a mathematical model of the primary visual cortex. In particular, we present one algorithm that does not exploit…

Computer Vision and Pattern Recognition · Computer Science 2020-02-11 Ugo Boscain , Roman Chertovskih , Jean-Paul Gauthier , Dario Prandi , Alexey Remizov

Image restoration aims to enhance low quality images, producing high quality images that exhibit natural visual characteristics and fine semantic attributes. Recently, the diffusion model has emerged as a powerful technique for image…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Jiangtong Tan , Feng Zhao

Image interpolation based on diffusion models is promising in creating fresh and interesting images. Advanced interpolation methods mainly focus on spherical linear interpolation, where images are encoded into the noise space and then…

Computer Vision and Pattern Recognition · Computer Science 2024-03-15 PengFei Zheng , Yonggang Zhang , Zhen Fang , Tongliang Liu , Defu Lian , Bo Han

The traditional image inpainting task aims to restore corrupted regions by referencing surrounding background and foreground. However, the object erasure task, which is in increasing demand, aims to erase objects and generate harmonious…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Fan Li , Zixiao Zhang , Yi Huang , Jianzhuang Liu , Renjing Pei , Bin Shao , Songcen Xu

Latent Diffusion Models (LDMs) have markedly advanced the quality of image inpainting and local editing. However, the inherent latent compression often introduces pixel-level inconsistencies, such as chromatic shifts, texture mismatches,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-04 Haitian Zheng , Yuan Yao , Yongsheng Yu , Yuqian Zhou , Jiebo Luo , Zhe Lin

Image outpainting is a very intriguing problem as the outside of a given image can be continuously filled by considering as the context of the image. This task has two main challenges. The first is to maintain the spatial consistency in…

Computer Vision and Pattern Recognition · Computer Science 2020-11-10 Kyunghun Kim , Yeohun Yun , Keon-Woo Kang , Kyeongbo Kong , Siyeong Lee , Suk-Ju Kang

Inpainting focuses on filling missing or corrupted regions of an image to blend seamlessly with its surrounding content and style. While conditional diffusion models have proven effective for text-guided inpainting, we introduce the novel…

Computer Vision and Pattern Recognition · Computer Science 2025-04-11 Nicola Fanelli , Gennaro Vessio , Giovanna Castellano

Recent advancements in multi-view 3D reconstruction and novel-view synthesis, particularly through Neural Radiance Fields (NeRF) and 3D Gaussian Splatting (3DGS), have greatly enhanced the fidelity and efficiency of 3D content creation.…

Computer Vision and Pattern Recognition · Computer Science 2025-07-25 Jun Zhou , Dinghao Li , Nannan Li , Mingjie Wang

This work addresses image restoration tasks through the lens of inverse problems using unpaired datasets. In contrast to traditional approaches -- which typically assume full knowledge of the forward model or access to paired degraded and…

Computer Vision and Pattern Recognition · Computer Science 2025-06-18 Giacomo Meanti , Thomas Ryckeboer , Michael Arbel , Julien Mairal

Generic image inpainting aims to complete a corrupted image by borrowing surrounding information, which barely generates novel content. By contrast, multi-modal inpainting provides more flexible and useful controls on the inpainted content,…

Computer Vision and Pattern Recognition · Computer Science 2023-03-07 Shaoan Xie , Zhifei Zhang , Zhe Lin , Tobias Hinz , Kun Zhang

Modern diffusion-based inpainting models pose significant challenges for image forgery localization (IFL), as their full regeneration pipelines reconstruct the entire image via a latent decoder, disrupting the camera-level noise patterns…

Computer Vision and Pattern Recognition · Computer Science 2026-04-15 Paschalis Giakoumoglou , Symeon Papadopoulos

Image inpainting aims to complete the missing or corrupted regions of images with realistic contents. The prevalent approaches adopt a hybrid objective of reconstruction and perceptual quality by using generative adversarial networks.…

Computer Vision and Pattern Recognition · Computer Science 2021-07-26 Yingchen Yu , Fangneng Zhan , Shijian Lu , Jianxiong Pan , Feiying Ma , Xuansong Xie , Chunyan Miao

Video outpainting extends a video beyond its original boundaries by synthesizing missing border content. Compared with image outpainting, it requires not only per-frame spatial plausibility but also long-range temporal coherence, especially…

Computer Vision and Pattern Recognition · Computer Science 2026-01-13 Yueming Pan , Ruoyu Feng , Jianmin Bao , Chong Luo , Nanning Zheng

We present Intrinsic Image Diffusion, a generative model for appearance decomposition of indoor scenes. Given a single input view, we sample multiple possible material explanations represented as albedo, roughness, and metallic maps.…

Computer Vision and Pattern Recognition · Computer Science 2024-03-22 Peter Kocsis , Vincent Sitzmann , Matthias Nießner

Diffusion-based text-to-image models have rapidly gained popularity for their ability to generate detailed and realistic images from textual descriptions. However, these models often reflect the biases present in their training data,…

Computer Vision and Pattern Recognition · Computer Science 2024-04-01 Hidir Yesiltepe , Kiymet Akdemir , Pinar Yanardag

Recent advances in image generation have made diffusion models powerful tools for creating high-quality images. However, their iterative denoising process makes understanding and interpreting their semantic latent spaces more challenging…

Computation and Language · Computer Science 2024-11-06 E. Zhixuan Zeng , Yuhao Chen , Alexander Wong