English
Related papers

Related papers: Image Inpainting via Generative Multi-column Convo…

200 papers

Image extension models have broad applications in image editing, computational photography and computer graphics. While image inpainting has been extensively studied in the literature, it is challenging to directly apply the…

Computer Vision and Pattern Recognition · Computer Science 2019-08-21 Piotr Teterwak , Aaron Sarna , Dilip Krishnan , Aaron Maschinot , David Belanger , Ce Liu , William T. Freeman

Image inpainting is the process of regenerating lost parts of the image. Supervised algorithm-based methods have shown excellent results but have two significant drawbacks. They do not perform well when tested with unseen data. They fail to…

Computer Vision and Pattern Recognition · Computer Science 2023-08-28 Shubham Gupta , Rahul Kunigal Ravishankar , Madhoolika Gangaraju , Poojasree Dwarkanath , Natarajan Subramanyam

Recent methods have shown that pre-trained diffusion models can be fine-tuned to enable generative inverse rendering by learning image-conditioned noise-to-intrinsic mapping. Despite their remarkable progress, they struggle to robustly…

Computer Vision and Pattern Recognition · Computer Science 2025-07-15 Rongjia Zheng , Qing Zhang , Chengjiang Long , Wei-Shi Zheng

Recent years have witnessed some exciting developments in the domain of generating images from scene-based text descriptions. These approaches have primarily focused on generating images from a static text description and are limited to…

Computer Vision and Pattern Recognition · Computer Science 2019-05-10 Gaurav Mittal , Shubham Agrawal , Anuva Agarwal , Sushant Mehta , Tanya Marwah

In most existing learning systems, images are typically viewed as 2D pixel arrays. However, in another paradigm gaining popularity, a 2D image is represented as an implicit neural representation (INR) - an MLP that predicts an RGB pixel…

Computer Vision and Pattern Recognition · Computer Science 2021-06-29 Ivan Skorokhodov , Savva Ignatyev , Mohamed Elhoseiny

In this paper, we propose a GAN-based approach for gap filling in borehole images created by wireline microresistivity imaging tools. The proposed method utilizes a generator, global discriminator, and local discriminator to inpaint the…

Computer Vision and Pattern Recognition · Computer Science 2023-01-18 Rachid Belmeskine , Abed Benaichouche

Artistic style transfer, a captivating application of generative artificial intelligence, involves fusing the content of one image with the artistic style of another to create unique visual compositions. This paper presents a comprehensive…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Jonayet Miah , Duc M Cao , Md Abu Sayed , Md. Sabbirul Haque

Distinguishing between computer-generated (CG) and natural photographic (PG) images is of great importance to verify the authenticity and originality of digital images. However, the recent cutting-edge generation methods enable high…

Computer Vision and Pattern Recognition · Computer Science 2022-09-08 Qiang Xu , Shan Jia , Xinghao Jiang , Tanfeng Sun , Zhe Wang , Hong Yan

We present a technique to synthesize and analyze volume-rendered images using generative models. We use the Generative Adversarial Network (GAN) framework to compute a model from a large collection of volume renderings, conditioned on (1)…

Graphics · Computer Science 2019-07-18 Matthew Berger , Jixian Li , Joshua A. Levine

Image inpainting is the process of taking an image and generating lost or intentionally occluded portions. Inpainting has countless applications including restoring previously damaged pictures, restoring the quality of images that have been…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Eyoel Gebre , Krishna Saxena , Timothy Tran

Colorization methods using deep neural networks have become a recent trend. However, most of them do not allow user inputs, or only allow limited user inputs (only global inputs or only local inputs), to control the output colorful images.…

Computer Vision and Pattern Recognition · Computer Science 2018-01-30 Yi Xiao , Peiyao Zhou , Yan Zheng

This paper presents a new adversarial training framework for image inpainting with segmentation confusion adversarial training (SCAT) and contrastive learning. SCAT plays an adversarial game between an inpainting generator and a…

Computer Vision and Pattern Recognition · Computer Science 2023-08-17 Zhiwen Zuo , Lei Zhao , Ailin Li , Zhizhong Wang , Zhanjie Zhang , Jiafu Chen , Wei Xing , Dongming Lu

Generative models have demonstrated remarkable abilities in generating high-fidelity visual content. In this work, we explore how generative models can further be used not only to synthesize visual content but also to understand the…

Computer Vision and Pattern Recognition · Computer Science 2025-06-25 Yanbo Wang , Justin Dauwels , Yilun Du

Inpainting-based image compression is a promising alternative to classical transform-based lossy codecs. Typically it stores a carefully selected subset of all pixel locations and their colour values. In the decoding phase the missing…

Image and Video Processing · Electrical Eng. & Systems 2023-05-16 Ferdinand Jost , Vassillen Chizhov , Joachim Weickert

We propose a diffusion-based inverse rendering framework that decomposes a single RGB image into geometry, material, and lighting. Inverse rendering is inherently ill-posed, making it difficult to predict a single accurate solution. To…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 JunYong Choi , Min-Cheol Sagong , SeokYeong Lee , Seung-Won Jung , Ig-Jae Kim , Junghyun Cho

Image inpainting seeks a semantically consistent way to recover the corrupted image in the light of its unmasked content. Previous approaches usually reuse the well-trained GAN as effective prior to generate realistic patches for missing…

Computer Vision and Pattern Recognition · Computer Science 2022-08-26 Yongsheng Yu , Libo Zhang , Heng Fan , Tiejian Luo

Existing image inpainting methods often produce artifacts when dealing with large holes in real applications. To address this challenge, we propose an iterative inpainting method with a feedback mechanism. Specifically, we introduce a deep…

Computer Vision and Pattern Recognition · Computer Science 2020-07-15 Yu Zeng , Zhe Lin , Jimei Yang , Jianming Zhang , Eli Shechtman , Huchuan Lu

In this work, we propose a new generative model that is capable of automatically decoupling global and local representations of images in an entirely unsupervised setting, by embedding a generative flow in the VAE framework to model the…

Computer Vision and Pattern Recognition · Computer Science 2021-03-17 Xuezhe Ma , Xiang Kong , Shanghang Zhang , Eduard Hovy

In recent years, deep learning has achieved remarkable success in the field of image restoration. However, most convolutional neural network-based methods typically focus on a single scale, neglecting the incorporation of multi-scale…

Image and Video Processing · Electrical Eng. & Systems 2025-02-27 Jiatao Jiang , Zhen Cui , Chunyan Xu , Jian Yang

Generative models have made significant progress in the tasks of modeling complex data distributions such as natural images. The introduction of Generative Adversarial Networks (GANs) and auto-encoders lead to the possibility of training on…

Computer Vision and Pattern Recognition · Computer Science 2018-03-29 Tobias Hinz , Stefan Wermter