English
Related papers

Related papers: Generative Image Inpainting with Submanifold Align…

200 papers

In recent years, deep generative models, such as Generative Adversarial Network (GAN), has grabbed significant attention in the field of computer vision. This project focuses on the application of GAN in image deblurring with the aim of…

Computer Vision and Pattern Recognition · Computer Science 2023-12-18 Zhengdong Li

Generative Adversarial Networks (GANs) have proven successful for unsupervised image generation. Several works have extended GANs to image inpainting by conditioning the generation with parts of the image to be reconstructed. Despite their…

Image and Video Processing · Electrical Eng. & Systems 2020-02-05 Cyprien Ruffino , Romain Hérault , Eric Laloy , Gilles Gasso

Limited medical imaging datasets challenge deep learning models by increasing risks of overfitting and reduced generalization, particularly in Generative Adversarial Networks (GANs), where discriminators may overfit, leading to training…

Computer Vision and Pattern Recognition · Computer Science 2024-12-05 Adrian B. Chłopowiec , Adam R. Chłopowiec , Krzysztof Galus , Wojciech Cebula , Martin Tabakov

Grayscale image colorization is a fascinating application of AI for information restoration. The inherently ill-posed nature of the problem makes it even more challenging since the outputs could be multi-modal. The learning-based methods…

Computer Vision and Pattern Recognition · Computer Science 2022-08-18 Himanshu Kumar , Abeer Banerjee , Sumeet Saurav , Sanjay Singh

A major challenge in applying deep learning to medical imaging is the paucity of annotated data. This study demonstrates that synthetic colonoscopy images generated by Generative Adversarial Network (GAN) inversion can be used as training…

Image and Video Processing · Electrical Eng. & Systems 2025-07-02 Mayank Golhar , Taylor L. Bobrow , Saowanee Ngamruengphong , Nicholas J. Durr

We present a high-fidelity 3D generative adversarial network (GAN) inversion framework that can synthesize photo-realistic novel views while preserving specific details of the input image. High-fidelity 3D GAN inversion is inherently…

Computer Vision and Pattern Recognition · Computer Science 2022-11-30 Jiaxin Xie , Hao Ouyang , Jingtan Piao , Chenyang Lei , Qifeng Chen

In this paper we present several architectural and optimization recipes for generative adversarial network(GAN) based facial semantic inpainting. Current benchmark models are susceptible to initial solutions of non-convex optimization…

Computer Vision and Pattern Recognition · Computer Science 2024-10-30 Avisek Lahiri , Arnav Jain , Divyasri Nadendla , Prabir Kumar Biswas

Modern image generative models show remarkable sample quality when trained on a single domain or class of objects. In this work, we introduce a generative adversarial network that can simultaneously generate aligned image samples from…

Computer Vision and Pattern Recognition · Computer Science 2022-06-08 Seung Wook Kim , Karsten Kreis , Daiqing Li , Antonio Torralba , Sanja Fidler

The characterization of subsurface models relies on the accuracy of subsurface models which request integrating a large number of information across different sources through model conditioning, such as data conditioning and geological…

Applications · Statistics 2024-04-09 Lei Liu , Eduardo Maldonado-Cruz , Honggeun Jo , Maša Prodanović , Michael J. Pyrcz

Generative adversarial networks (GANs) have attained photo-realistic quality in image generation. However, how to best control the image content remains an open challenge. We introduce LatentKeypointGAN, a two-stage GAN which is trained…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Xingzhe He , Bastian Wandt , Helge Rhodin

3D GAN inversion projects a single image into the latent space of a pre-trained 3D GAN to achieve single-shot novel view synthesis, which requires visible regions with high fidelity and occluded regions with realism and multi-view…

Computer Vision and Pattern Recognition · Computer Science 2025-11-12 Kaitao Huang , Yan Yan , Jing-Hao Xue , Hanzi Wang

With the advancements in denoising diffusion probabilistic models (DDPMs), image inpainting has significantly evolved from merely filling information based on nearby regions to generating content conditioned on various prompts such as text,…

Computer Vision and Pattern Recognition · Computer Science 2026-02-25 Lingzhi Pan , Tong Zhang , Bingyuan Chen , Qi Zhou , Wei Ke , Sabine Süsstrunk , Mathieu Salzmann

Generative Adversarial Networks (GANs) have been widely used for the image-to-image translation task. While these models rely heavily on the labeled image pairs, recently some GAN variants have been proposed to tackle the unpaired image…

Computer Vision and Pattern Recognition · Computer Science 2019-03-18 Lei Chen , Le Wu , Zhenzhen Hu , Meng Wang

Recent work has shown that a variety of semantics emerge in the latent space of Generative Adversarial Networks (GANs) when being trained to synthesize images. However, it is difficult to use these learned semantics for real image editing.…

Computer Vision and Pattern Recognition · Computer Science 2020-07-17 Jiapeng Zhu , Yujun Shen , Deli Zhao , Bolei Zhou

While conventional depth estimation can infer the geometry of a scene from a single RGB image, it fails to estimate scene regions that are occluded by foreground objects. This limits the use of depth prediction in augmented and virtual…

Computer Vision and Pattern Recognition · Computer Science 2019-05-09 Helisa Dhamo , Keisuke Tateno , Iro Laina , Nassir Navab , Federico Tombari

Depth acquisition, based on active illumination, is essential for autonomous and robotic navigation. LiDARs (Light Detection And Ranging) with mechanical, fixed, sampling templates are commonly used in today's autonomous vehicles. An…

Computer Vision and Pattern Recognition · Computer Science 2019-08-06 Adam Wolff , Shachar Praisler , Ilya Tcenov , Guy Gilboa

In this paper, we make the first attempt to align diffusion models for image inpainting with human aesthetic standards via a reinforcement learning framework, significantly improving the quality and visual appeal of inpainted images.…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Kendong Liu , Zhiyu Zhu , Chuanhao Li , Hui Liu , Huanqiang Zeng , Junhui Hou

Training a generative model on a single image has drawn significant attention in recent years. Single image generative methods are designed to learn the internal patch distribution of a single natural image at multiple scales. These models…

Computer Vision and Pattern Recognition · Computer Science 2022-12-06 Idan Kligvasser , Tamar Rott Shaham , Noa Alkobi , Tomer Michaeli

Implicit Neural Representations (INRs) are widely used for modeling continuous 2D images, enabling high-fidelity reconstruction, super-resolution, and compression. Architectures such as SIREN, WIRE, and FINER demonstrate their ability to…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Weronika Jakubowska , Mikołaj Zieliński , Rafał Tobiasz , Krzysztof Byrski , Maciej Zięba , Dominik Belter , Przemysław Spurek

The fusion of multispectral and panchromatic images is always dubbed pansharpening. Most of the available deep learning-based pan-sharpening methods sharpen the multispectral images through a one-step scheme, which strongly depends on the…

Image and Video Processing · Electrical Eng. & Systems 2022-08-01 Yinghui Xing , Shuyuan Yang , Song Wang , Yan Zhang , Yanning Zhang