English
Related papers

Related papers: Generalizable Image Repair for Robust Visual Contr…

200 papers

We propose PixelGaussian, an efficient feed-forward framework for learning generalizable 3D Gaussian reconstruction from arbitrary views. Most existing methods rely on uniform pixel-wise Gaussian representations, which learn a fixed number…

Computer Vision and Pattern Recognition · Computer Science 2024-10-25 Xin Fei , Wenzhao Zheng , Yueqi Duan , Wei Zhan , Masayoshi Tomizuka , Kurt Keutzer , Jiwen Lu

Deep generative models provide powerful tools for distributions over complicated manifolds, such as those of natural images. But many of these methods, including generative adversarial networks (GANs), can be difficult to train, in part…

Machine Learning · Statistics 2017-11-08 Akash Srivastava , Lazar Valkov , Chris Russell , Michael U. Gutmann , Charles Sutton

We study a new family of inverse problems for recovering representations of corrupted data. We assume access to a pre-trained representation learning network R(x) that operates on clean images, like CLIP. The problem is to recover the…

Machine Learning · Computer Science 2021-10-28 Sriram Ravula , Georgios Smyrnis , Matt Jordan , Alexandros G. Dimakis

Recent GAN-based (Generative adversarial networks) inpainting methods show remarkable improvements and generate plausible images using multi-stage networks or Contextual Attention Modules (CAM). However, these techniques increase the model…

Computer Vision and Pattern Recognition · Computer Science 2021-02-16 Mohamed Abbas Hedjazi , Yakup Genc

Generative adversarial networks (GANs) have demonstrated impressive image generation quality and semantic editing capability of real images, e.g., changing object classes, modifying attributes, or transferring styles. However, applying…

Computer Vision and Pattern Recognition · Computer Science 2022-06-22 Yiran Xu , Badour AlBahar , Jia-Bin Huang

GAN inversion is indispensable for applying the powerful editability of GAN to real images. However, existing methods invert video frames individually often leading to undesired inconsistent results over time. In this paper, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2023-08-16 Yangyang Xu , Shengfeng He , Kwan-Yee K. Wong , Ping Luo

We show that pre-trained Generative Adversarial Networks (GANs) such as StyleGAN and BigGAN can be used as a latent bank to improve the performance of image super-resolution. While most existing perceptual-oriented approaches attempt to…

Computer Vision and Pattern Recognition · Computer Science 2022-08-01 Kelvin C. K. Chan , Xiangyu Xu , Xintao Wang , Jinwei Gu , Chen Change Loy

In ill-posed imaging inverse problems, there can exist many hypotheses that fit both the observed measurements and prior knowledge of the true image. Rather than returning just one hypothesis of that image, posterior samplers aim to explore…

Image and Video Processing · Electrical Eng. & Systems 2024-11-04 Matthew C. Bendel , Rizwan Ahmad , Philip Schniter

In recent years, multi-scale generative adversarial networks (GANs) have been proposed to build generalized image processing models based on single sample. Constraining on the sample size, multi-scale GANs have much difficulty converging to…

Computer Vision and Pattern Recognition · Computer Science 2022-12-01 Jing Tang , Bo Tao , Zeyu Gong , Zhouping Yin

The inherent challenge of image fusion lies in capturing the correlation of multi-source images and comprehensively integrating effective information from different sources. Most existing techniques fail to perform dynamic image fusion…

Computer Vision and Pattern Recognition · Computer Science 2024-11-06 Bing Cao , Yinan Xia , Yi Ding , Changqing Zhang , Qinghua Hu

2D images are observations of the 3D physical world depicted with the geometry, material, and illumination components. Recovering these underlying intrinsic components from 2D images, also known as inverse rendering, usually requires a…

Computer Vision and Pattern Recognition · Computer Science 2022-11-15 Xingang Pan , Ayush Tewari , Lingjie Liu , Christian Theobalt

Today's robots often interface with data-driven perception and planning models with classical model-predictive controllers (MPC). Often, such learned perception/planning models produce erroneous waypoint predictions on out-of-distribution…

Robotics · Computer Science 2022-12-06 Shubhankar Agarwal , Sandeep P. Chinchali

In image editing, the most common task is pasting objects from one image to the other and then eventually adjusting the manifestation of the foreground object with the background object. This task is called image compositing. But image…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Shivangi Aneja , Soham Mazumder

Despite the breakthroughs in quality of image enhancement, an end-to-end solution for simultaneous recovery of the finer texture details and sharpness for degraded images with low resolution is still unsolved. Some existing approaches focus…

Computer Vision and Pattern Recognition · Computer Science 2019-01-17 Soumya Shubhra Ghosh , Yang Hua , Sankha Subhra Mukherjee , Neil Robertson

The interest of the machine learning community in image synthesis has grown significantly in recent years, with the introduction of a wide range of deep generative models and means for training them. In this work, we propose a general…

Computer Vision and Pattern Recognition · Computer Science 2023-02-02 Roy Ganz , Michael Elad

Adversarial robustness is one of the most challenging problems in Deep Learning and Computer Vision research. All the state-of-the-art techniques require a time-consuming procedure that creates cleverly perturbed images. Due to its cost,…

Computer Vision and Pattern Recognition · Computer Science 2021-12-22 Matteo Terzi , Mattia Carletti , Gian Antonio Susto

Generative adversarial network (GAN) for image super-resolution (SR) has attracted enormous interests in recent years. However, the GAN-based SR methods only use image discriminator to distinguish SR images and high-resolution (HR) images.…

Computer Vision and Pattern Recognition · Computer Science 2020-03-18 Xuan Zhu , Yue Cheng , Jinye Peng , Rongzhi Wang , Mingnan Le , Xin Liu

Recent deep learning based single image super-resolution (SISR) methods mostly train their models in a clean data domain where the low-resolution (LR) and the high-resolution (HR) images come from noise-free settings (same domain) due to…

Image and Video Processing · Electrical Eng. & Systems 2020-09-09 Rao Muhammad Umer , Christian Micheloni

While learned image compression (LIC) focuses on efficient data transmission, generative image compression (GIC) extends this framework by integrating generative modeling to produce photo-realistic reconstructed images. In this paper, we…

Image and Video Processing · Electrical Eng. & Systems 2025-05-28 Minghao Han , Weiyi You , Jinhua Zhang , Leheng Zhang , Ce Zhu , Shuhang Gu

The field of image synthesis has made tremendous strides forward in the last years. Besides defining the desired output image with text-prompts, an intuitive approach is to additionally use spatial guidance in form of an image, such as a…

Computer Vision and Pattern Recognition · Computer Science 2024-08-13 Denis Zavadski , Johann-Friedrich Feiden , Carsten Rother