English
Related papers

Related papers: Invertible generative models for inverse problems:…

200 papers

Image denoisers have been shown to be powerful priors for solving inverse problems in imaging. In this work, we introduce a generalization of these methods that allows any image restoration network to be used as an implicit prior. The…

Image and Video Processing · Electrical Eng. & Systems 2023-10-03 Yuyang Hu , Mauricio Delbracio , Peyman Milanfar , Ulugbek S. Kamilov

We present an algorithm to directly solve numerous image restoration problems (e.g., image deblurring, image dehazing, image deraining, etc.). These problems are highly ill-posed, and the common assumptions for existing methods are usually…

Computer Vision and Pattern Recognition · Computer Science 2020-03-31 Jinshan Pan , Jiangxin Dong , Yang Liu , Jiawei Zhang , Jimmy Ren , Jinhui Tang , Yu-Wing Tai , Ming-Hsuan Yang

Recent methods have shown that pre-trained diffusion models can be fine-tuned to enable generative inverse rendering by learning image-conditioned noise-to-intrinsic mapping. Despite their remarkable progress, they struggle to robustly…

Computer Vision and Pattern Recognition · Computer Science 2025-07-15 Rongjia Zheng , Qing Zhang , Chengjiang Long , Wei-Shi Zheng

Reconstructing medical images from partial measurements is an important inverse problem in Computed Tomography (CT) and Magnetic Resonance Imaging (MRI). Existing solutions based on machine learning typically train a model to directly map…

Image and Video Processing · Electrical Eng. & Systems 2022-06-17 Yang Song , Liyue Shen , Lei Xing , Stefano Ermon

Solving inverse problems without any training involves using a pretrained generative model and making appropriate modifications to the generation process to avoid finetuning of the generative model. While recent methods have explored the…

Computer Vision and Pattern Recognition · Computer Science 2024-10-22 Ashwini Pokle , Matthew J. Muckley , Ricky T. Q. Chen , Brian Karrer

Deep generative models such as GANs, normalizing flows, and diffusion models are powerful regularizers for inverse problems. They exhibit great potential for helping reduce ill-posedness and attain high-quality results. However, the latent…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Dongzhuo Li

In this paper, we propose novel generative models for creating adversarial examples, slightly perturbed images resembling natural images but maliciously crafted to fool pre-trained models. We present trainable deep neural networks for…

Computer Vision and Pattern Recognition · Computer Science 2018-07-09 Omid Poursaeed , Isay Katsman , Bicheng Gao , Serge Belongie

We develop a generative model-based approach to Bayesian inverse problems, such as image reconstruction from noisy and incomplete images. Our framework addresses two common challenges of Bayesian reconstructions: 1) It makes use of complex,…

Machine Learning · Statistics 2019-10-24 Vanessa Böhm , François Lanusse , Uroš Seljak

Deep convolutional neural networks trained on large datsets have emerged as an intriguing alternative for compressing images and solving inverse problems such as denoising and compressive sensing. However, it has only recently been realized…

Machine Learning · Computer Science 2019-07-09 Reinhard Heckel

Generative learning generates high dimensional data based on low dimensional conditions, also called prompts. Therefore, generative learning algorithms are eligible for solving (Bayesian) inverse problems. In this article we compare a…

Machine Learning · Computer Science 2026-02-02 Patrick Krüger , Patrick Materne , Werner Krebs , Hanno Gottschalk

The inverse mapping of GANs'(Generative Adversarial Nets) generator has a great potential value.Hence, some works have been developed to construct the inverse function of generator by directly learning or adversarial learning.While the…

Machine Learning · Computer Science 2017-09-13 Junyu Luo , Yong Xu , Chenwei Tang , Jiancheng Lv

We extensively study how to combine Generative Adversarial Networks and learned compression to obtain a state-of-the-art generative lossy compression system. In particular, we investigate normalization layers, generator and discriminator…

Image and Video Processing · Electrical Eng. & Systems 2020-10-26 Fabian Mentzer , George Toderici , Michael Tschannen , Eirikur Agustsson

In recent years, there have been significant advances in the use of deep learning methods in inverse problems such as denoising, compressive sensing, inpainting, and super-resolution. While this line of works has predominantly been driven…

Machine Learning · Statistics 2023-01-31 Jonathan Scarlett , Reinhard Heckel , Miguel R. D. Rodrigues , Paul Hand , Yonina C. Eldar

Medical image reconstruction is typically an ill-posed inverse problem. In order to address such ill-posed problems, the prior distribution of the sought after object property is usually incorporated by means of some sparsity-promoting…

Image and Video Processing · Electrical Eng. & Systems 2020-01-30 Sayantan Bhadra , Weimin Zhou , Mark A. Anastasio

It is tempting to think that machines are less prone to unfairness and prejudice. However, machine learning approaches compute their outputs based on data. While biases can enter at any stage of the development pipeline, models are…

Computer Vision and Pattern Recognition · Computer Science 2020-12-07 Patrick Esser , Robin Rombach , Björn Ommer

Compressive lensless imagers enable novel applications in an extremely compact device, requiring only a phase or amplitude mask placed close to the sensor. They have been demonstrated for 2D and 3D microscopy, single-shot video, and…

Image and Video Processing · Electrical Eng. & Systems 2021-06-23 Kristina Monakhova , Vi Tran , Grace Kuo , Laura Waller

Generation of photo-realistic images, semantic editing and representation learning are a few of many potential applications of high resolution generative models. Recent progress in GANs have established them as an excellent choice for such…

Computer Vision and Pattern Recognition · Computer Science 2021-12-13 Partha Ghosh , Dominik Zietlow , Michael J. Black , Larry S. Davis , Xiaochen Hu

An open secret in contemporary machine learning is that many models work beautifully on standard benchmarks but fail to generalize outside the lab. This has been attributed to biased training data, which provide poor coverage over real…

Computer Vision and Pattern Recognition · Computer Science 2020-02-18 Ali Jahanian , Lucy Chai , Phillip Isola

Recently, machine learning has been introduced in the inverse design of physical devices, i.e., the automatic generation of device geometries for a desired physical response. In particular, generative adversarial networks have been proposed…

Optics · Physics 2025-02-18 Timo Gahlmann , Philippe Tassin

Limited angle CT reconstruction is an under-determined linear inverse problem that requires appropriate regularization techniques to be solved. In this work we study how pre-trained generative adversarial networks (GANs) can be used to…

Image and Video Processing · Electrical Eng. & Systems 2020-01-30 Rushil Anirudh , Hyojin Kim , Jayaraman J. Thiagarajan , K. Aditya Mohan , Kyle M. Champley