English
Related papers

Related papers: SILO: Solving Inverse Problems with Latent Operato…

200 papers

Diffusion models can be used as learned priors for solving various inverse problems. However, most existing approaches are restricted to linear inverse problems, limiting their applicability to more general cases. In this paper, we build…

Image and Video Processing · Electrical Eng. & Systems 2022-11-28 Bahjat Kawar , Jiaming Song , Stefano Ermon , Michael Elad

Diffusion models can learn strong image priors from underlying data distribution and use them to solve inverse problems, but the training process is computationally expensive and requires lots of data. Such bottlenecks prevent most existing…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Jason Hu , Bowen Song , Xiaojian Xu , Liyue Shen , Jeffrey A. Fessler

Most learning-based image compression methods lack efficiency for high image quality due to their non-invertible design. The decoding function of the frequently applied compressive autoencoder architecture is only an approximated inverse of…

Image and Video Processing · Electrical Eng. & Systems 2024-05-24 Marc Windsheimer , Fabian Brand , André Kaup

Diffusion models are powerful tools for sampling from high-dimensional distributions by progressively transforming pure noise into structured data through a denoising process. When equipped with a guidance mechanism, these models can also…

Machine Learning · Computer Science 2026-05-04 Saeed Mohseni-Sehdeh , Walid Saad , Kei Sakaguchi , Tao Yu

We study a new family of inverse problems for recovering representations of corrupted data. We assume access to a pre-trained representation learning network R(x) that operates on clean images, like CLIP. The problem is to recover the…

Machine Learning · Computer Science 2021-10-28 Sriram Ravula , Georgios Smyrnis , Matt Jordan , Alexandros G. Dimakis

Recent generative-prior-based methods have shown promising blind face restoration performance. They usually project the degraded images to the latent space and then decode high-quality faces either by single-stage latent optimization or…

Computer Vision and Pattern Recognition · Computer Science 2024-02-12 Maitreya Suin , Rama Chellappa

Diffusion models (DMs) have exhibited remarkable efficacy in various image restoration tasks. However, existing approaches typically operate within the high-dimensional pixel space, resulting in high computational overhead. While methods…

Computer Vision and Pattern Recognition · Computer Science 2026-05-15 Yang Zheng , Wen Li , Zhaoqiang Liu

We discuss the possibility to learn a data-driven explicit model correction for inverse problems and whether such a model correction can be used within a variational framework to obtain regularised reconstructions. This paper discusses the…

Numerical Analysis · Mathematics 2020-10-22 Sebastian Lunz , Andreas Hauptmann , Tanja Tarvainen , Carola-Bibiane Schönlieb , Simon Arridge

Diffusion models are extensively used for modeling image priors for inverse problems. We introduce \emph{Diff-Unfolding}, a principled framework for learning posterior score functions of \emph{conditional diffusion models} by explicitly…

Image and Video Processing · Electrical Eng. & Systems 2025-05-22 Yuanhao Wang , Shirin Shoushtari , Ulugbek S. Kamilov

Diffusion models have found phenomenal success as expressive priors for solving inverse problems, but their extension beyond natural images to more structured scientific domains remains limited. Motivated by applications in materials…

Computer Vision and Pattern Recognition · Computer Science 2024-10-08 Timofey Efimov , Harry Dong , Megna Shah , Jeff Simmons , Sean Donegan , Yuejie Chi

Diffusion models have emerged as powerful generative approaches for missing-data imputation, yet most existing methods operate directly in data space and degrade when training data are heavily incomplete. We investigate whether shifting…

Machine Learning · Computer Science 2026-05-28 Alberte Heering Estad , Ignacio Peis , Jes Frellsen

Diffusion models have recently gained traction as a powerful class of deep generative priors, excelling in a wide range of image restoration tasks due to their exceptional ability to model data distributions. To solve image restoration…

Image and Video Processing · Electrical Eng. & Systems 2025-06-10 Xiang Li , Soo Min Kwon , Shijun Liang , Ismail R. Alkhouri , Saiprasad Ravishankar , Qing Qu

There exist many forms of deep latent variable models, such as the variational autoencoder and adversarial autoencoder. Regardless of the specific class of model, there exists an implicit consensus that the latent distribution should be…

Machine Learning · Computer Science 2020-07-17 Rogan Morrow , Wei-Chen Chiu

Current deep learning methods for low-light image enhancement (LLIE) typically rely on pixel-wise mapping learned from paired data. However, these methods often overlook the importance of considering degradation representations, which can…

Computer Vision and Pattern Recognition · Computer Science 2023-07-28 Tao Wang , Kaihao Zhang , Ziqian Shao , Wenhan Luo , Bjorn Stenger , Tae-Kyun Kim , Wei Liu , Hongdong Li

Complex degradations like noise, blur, and low resolution are typical challenges in real world image fusion tasks, limiting the performance and practicality of existing methods. End to end neural network based approaches are generally…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 Yu Shi , Yu Liu , Zhong-Cheng Wu , Juan Cheng , Huafeng Li , Xun Chen

This paper aims to recover object materials from posed images captured under an unknown static lighting condition. Recent methods solve this task by optimizing material parameters through differentiable physically based rendering. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-04-24 Xi Chen , Sida Peng , Dongchen Yang , Yuan Liu , Bowen Pan , Chengfei Lv , Xiaowei Zhou

Recent advancements in image restoration increasingly employ conditional latent diffusion models (CLDMs). While these models have demonstrated notable performance improvements in recent years, this work questions their suitability for IR…

Computer Vision and Pattern Recognition · Computer Science 2024-12-16 Yunchen Yuan , Junyuan Xiao , Xinjie Li

The latent space of diffusion model mostly still remains unexplored, despite its great success and potential in the field of generative modeling. In fact, the latent space of existing diffusion models are entangled, with a distorted mapping…

Machine Learning · Computer Science 2024-07-17 Jaehoon Hahm , Junho Lee , Sunghyun Kim , Joonseok Lee

Recovering high-dimensional statistical structure from limited measurements is a fundamental challenge in hyperspectral imaging, where capturing full-resolution data is often infeasible due to sensor, bandwidth, or acquisition constraints.…

Image and Video Processing · Electrical Eng. & Systems 2025-08-01 Jonathan Monsalve , Kumar Vijay Mishra

A conditional latent-diffusion based framework for solving the electromagnetic inverse scattering problem associated with microwave imaging is introduced. This generative machine-learning model explicitly mirrors the non-uniqueness of the…

Image and Video Processing · Electrical Eng. & Systems 2025-10-30 Shirin Chehelgami , Joe LoVetri , Vahab Khoshdel