English
Related papers

Related papers: Learning Normalized Energy Models for Linear Inver…

200 papers

Many inverse problems are ill-posed and need to be complemented by prior information that restricts the class of admissible models. Bayesian approaches encode this information as prior distributions that impose generic properties on the…

Machine Learning · Computer Science 2024-12-20 Julian L. Möbius , Michael Habeck

In this work, we study the generalizability of diffusion models by looking into the hidden properties of the learned score functions, which are essentially a series of deep denoisers trained on various noise levels. We observe that as…

Machine Learning · Computer Science 2024-12-03 Xiang Li , Yixiang Dai , Qing Qu

Flow-based latent generative models such as Stable Diffusion 3 are able to generate images with remarkable quality, even enabling photorealistic text-to-image generation. Their impressive performance suggests that these models should also…

Computer Vision and Pattern Recognition · Computer Science 2025-10-13 Julius Erbach , Dominik Narnhofer , Andreas Dombos , Bernt Schiele , Jan Eric Lenssen , Konrad Schindler

This paper explores the challenges and benefits of a trainable destruction process in diffusion samplers -- diffusion-based generative models trained to sample an unnormalised density without access to data samples. Contrary to the majority…

Diffusion models have emerged as powerful learned priors for Bayesian inverse problems (BIPs). Diffusion-based solvers rely on a presumed likelihood for the observations in BIPs to guide the generation process. Likelihood misspecification…

Machine Learning · Computer Science 2026-05-12 Yiming Yang , Xiaoyuan Cheng , Yi He , Kaiyu Li , Wenxuan Yuan , Zhuo Sun

The recent emergence of diffusion models has significantly advanced the precision of learnable priors, presenting innovative avenues for addressing inverse problems. Since inverse problems inherently entail maximum a posteriori estimation,…

Machine Learning · Computer Science 2025-01-22 Jiawei Zhang , Jiaxin Zhuang , Cheng Jin , Gen Li , Yuantao Gu

Using diffusion models to solve inverse problems is a growing field of research. Current methods assume the degradation to be known and provide impressive results in terms of restoration quality and diversity. In this work, we leverage the…

Computer Vision and Pattern Recognition · Computer Science 2025-06-02 Charles Laroche , Andrés Almansa , Eva Coupete

Denoising diffusion models have emerged as a dominant approach for image generation, however they still suffer from slow convergence in training and color shift issues in sampling. In this paper, we identify that these obstacles can be…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Hu Yu , Li Shen , Jie Huang , Hongsheng Li , Feng Zhao

In this paper, we propose a unified framework of denoising score-based models in the context of graduated non-convex energy minimization. We show that for sufficiently large noise variance, the associated negative log density -- the energy…

Machine Learning · Computer Science 2023-02-22 Erich Kobler , Thomas Pock

Diffusion models have emerged as powerful tools for solving inverse problems, yet prior work has primarily focused on observations with Gaussian measurement noise, restricting their use in real-world scenarios. This limitation persists due…

Machine Learning · Statistics 2025-02-11 Alessandro Micheli , Mélodie Monod , Samir Bhatt

In recent years, denoising problems have become intertwined with the development of deep generative models. In particular, diffusion models are trained like denoisers, and the distribution they model coincide with denoising priors in the…

Compressed sensing Synthetic Aperture Radar (SAR) image formation, formulated as an inverse problem and solved with traditional iterative optimization methods can be very computationally expensive. We investigate the use of denoising…

Image and Video Processing · Electrical Eng. & Systems 2025-04-25 Odysseas Pappas , Perla Mayo , Andrew Austin , Alin Achim

Can a diffusion model trained on bedrooms recover human faces? Diffusion models are widely used as priors for inverse problems, but standard approaches usually assume a high-fidelity model trained on data that closely match the unknown…

Machine Learning · Computer Science 2026-02-02 Jing Jia , Wei Yuan , Sifan Liu , Liyue Shen , Guanyang Wang

Real-world image denoising is an extremely important image processing problem, which aims to recover clean images from noisy images captured in natural environments. In recent years, diffusion models have achieved very promising results in…

Computer Vision and Pattern Recognition · Computer Science 2023-05-09 Cheng Yang , Lijing Liang , Zhixun Su

Generative models have shown strong generation ability while efficient likelihood estimation is less explored. Energy-based models~(EBMs) define a flexible energy function to parameterize unnormalized densities efficiently but are notorious…

Machine Learning · Computer Science 2024-06-11 Cong Geng , Tian Han , Peng-Tao Jiang , Hao Zhang , Jinwei Chen , Søren Hauberg , Bo Li

Since most inverse problems arising in scientific and engineering applications are ill-posed, prior information about the solution space is incorporated, typically through regularization, to establish a well-posed problem with a unique…

Signal Processing · Electrical Eng. & Systems 2024-06-18 Carter Lyons , Raghu G. Raj , Margaret Cheney

Deep neural networks have been applied successfully to a wide variety of inverse problems arising in computational imaging. These networks are typically trained using a forward model that describes the measurement process to be inverted,…

Image and Video Processing · Electrical Eng. & Systems 2021-04-14 Davis Gilton , Gregory Ongie , Rebecca Willett

Learning probability models from data is at the heart of many machine learning endeavors, but is notoriously difficult due to the curse of dimensionality. We introduce a new framework for learning \emph{normalized} energy (log probability)…

Machine Learning · Computer Science 2026-01-16 Florentin Guth , Zahra Kadkhodaie , Eero P Simoncelli

Diffusion models have been used in cosmological applications as a generative model for fast simulations and to reconstruct underlying cosmological fields or astrophysical images from noisy data. These two tasks are often treated as…

Cosmology and Nongalactic Astrophysics · Physics 2025-02-07 Supranta S. Boruah , Michael Jacob , Bhuvnesh Jain

In recent years, deep learning-based image compression, particularly through generative models, has emerged as a pivotal area of research. Despite significant advancements, challenges such as diminished sharpness and quality in…

Image and Video Processing · Electrical Eng. & Systems 2024-09-18 Ryugo Morita , Hitoshi Nishimura , Ko Watanabe , Andreas Dengel , Jinjia Zhou