English
Related papers

Related papers: Improving Decoupled Posterior Sampling for Inverse…

200 papers

Recovering high-dimensional signals from corrupted measurements is a central challenge in inverse problems. Recent advances in generative diffusion models have shown remarkable empirical success in providing strong data-driven priors, but…

Machine Learning · Computer Science 2025-09-26 Oscar Leong , Yann Traonmilin

Denoising diffusion probabilistic models (DDPM) are a class of generative models which have recently been shown to produce excellent samples. We show that with a few simple modifications, DDPMs can also achieve competitive log-likelihoods…

Machine Learning · Computer Science 2021-02-22 Alex Nichol , Prafulla Dhariwal

Sampling from the posterior distribution poses a major computational challenge in solving inverse problems using latent diffusion models. Common methods rely on Tweedie's first-order moments, which are known to induce a quality-limiting…

Machine Learning · Computer Science 2023-12-05 Litu Rout , Yujia Chen , Abhishek Kumar , Constantine Caramanis , Sanjay Shakkottai , Wen-Sheng Chu

Denoising Probabilistic Models (DPMs) represent an emerging domain of generative models that excel in generating diverse and high-quality images. However, most current training methods for DPMs often neglect the correlation between…

Computer Vision and Pattern Recognition · Computer Science 2024-02-01 Viet Nguyen , Giang Vu , Tung Nguyen Thanh , Khoat Than , Toan Tran

We present a novel framework for enhancing the visual fidelity and consistency of text-guided 3D Gaussian Splatting (3DGS) editing. Existing editing approaches face two critical challenges: inconsistent geometric reconstructions across…

Computer Vision and Pattern Recognition · Computer Science 2025-03-17 Xuanqi Zhang , Jieun Lee , Chris Joslin , Wonsook Lee

We propose a novel sparse spectrum approximation of Gaussian process (GP) tailored for Bayesian optimization. Whilst the current sparse spectrum methods provide desired approximations for regression problems, it is observed that this…

Machine Learning · Computer Science 2020-06-09 Ang Yang , Cheng Li , Santu Rana , Sunil Gupta , Svetha Venkatesh

Diffusion probabilistic models (DPMs) are a key component in modern generative models. DPM-solvers have achieved reduced latency and enhanced quality significantly, but have posed challenges to find the exact inverse (i.e., finding the…

Computer Vision and Pattern Recognition · Computer Science 2023-12-01 Seongmin Hong , Kyeonghyun Lee , Suh Yoon Jeon , Hyewon Bae , Se Young Chun

Popularized by their strong image generation performance, diffusion and related methods for generative modeling have found widespread success in visual media applications. In particular, diffusion methods have enabled new approaches to data…

Image and Video Processing · Electrical Eng. & Systems 2026-01-28 Yibo Yang , Stephan Mandt

Diffusion Inverse Solvers (DIS) are designed to sample from the conditional distribution $p_{\theta}(X_0|y)$, with a predefined diffusion model $p_{\theta}(X_0)$, an operator $f(\cdot)$, and a measurement $y=f(x'_0)$ derived from an unknown…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Tongda Xu , Ziran Zhu , Jian Li , Dailan He , Yuanyuan Wang , Ming Sun , Ling Li , Hongwei Qin , Yan Wang , Jingjing Liu , Ya-Qin Zhang

Large denoising diffusion models, such as Stable Diffusion, have been trained on billions of image-caption pairs to perform text-conditioned image generation. As a byproduct of this training, these models have acquired general knowledge…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Alexandros Graikos , Nebojsa Jojic , Dimitris Samaras

Consistency distillation methods have demonstrated significant success in accelerating generative tasks of diffusion models. However, since previous consistency distillation methods use simple and straightforward strategies in selecting…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Cunzheng Wang , Ziyuan Guo , Yuxuan Duan , Huaxia Li , Nemo Chen , Xu Tang , Yao Hu

Diffusion models have become a standard approach for generative modeling in continuous domains, yet their application to discrete data remains challenging. We investigate why Gaussian diffusion models with the DDPM solver struggle to sample…

Computation and Language · Computer Science 2026-05-28 Alexander Shabalin , Simon Elistratov , Viacheslav Meshchaninov , Ildus Sadrtdinov , Dmitry Vetrov

In this work, we introduce a new deep learning approach based on diffusion posterior sampling (DPS) to perform material decomposition from spectral CT measurements. This approach combines sophisticated prior knowledge from unsupervised…

Image and Video Processing · Electrical Eng. & Systems 2024-02-07 Xiao Jiang , Grace J. Gang , J. Webster Stayman

Inverse problems generally require a regularizer or prior for a good solution. A recent trend is to train a convolutional net to denoise images, and use this net as a prior when solving the inverse problem. Several proposals depend on a…

Computer Vision and Pattern Recognition · Computer Science 2023-07-12 Kyle Luther , H. Sebastian Seung

We first propose a decentralized proximal stochastic gradient tracking method (DProxSGT) for nonconvex stochastic composite problems, with data heterogeneously distributed on multiple workers in a decentralized connected network. To save…

Optimization and Control · Mathematics 2023-03-01 Yonggui Yan , Jie Chen , Pin-Yu Chen , Xiaodong Cui , Songtao Lu , Yangyang Xu

Reconstructing PDE solutions from sparse observations is a core challenge in scientific computing. We present FM4PDE, a flow-matching generative framework that learns the joint distribution of PDE coefficients (or initial states) and…

Machine Learning · Statistics 2026-05-26 Xifeng Zhang , Jin Zhao

Pre-trained diffusion models have been successfully used as priors in a variety of linear inverse problems, where the goal is to reconstruct a signal from noisy linear measurements. However, existing approaches require knowledge of the…

Machine Learning · Computer Science 2023-06-28 Naoki Murata , Koichi Saito , Chieh-Hsin Lai , Yuhta Takida , Toshimitsu Uesaka , Yuki Mitsufuji , Stefano Ermon

Score-based generative models (SGMs) have recently emerged as a promising class of generative models. However, a fundamental limitation is that their inference is very slow due to a need for many (e.g., 2000) iterations of sequential…

Computer Vision and Pattern Recognition · Computer Science 2022-12-06 Hengyuan Ma , Li Zhang , Xiatian Zhu , Jianfeng Feng

Employing a forward diffusion chain to gradually map the data to a noise distribution, diffusion-based generative models learn how to generate the data by inferring a reverse diffusion chain. However, this approach is slow and costly…

Machine Learning · Statistics 2023-09-08 Huangjie Zheng , Pengcheng He , Weizhu Chen , Mingyuan Zhou

Deep Gaussian Processes (DGPs) are multi-layer, flexible extensions of Gaussian processes but their training remains challenging. Sparse approximations simplify the training but often require optimization over a large number of inducing…

Machine Learning · Statistics 2021-07-20 Ayush Jain , P. K. Srijith , Mohammad Emtiyaz Khan