English
Related papers

Related papers: Supervised Guidance Training for Infinite-Dimensio…

200 papers

Diffusion models have emerged as powerful generative priors for high-dimensional inverse problems, yet learning them when only corrupted or noisy observations are available remains challenging. In this work, we propose a new method for…

Machine Learning · Computer Science 2025-12-23 Danial Hosseintabar , Fan Chen , Giannis Daras , Antonio Torralba , Constantinos Daskalakis

Diffusion models offer stable training and state-of-the-art performance for deep generative modeling tasks. Here, we consider their use in the context of multivariate subsurface modeling and probabilistic inversion. We first demonstrate…

Computer Vision and Pattern Recognition · Computer Science 2026-01-28 Roberto Miele , Niklas Linde

We adopt Bayesian approach to consider the inverse problem of estimate a function from noisy observations. One important component of this approach is the prior measure. Total variation prior has been proved with no discretization invariant…

Statistics Theory · Mathematics 2026-02-09 Junxiong Jia , Jigen Peng , Jinghuai Gao

How diffusion models generalize beyond their training set is not known, and is somewhat mysterious given two facts: the optimum of the denoising score matching (DSM) objective usually used to train diffusion models is the score function of…

Machine Learning · Computer Science 2025-04-18 John J. Vastola

We study nonparametric Bayesian models for reversible multi-dimensional diffusions with periodic drift. For continuous observation paths, reversibility is exploited to prove a general posterior contraction rate theorem for the drift…

Statistics Theory · Mathematics 2024-08-02 Matteo Giordano , Kolyan Ray

This article extends the framework of Bayesian inverse problems in infinite-dimensional parameter spaces, as advocated by Stuart (Acta Numer. 19:451--559, 2010) and others, to the case of a heavy-tailed prior measure in the family of stable…

Probability · Mathematics 2018-05-23 T. J. Sullivan

In the recent development of conditional diffusion models still require heavy supervised fine-tuning for performing control on a category of tasks. Training-free conditioning via guidance with off-the-shelf models is a favorable alternative…

Computer Vision and Pattern Recognition · Computer Science 2025-08-04 Christian Simon , Masato Ishii , Akio Hayakawa , Zhi Zhong , Shusuke Takahashi , Takashi Shibuya , Yuki Mitsufuji

Diffusion models are a class of probabilistic generative models that have been widely used as a prior for image processing tasks like text conditional generation and inpainting. We demonstrate that these models can be adapted to make…

Machine Learning · Computer Science 2023-06-14 Marc Finzi , Anudhyan Boral , Andrew Gordon Wilson , Fei Sha , Leonardo Zepeda-Núñez

While Bayesian inference provides a principled framework for reasoning under uncertainty, its widespread adoption is limited by the intractability of exact posterior computation, necessitating the use of approximate inference. However,…

Machine Learning · Statistics 2026-05-19 George Whittle , Juliusz Ziomek , Jacob Rawling , Maike A. Osborne

Ill-posed imaging inverse problems remain challenging due to the ambiguity in mapping degraded observations to clean images. Diffusion-based generative priors have recently shown promise, but typically rely on computationally intensive…

Image and Video Processing · Electrical Eng. & Systems 2026-02-13 Ayush Varshney , Katherine L. Bouman , Berthy T. Feng

Score-based diffusion models have emerged as one of the most promising frameworks for deep generative modelling. In this work we conduct a systematic comparison and theoretical analysis of different approaches to learning conditional…

Machine Learning · Computer Science 2021-11-29 Georgios Batzolis , Jan Stanczuk , Carola-Bibiane Schönlieb , Christian Etmann

Learning a sequence of tasks without access to i.i.d. observations is a widely studied form of continual learning (CL) that remains challenging. In principle, Bayesian learning directly applies to this setting, since recursive and one-off…

Distribution matching (DM) is a versatile domain-invariant representation learning technique that has been applied to tasks such as fair classification, domain adaptation, and domain translation. Non-parametric DM methods struggle with…

Machine Learning · Computer Science 2025-06-18 Ziyu Gong , Jim Lim , David I. Inouye

Blind face restoration methods have shown remarkable performance, particularly when trained on large-scale synthetic datasets with supervised learning. These datasets are often generated by simulating low-quality face images with a…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Tianshu Kuai , Sina Honari , Igor Gilitschenski , Alex Levinshtein

Conventional score-based diffusion models (DMs) may struggle with anisotropic Gaussian diffusion processes due to the required inversion of covariance matrices in the denoising score matching training objective…

Image and Video Processing · Electrical Eng. & Systems 2025-11-18 Jeffrey Alido , Tongyu Li , Yu Sun , Lei Tian

Curse of Dimensionality is an unavoidable challenge in statistical probability models, yet diffusion models seem to overcome this limitation, achieving impressive results in high-dimensional data generation. Diffusion models assume that…

Machine Learning · Statistics 2025-10-01 Zhenxin Zheng , Zhenjie Zheng

Diffusion Models have demonstrated remarkable capabilities in handling inverse problems, offering high-quality posterior-sampling-based solutions. Despite significant advances, a fundamental trade-off persists regarding the way the…

Computer Vision and Pattern Recognition · Computer Science 2025-11-20 Noam Elata , Hyungjin Chung , Jong Chul Ye , Tomer Michaeli , Michael Elad

Understanding how adult humans learn non-native speech categories such as tone information has shed novel insights into the mechanisms underlying experience-dependent brain plasticity. Scientists have traditionally examined these questions…

Methodology · Statistics 2020-06-16 Giorgio Paulon , Fernando Llanos , Bharath Chandrasekaran , Abhra Sarkar

Autoregressive video diffusion models hold promise for world simulation but are vulnerable to exposure bias arising from the train-test mismatch. While recent works address this via post-training, they typically rely on a bidirectional…

Computer Vision and Pattern Recognition · Computer Science 2025-12-18 Yuwei Guo , Ceyuan Yang , Hao He , Yang Zhao , Meng Wei , Zhenheng Yang , Weilin Huang , Dahua Lin

Diffusion models optimized via variational inference (VI) have emerged as a promising tool for generating samples from unnormalized target densities. These models create samples by simulating a stochastic differential equation, starting…

Machine Learning · Computer Science 2025-03-04 Denis Blessing , Xiaogang Jia , Gerhard Neumann