English
Related papers

Related papers: A Score-based Generative Solver for PDE-constraine…

200 papers

Image restoration aims to recover high-quality images from degraded observations. When the degradation process is known, the recovery problem can be formulated as an inverse problem, and in a Bayesian context, the goal is to sample a clean…

Image and Video Processing · Electrical Eng. & Systems 2025-10-13 Darshan Thaker , Abhishek Goyal , René Vidal

Generative models, such as Variational Auto-Encoder (VAE) and Generative Adversarial Network (GAN), have been successfully applied in sequential recommendation. These methods require sampling from probability distributions and adopt…

Information Retrieval · Computer Science 2023-06-23 Hanwen Du , Huanhuan Yuan , Zhen Huang , Pengpeng Zhao , Xiaofang Zhou

While score based generative models, or diffusion models, have found success in image synthesis, they are often coupled with text data or image label to be able to manipulate and conditionally generate images. Even though manipulation of…

Computer Vision and Pattern Recognition · Computer Science 2023-02-07 Sandesh Ghimire , Armand Comas , Davin Hill , Aria Masoomi , Octavia Camps , Jennifer Dy

Score-based diffusion generative models have recently emerged as a powerful tool for modelling complex data distributions. These models aim at learning the score function, which defines a map from a known probability distribution to the…

Machine Learning · Statistics 2025-11-12 Ehsan Mirafzali , Frank Proske , Utkarsh Gupta , Daniele Venturi , Razvan Marinescu

Recent studies demonstrate that diffusion models can serve as a strong prior for solving inverse problems. A prominent example is Diffusion Posterior Sampling (DPS), which approximates the posterior distribution of data given the measure…

Machine Learning · Statistics 2024-09-16 Yaxuan Zhu , Zehao Dou , Haoxin Zheng , Yasi Zhang , Ying Nian Wu , Ruiqi Gao

Diffusion Probabilistic Models (DPMs) are a well-established class of diffusion models for unconditional image generation, while SGMSE+ is a well-established conditional diffusion model for speech enhancement. One of the downsides of…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-11 Bunlong Lay , Timo Gerkmann

Inspired by the combination of feedforward and iterative computations in the virtual cortex, and taking advantage of the ability of denoising autoencoders to estimate the score of a joint distribution, we propose a novel approach to…

Computer Vision and Pattern Recognition · Computer Science 2017-08-22 Adriana Romero , Michal Drozdzal , Akram Erraqabi , Simon Jégou , Yoshua Bengio

Graph generative models have broad applications in biology, chemistry and social science. However, modelling and understanding the generative process of graphs is challenging due to the discrete and high-dimensional nature of graphs, as…

Machine Learning · Computer Science 2022-12-06 Han Huang , Leilei Sun , Bowen Du , Yanjie Fu , Weifeng Lv

Many data-driven decision problems are formulated using a nominal distribution estimated from historical data, while performance is ultimately determined by a deployment distribution that may be shifted, context-dependent, partially…

Machine Learning · Computer Science 2026-04-07 Xiuyuan Cheng , Yunqin Zhu , Yao Xie

Diffusion models have shown promising results in speech enhancement, using a task-adapted diffusion process for the conditional generation of clean speech given a noisy mixture. However, at test time, the neural network used for score…

Audio and Speech Processing · Electrical Eng. & Systems 2024-01-17 Bunlong Lay , Jean-Marie Lemercier , Julius Richter , Timo Gerkmann

Score Distillation Sampling (SDS) has been pivotal for leveraging pre-trained diffusion models in downstream tasks such as inverse problems, but it faces two major challenges: $(i)$ mode collapse and $(ii)$ latent space inversion, which…

Machine Learning · Computer Science 2024-10-15 Nicolas Zilberstein , Morteza Mardani , Santiago Segarra

Inverse problems aim to determine parameters from observations, a crucial task in engineering and science. Lately, generative models, especially diffusion models, have gained popularity in this area for their ability to produce realistic…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Gabriel della Maggiora , Luis Alberto Croquevielle , Nikita Deshpande , Harry Horsley , Thomas Heinis , Artur Yakimovich

Designing biological sequences is an important challenge that requires satisfying complex constraints and thus is a natural problem to address with deep generative modeling. Diffusion generative models have achieved considerable success in…

Machine Learning · Computer Science 2023-06-19 Pavel Avdeyev , Chenlai Shi , Yuhao Tan , Kseniia Dudnyk , Jian Zhou

This is an expository article on the score-based diffusion models, with a particular focus on the formulation via stochastic differential equations (SDE). After a gentle introduction, we discuss the two pillars in the diffusion modeling --…

Machine Learning · Computer Science 2025-07-08 Wenpin Tang , Hanyang Zhao

Diffusion models have recently shown promise as powerful generative priors for inverse problems. However, conventional applications require solving the full reverse diffusion process and operating on noisy intermediate states, which poses…

Geophysics · Physics 2025-06-13 Yuke Xie , Hervé Chauris , Nicolas Desassis

Denoising diffusion models have driven significant progress in the field of Bayesian inverse problems. Recent approaches use pre-trained diffusion models as priors to solve a wide range of such problems, only leveraging inference-time…

Machine Learning · Statistics 2025-02-06 Yazid Janati , Badr Moufad , Mehdi Abou El Qassime , Alain Durmus , Eric Moulines , Jimmy Olsson

The recent emergence of diffusion models has significantly advanced the precision of learnable priors, presenting innovative avenues for addressing inverse problems. Since inverse problems inherently entail maximum a posteriori estimation,…

Machine Learning · Computer Science 2025-01-22 Jiawei Zhang , Jiaxin Zhuang , Cheng Jin , Gen Li , Yuantao Gu

Learning a categorical distribution comes with its own set of challenges. A successful approach taken by state-of-the-art works is to cast the problem in a continuous domain to take advantage of the impressive performance of the generative…

Machine Learning · Computer Science 2023-03-09 Florence Regol , Mark Coates

Identifying the parameters of a non-linear model that best explain observed data is a core task across scientific fields. When such models rely on complex simulators, evaluating the likelihood is typically intractable, making traditional…

Inferring accurate posteriors for high-dimensional representations of the brightness of gravitationally-lensed sources is a major challenge, in part due to the difficulties of accurately quantifying the priors. Here, we report the use of a…

Instrumentation and Methods for Astrophysics · Physics 2022-11-30 Alexandre Adam , Adam Coogan , Nikolay Malkin , Ronan Legin , Laurence Perreault-Levasseur , Yashar Hezaveh , Yoshua Bengio