English
Related papers

Related papers: A PDE Perspective on Generative Diffusion Models

200 papers

The distortion-perception (DP) tradeoff reveals a fundamental conflict between distortion metrics (e.g., MSE and PSNR) and perceptual quality. Recent research has increasingly concentrated on evaluating denoising algorithms within the DP…

Computer Vision and Pattern Recognition · Computer Science 2025-04-04 Yuhan Wang , Suzhi Bi , Ying-Jun Angela Zhang , Xiaojun Yuan

Score-based generative models (SGMs) are a powerful class of generative models that exhibit remarkable empirical performance. Score-based generative modelling (SGM) consists of a ``noising'' stage, whereby a diffusion is used to gradually…

Machine Learning · Computer Science 2022-11-23 Valentin De Bortoli , Emile Mathieu , Michael Hutchinson , James Thornton , Yee Whye Teh , Arnaud Doucet

We introduce an approach for analyzing the responses of dynamical systems to external perturbations that combines score-based generative modeling with the Generalized Fluctuation-Dissipation Theorem (GFDT). The methodology enables accurate…

Data Analysis, Statistics and Probability · Physics 2024-11-11 Ludovico Theo Giorgini , Katherine Deck , Tobias Bischoff , Andre Souza

We propose DiffSep, a new single channel source separation method based on score-matching of a stochastic differential equation (SDE). We craft a tailored continuous time diffusion-mixing process starting from the separated sources and…

Audio and Speech Processing · Electrical Eng. & Systems 2022-11-03 Robin Scheibler , Youna Ji , Soo-Whan Chung , Jaeuk Byun , Soyeon Choe , Min-Seok Choi

Diffusion models have shown impressive performance for image generation, often times outperforming other generative models. Since their introduction, researchers have extended the powerful noise-to-image denoising pipeline to discriminative…

Image and Video Processing · Electrical Eng. & Systems 2023-12-21 Fahim Ahmed Zaman , Mathews Jacob , Amanda Chang , Kan Liu , Milan Sonka , Xiaodong Wu

Diffusion models are gaining widespread use in cutting-edge image, video, and audio generation. Score-based diffusion models stand out among these methods, necessitating the estimation of score function of the input data distribution. In…

Machine Learning · Computer Science 2024-05-24 Fangzhao Zhang , Mert Pilanci

Recent work has explored a range of model families for human motion generation, including Variational Autoencoders (VAEs), Generative Adversarial Networks (GANs), and diffusion-based models. Despite their differences, many methods rely on…

Computer Vision and Pattern Recognition · Computer Science 2025-10-15 David Björkstrand , Tiesheng Wang , Lars Bretzner , Josephine Sullivan

This work presents a physics-conditioned latent diffusion model tailored for dynamical downscaling of atmospheric data, with a focus on reconstructing high-resolution 2-m temperature fields. Building upon a pre-existing diffusion…

Machine Learning · Computer Science 2025-10-29 Paul Rosu , Muchang Bahng , Erick Jiang , Rico Zhu , Vahid Tarokh

Denoising diffusions are state-of-the-art generative models exhibiting remarkable empirical performance. They work by diffusing the data distribution into a Gaussian distribution and then learning to reverse this noising process to obtain…

Machine Learning · Statistics 2024-02-20 Joe Benton , Yuyang Shi , Valentin De Bortoli , George Deligiannidis , Arnaud Doucet

In a great number of tasks in science and engineering, the goal is to infer an unknown image from a small number of measurements collected from a known forward model describing certain sensing or imaging modality. Due to resource…

Image and Video Processing · Electrical Eng. & Systems 2024-06-13 Xingyu Xu , Yuejie Chi

Simulating turbulent flows is crucial for a wide range of applications, and machine learning-based solvers are gaining increasing relevance. However, achieving temporal stability when generalizing to longer rollout horizons remains a…

Machine Learning · Computer Science 2024-12-12 Georg Kohl , Li-Wei Chen , Nils Thuerey

We propose score dynamics (SD), a general framework for learning accelerated evolution operators with large timesteps from molecular-dynamics simulations. SD is centered around scores, or derivatives of the transition log-probability with…

Computational Physics · Physics 2024-03-08 Tim Hsu , Babak Sadigh , Vasily Bulatov , Fei Zhou

Complex systems with intricate causal dependencies challenge accurate prediction. Effective modeling requires precise physical process representation, integration of interdependent factors, and incorporation of multi-resolution…

Machine Learning · Computer Science 2025-04-08 Xuechun Li , Shan Gao , Susu Xu

We propose a framework to perform Bayesian inference using conditional score-based diffusion models to solve a class of inverse problems in mechanics involving the inference of a specimen's spatially varying material properties from noisy…

Score-based diffusion models are a recently developed framework for posterior sampling in Bayesian inverse problems with a state-of-the-art performance for severely ill-posed problems by leveraging a powerful prior distribution learned from…

Diffusion models achieve high-quality image generation but are limited by slow iterative sampling. Distillation methods alleviate this by enabling one- or few-step generation. Flow matching, originally introduced as a distinct framework,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-04 Mingyuan Zhou , Yi Gu , Huangjie Zheng , Liangchen Song , Guande He , Yizhe Zhang , Wenze Hu , Yinfei Yang

Diffusion models now set the benchmark in high-fidelity generative sampling, yet they can, in principle, be prone to memorization. In this case, their learned score overfits the finite dataset so that the reverse-time SDE samples are mostly…

Machine Learning · Computer Science 2025-05-30 Franck Gabriel , François Ged , Maria Han Veiga , Emmanuel Schertzer

Score-based generative models have emerged as a powerful approach for sampling high-dimensional probability distributions. Despite their effectiveness, their theoretical underpinnings remain relatively underdeveloped. In this work, we study…

Machine Learning · Computer Science 2025-04-22 Daniel Zhengyu Huang , Jiaoyang Huang , Zhengjiang Lin

We propose a new reinforcement learning (RL) formulation for training continuous-time score-based diffusion models for generative AI to generate samples that maximize reward functions while keeping the generated distributions close to the…

Machine Learning · Computer Science 2025-08-12 Xuefeng Gao , Jiale Zha , Xun Yu Zhou

Controllable molecular graph generation is essential for material and drug discovery, where generated molecules must satisfy diverse property constraints. While recent advances in graph diffusion models have improved generation quality,…

Machine Learning · Computer Science 2025-09-30 Anjie Qiao , Zhen Wang , Chuan Chen , DeFu Lian , Enhong Chen