中文
相关论文

相关论文: Modeling Score Approximation Errors in Diffusion M…

200 篇论文

In this paper we analyze the behaviour of the stochastic gradient descent (SGD), a widely used method in supervised learning for optimizing neural network weights via a minimization of non-convex loss functions. Since the pioneering work of…

机器学习 · 计算机科学 2025-05-13 Davide Barbieri , Matteo Bonforte , Peio Ibarrondo

This work introduces the generative fractional diffusion model for protein generation (ProT-GFDM), a novel generative framework that employs fractional stochastic dynamics for protein backbone structure modeling. This approach builds on the…

定量方法 · 定量生物学 2025-05-01 Xiao Liang , Wentao Ma , Eric Paquet , Herna Lydia Viktor , Wojtek Michalowski

Score-based Generative Models (SGMs) aim to sample from a target distribution by learning score functions using samples perturbed by Gaussian noise. Existing convergence bounds for SGMs in the W2-distance rely on stringent assumptions about…

机器学习 · 统计学 2025-12-12 Marta Gentiloni-Silveri , Antonio Ocello

Implicit generative modeling (IGM) aims to produce samples of synthetic data matching the characteristics of a target data distribution. Recent work (e.g. score-matching networks, diffusion models) has approached the IGM problem from the…

机器学习 · 计算机科学 2026-05-21 Romann M. Weber

Score-based generative models (SGMs) need to approximate the scores $\nabla \log p_t$ of the intermediate distributions as well as the final distribution $p_T$ of the forward process. The theoretical underpinnings of the effects of these…

机器学习 · 统计学 2022-10-18 Jakiw Pidstrigach

Policy targets evolve faster than the Coupled Model Intercomparison Project cycles, complicating adaptation and mitigation planning that must often contend with outdated projections. Climate model output emulators address this gap by…

大气与海洋物理 · 物理学 2026-04-14 Shahine Bouabid , Andre Nogueira Souza , Raffaele Ferrari

Score-based generative models (SGMs) have emerged as one of the most popular classes of generative models. A substantial body of work now exists on the analysis of SGMs, focusing either on discretization aspects or on their statistical…

机器学习 · 统计学 2026-02-10 Benjamin Dupuis , Dario Shariatian , Maxime Haddouche , Alain Durmus , Umut Simsekli

We introduce a guided stochastic sampling method that augments sampling from diffusion models with physics-based guidance derived from partial differential equation (PDE) residuals and observational constraints, ensuring generated samples…

机器学习 · 计算机科学 2026-05-28 Andrew Millard , Fredrik Lindsten , Zheng Zhao

We introduce Sequential Neural Posterior Score Estimation (SNPSE), a score-based method for Bayesian inference in simulator-based models. Our method, inspired by the remarkable success of score-based methods in generative modelling,…

机器学习 · 统计学 2024-06-04 Louis Sharrock , Jack Simons , Song Liu , Mark Beaumont

Recent developments in generative modeling have utilized score-based methods coupled with stochastic differential equations to sample from complex probability distributions. However, these and other performant sampling methods generally…

机器学习 · 计算机科学 2025-06-03 Bryan Riel , Tobias Bischoff

Graph structures offer a versatile framework for representing diverse patterns in nature and complex systems, applicable across domains like molecular chemistry, social networks, and transportation systems. While diffusion models have…

机器学习 · 计算机科学 2024-06-10 Adrien Carrel

Score-based generative models can effectively learn the distribution of data by estimating the gradient of the distribution. Due to the multi-step denoising characteristic, researchers have recently considered combining score-based…

机器学习 · 计算机科学 2024-12-17 Changyuan Zhao , Hongyang Du , Guangyuan Liu , Dusit Niyato

We introduce an approach for analyzing the responses of dynamical systems to external perturbations that combines score-based generative modeling with the Generalized Fluctuation-Dissipation Theorem (GFDT). The methodology enables accurate…

数据分析、统计与概率 · 物理学 2024-11-11 Ludovico Theo Giorgini , Katherine Deck , Tobias Bischoff , Andre Souza

This paper introduces a new approach to generating sample paths of unknown Markovian stochastic differential equations (SDEs) using diffusion models, a class of generative AI methods commonly employed in image and video applications. Unlike…

机器学习 · 计算机科学 2026-03-17 Xuefeng Gao , Jiale Zha , Xun Yu Zhou

Score-based (denoising diffusion) generative models have recently gained a lot of success in generating realistic and diverse data. These approaches define a forward diffusion process for transforming data to noise and generate data by…

机器学习 · 计算机科学 2021-06-01 Alexia Jolicoeur-Martineau , Ke Li , Rémi Piché-Taillefer , Tal Kachman , Ioannis Mitliagkas

In this paper, we use a stochastic partial differential equation (SPDE) as a model for the density of a population under the influence of random external forces/stimuli given by the environment. We study statistical properties for two…

Score-based diffusion models learn to reverse a stochastic differential equation that maps data to noise. However, for complex tasks, numerical error can compound and result in highly unnatural samples. Previous work mitigates this drift…

机器学习 · 统计学 2023-06-12 Aaron Lou , Stefano Ermon

This work proposes stochastic partial differential equations (SPDEs) as a practical tool to replicate clustering effects of more detailed particle-based dynamics. Inspired by membrane-mediated receptor dynamics on cell surfaces, we…

Diffusion models play a pivotal role in contemporary generative modeling, claiming state-of-the-art performance across various domains. Despite their superior sample quality, mainstream diffusion-based stochastic samplers like DDPM often…

机器学习 · 统计学 2024-10-08 Yuchen Wu , Yuxin Chen , Yuting Wei

In recent years we have witnessed a growth in mathematics for deep learning, which has been used to solve inverse problems of partial differential equations (PDEs). However, most deep learning-based inversion methods either require paired…

数值分析 · 数学 2024-04-23 Enze Jiang , Jishen Peng , Zheng Ma , Xiong-Bin Yan