English
Related papers

Related papers: Modeling Score Approximation Errors in Diffusion M…

200 papers

Score-based generative models (SGMs) aim at estimating a target data distribution by learning score functions using only noise-perturbed samples from the target.Recent literature has focused extensively on assessing the error between the…

Statistics Theory · Mathematics 2025-01-28 Stanislas Strasman , Antonio Ocello , Claire Boyer , Sylvain Le Corff , Vincent Lemaire

Score-based generative models (SGMs) are a powerful class of generative models that exhibit remarkable empirical performance. Score-based generative modelling (SGM) consists of a ``noising'' stage, whereby a diffusion is used to gradually…

Machine Learning · Computer Science 2022-11-23 Valentin De Bortoli , Emile Mathieu , Michael Hutchinson , James Thornton , Yee Whye Teh , Arnaud Doucet

Progressively applying Gaussian noise transforms complex data distributions to approximately Gaussian. Reversing this dynamic defines a generative model. When the forward noising process is given by a Stochastic Differential Equation (SDE),…

Machine Learning · Statistics 2023-04-06 Valentin De Bortoli , James Thornton , Jeremy Heng , Arnaud Doucet

Score-based generative models have emerged as a powerful approach for sampling high-dimensional probability distributions. Despite their effectiveness, their theoretical underpinnings remain relatively underdeveloped. In this work, we study…

Machine Learning · Computer Science 2025-04-22 Daniel Zhengyu Huang , Jiaoyang Huang , Zhengjiang Lin

Generative modeling has drawn much attention in creative and scientific data generation tasks. Score-based Diffusion Models, a type of generative model that iteratively learns to denoise data, have shown state-of-the-art results on tasks…

Robotics · Computer Science 2024-05-21 Tyler Presser , Agnimitra Dasgupta , Daniel Erwin , Assad Oberai

Score-based generative models (SGMs) have recently demonstrated impressive results in terms of both sample quality and distribution coverage. However, they are usually applied directly in data space and often require thousands of network…

Machine Learning · Statistics 2021-12-03 Arash Vahdat , Karsten Kreis , Jan Kautz

In the task of predicting spatio-temporal fields in environmental science using statistical methods, introducing statistical models inspired by the physics of the underlying phenomena that are numerically efficient is of growing interest.…

Methodology · Statistics 2024-07-23 Lucia Clarotto , Denis Allard , Thomas Romary , Nicolas Desassis

In this study, we propose a new method that is useful for estimating unknown parameter values of stochastic differential equation (SDE) models, based on probability density function (PDF) data measured from random dynamical systems. As our…

Systems and Control · Electrical Eng. & Systems 2020-10-05 Katsutoshi Yoshida , Yoshikazu Yamanaka

Inverse problems describe the process of estimating the causal factors from a set of measurements or data. Mapping of often incomplete or degraded data to parameters is ill-posed, thus data-driven iterative solutions are required, for…

Artificial Intelligence · Computer Science 2024-06-21 Weitong Zhang , Chengqi Zang , Liu Li , Sarah Cechnicka , Cheng Ouyang , Bernhard Kainz

Traditional deterministic subgrid-scale (SGS) models are often dissipative and unstable, especially in regions of chaotic and turbulent flow. Ongoing work in climate science and ocean modeling motivates the use of stochastic SGS models for…

Numerical Analysis · Mathematics 2025-04-15 Emily Williams , David Darmofal

In this work, we look at Score-based generative models (also called diffusion generative models) from a geometric perspective. From a new view point, we prove that both the forward and backward process of adding noise and generating from…

Machine Learning · Computer Science 2023-02-10 Sandesh Ghimire , Jinyang Liu , Armand Comas , Davin Hill , Aria Masoomi , Octavia Camps , Jennifer Dy

The diffusion model has shown remarkable success in computer vision, but it remains unclear whether the ODE-based probability flow or the SDE-based diffusion model is more superior and under what circumstances. Comparing the two is…

Machine Learning · Computer Science 2023-11-08 Yu Cao , Jingrun Chen , Yixin Luo , Xiang Zhou

This paper presents theoretical advances in the application of the Stochastic Partial Differential Equation (SPDE) approach in geostatistics. We show a general approach to construct stationary models related to a wide class of linear SPDEs,…

Statistics Theory · Mathematics 2018-07-30 Ricardo Carrizo Vergara , Denis Allard , Nicolas Desassis

In this paper, we investigate the stochastic evolution equations (SEEs) driven by $\log$-Whittle-Mat$\acute{{\mathrm{e}}}$rn (W-M) random diffusion coefficient field and $Q$-Wiener multiplicative force noise. First, the well-posedness of…

Numerical Analysis · Mathematics 2022-07-05 X. Qi , M. Azaiez , C. Huang , C. Xu

Reinforcement Learning from Human Feedback (RLHF) is increasingly used to fine-tune diffusion models, but a key challenge arises from the mismatch between stochastic samplers used during training and deterministic samplers used during…

Machine Learning · Computer Science 2025-12-17 Jiayuan Sheng , Hanyang Zhao , Haoxian Chen , David D. Yao , Wenpin Tang

Simulating parameter-dependent stochastic differential equations (SDEs) presents significant computational challenges, as separate high-fidelity simulations are typically required for each parameter value of interest. Despite the success of…

Machine Learning · Statistics 2026-02-03 Minglei Yang , Sicheng He

Diffusion-based generative models employ stochastic differential equations (SDEs) and their equivalent probability flow ordinary differential equations (ODEs) to establish a smooth transformation between complex high-dimensional data…

Machine Learning · Computer Science 2025-12-12 Defang Chen , Zhenyu Zhou , Can Wang , Siwei Lyu

We introduce a general framework for approximating parabolic Stochastic Partial Differential Equations (SPDEs) based on fluctuation-dissipation balance. Using this approach we formulate Stochastic Discontinuous Galerkin Methods (SDGM). We…

Numerical Analysis · Mathematics 2023-02-28 Will Pazner , Nathaniel Trask , Paul J. Atzberger

Sampling invariant distributions from an It\^o diffusion process presents a significant challenge in stochastic simulation. Traditional numerical solvers for stochastic differential equations require both a fine step size and a lengthy…

Machine Learning · Computer Science 2025-06-06 Zhiqiang Cai , Yu Cao , Yuanfei Huang , Xiang Zhou

Reconstructing continuous physical fields from sparse measurements is a central inverse problem, but data-driven generative models can produce states that violate governing dynamics. We introduce a physics-informed generative solver that…

Machine Learning · Computer Science 2026-05-22 Ziyuan Zhu , Keyu Hu , Zhifei Chen , Yuhao Shi , Ming Bao , Jing Zhao , Gang Wang , Haitan Xu , Jiadong Li , Qijun Zhao , Xiaodong Li , Minghui Lu , Yanfeng Chen
‹ Prev 1 3 4 5 6 7 10 Next ›