中文
相关论文

相关论文: Modeling Score Approximation Errors in Diffusion M…

200 篇论文

Score-based generative models (SGMs) aim at estimating a target data distribution by learning score functions using only noise-perturbed samples from the target.Recent literature has focused extensively on assessing the error between the…

Score-based generative models (SGMs) are a powerful class of generative models that exhibit remarkable empirical performance. Score-based generative modelling (SGM) consists of a ``noising'' stage, whereby a diffusion is used to gradually…

机器学习 · 计算机科学 2022-11-23 Valentin De Bortoli , Emile Mathieu , Michael Hutchinson , James Thornton , Yee Whye Teh , Arnaud Doucet

Progressively applying Gaussian noise transforms complex data distributions to approximately Gaussian. Reversing this dynamic defines a generative model. When the forward noising process is given by a Stochastic Differential Equation (SDE),…

机器学习 · 统计学 2023-04-06 Valentin De Bortoli , James Thornton , Jeremy Heng , Arnaud Doucet

Score-based generative models have emerged as a powerful approach for sampling high-dimensional probability distributions. Despite their effectiveness, their theoretical underpinnings remain relatively underdeveloped. In this work, we study…

机器学习 · 计算机科学 2025-04-22 Daniel Zhengyu Huang , Jiaoyang Huang , Zhengjiang Lin

Generative modeling has drawn much attention in creative and scientific data generation tasks. Score-based Diffusion Models, a type of generative model that iteratively learns to denoise data, have shown state-of-the-art results on tasks…

机器人学 · 计算机科学 2024-05-21 Tyler Presser , Agnimitra Dasgupta , Daniel Erwin , Assad Oberai

Score-based generative models (SGMs) have recently demonstrated impressive results in terms of both sample quality and distribution coverage. However, they are usually applied directly in data space and often require thousands of network…

机器学习 · 统计学 2021-12-03 Arash Vahdat , Karsten Kreis , Jan Kautz

In the task of predicting spatio-temporal fields in environmental science using statistical methods, introducing statistical models inspired by the physics of the underlying phenomena that are numerically efficient is of growing interest.…

统计方法学 · 统计学 2024-07-23 Lucia Clarotto , Denis Allard , Thomas Romary , Nicolas Desassis

In this study, we propose a new method that is useful for estimating unknown parameter values of stochastic differential equation (SDE) models, based on probability density function (PDF) data measured from random dynamical systems. As our…

系统与控制 · 电气工程与系统科学 2020-10-05 Katsutoshi Yoshida , Yoshikazu Yamanaka

Inverse problems describe the process of estimating the causal factors from a set of measurements or data. Mapping of often incomplete or degraded data to parameters is ill-posed, thus data-driven iterative solutions are required, for…

人工智能 · 计算机科学 2024-06-21 Weitong Zhang , Chengqi Zang , Liu Li , Sarah Cechnicka , Cheng Ouyang , Bernhard Kainz

Traditional deterministic subgrid-scale (SGS) models are often dissipative and unstable, especially in regions of chaotic and turbulent flow. Ongoing work in climate science and ocean modeling motivates the use of stochastic SGS models for…

数值分析 · 数学 2025-04-15 Emily Williams , David Darmofal

In this work, we look at Score-based generative models (also called diffusion generative models) from a geometric perspective. From a new view point, we prove that both the forward and backward process of adding noise and generating from…

机器学习 · 计算机科学 2023-02-10 Sandesh Ghimire , Jinyang Liu , Armand Comas , Davin Hill , Aria Masoomi , Octavia Camps , Jennifer Dy

The diffusion model has shown remarkable success in computer vision, but it remains unclear whether the ODE-based probability flow or the SDE-based diffusion model is more superior and under what circumstances. Comparing the two is…

机器学习 · 计算机科学 2023-11-08 Yu Cao , Jingrun Chen , Yixin Luo , Xiang Zhou

This paper presents theoretical advances in the application of the Stochastic Partial Differential Equation (SPDE) approach in geostatistics. We show a general approach to construct stationary models related to a wide class of linear SPDEs,…

统计理论 · 数学 2018-07-30 Ricardo Carrizo Vergara , Denis Allard , Nicolas Desassis

In this paper, we investigate the stochastic evolution equations (SEEs) driven by $\log$-Whittle-Mat$\acute{{\mathrm{e}}}$rn (W-M) random diffusion coefficient field and $Q$-Wiener multiplicative force noise. First, the well-posedness of…

数值分析 · 数学 2022-07-05 X. Qi , M. Azaiez , C. Huang , C. Xu

Reinforcement Learning from Human Feedback (RLHF) is increasingly used to fine-tune diffusion models, but a key challenge arises from the mismatch between stochastic samplers used during training and deterministic samplers used during…

机器学习 · 计算机科学 2025-12-17 Jiayuan Sheng , Hanyang Zhao , Haoxian Chen , David D. Yao , Wenpin Tang

Simulating parameter-dependent stochastic differential equations (SDEs) presents significant computational challenges, as separate high-fidelity simulations are typically required for each parameter value of interest. Despite the success of…

机器学习 · 统计学 2026-02-03 Minglei Yang , Sicheng He

Diffusion-based generative models employ stochastic differential equations (SDEs) and their equivalent probability flow ordinary differential equations (ODEs) to establish a smooth transformation between complex high-dimensional data…

机器学习 · 计算机科学 2025-12-12 Defang Chen , Zhenyu Zhou , Can Wang , Siwei Lyu

We introduce a general framework for approximating parabolic Stochastic Partial Differential Equations (SPDEs) based on fluctuation-dissipation balance. Using this approach we formulate Stochastic Discontinuous Galerkin Methods (SDGM). We…

数值分析 · 数学 2023-02-28 Will Pazner , Nathaniel Trask , Paul J. Atzberger

Sampling invariant distributions from an It\^o diffusion process presents a significant challenge in stochastic simulation. Traditional numerical solvers for stochastic differential equations require both a fine step size and a lengthy…

机器学习 · 计算机科学 2025-06-06 Zhiqiang Cai , Yu Cao , Yuanfei Huang , Xiang Zhou

Reconstructing continuous physical fields from sparse measurements is a central inverse problem, but data-driven generative models can produce states that violate governing dynamics. We introduce a physics-informed generative solver that…