中文
相关论文

相关论文: Approximation to stochastic variance reduced gradi…

200 篇论文

We propose a novel approach to analyze generalization error for discretizations of Langevin diffusion, such as the stochastic gradient Langevin dynamics (SGLD). For an $\epsilon$ tolerance of expected generalization error, it is known that…

机器学习 · 统计学 2021-02-15 Mufan Bill Li , Maxime Gazeau

We establish quantitative convergence rates for stochastic particle approximation based on Nanbu-type Monte Carlo schemes applied to a broad class of collisional kinetic models. Using coupling techniques and stability estimates in the…

数值分析 · 数学 2025-04-15 Giacomo Borghi , Lorenzo Pareschi

We develop a discrete optimal transport framework for analyzing simulated annealing algorithms on finite state spaces. Building on the discrete Wasserstein metric introduced by Maas (J. Funct. Anal., 2011), we define a generalized discrete…

数据结构与算法 · 计算机科学 2026-05-08 Yuchen He , Tianhui Jiang , Sihan Wang , Chihao Zhang

Approximate Bayesian inference estimates descriptors of an intractable target distribution - in essence, an optimization problem within a family of distributions. For example, Langevin dynamics (LD) extracts asymptotically exact samples…

机器学习 · 统计学 2021-10-11 Zheyang Shen , Markus Heinonen , Samuel Kaski

By using the heat kernel parameter expansion with respect to the frozen SDEs, the intrinsic derivative is estimated for the law of Mckean-Vlasov SDEs with respect to the initial distribution. As an application, the total variation distance…

概率论 · 数学 2020-07-01 Xing Huang , Feng-Yu Wang

Langevin simulation provides an effective way to study collisional effects in beams by reducing the six-dimensional Fokker-Planck equation to a group of stochastic ordinary differential equations. These resulting equations usually have…

加速器物理 · 物理学 2007-05-23 Ji Qiang , Salman Habib

We revisit the problem of sampling from a target distribution that has a smooth strongly log-concave density everywhere in $\mathbb R^p$. In this context, if no additional density information is available, the randomized midpoint…

统计理论 · 数学 2023-06-19 Lu Yu , Avetik Karagulyan , Arnak Dalalyan

We study a class of stochastic semilinear damped wave equations driven by additive Wiener noise. Owing to the damping term, under appropriate conditions on the nonlinearity, the solution admits a unique invariant distribution. We apply…

数值分析 · 数学 2023-06-27 Ziyi Lei , Charles-Edouard Bréhier , Siqing Gan

We present a simple approach to study the one-dimensional pressureless Euler system via adhesion dynamics in the Wasserstein space of probability measures with finite quadratic moments. Starting from a discrete system of a finite number of…

偏微分方程分析 · 数学 2014-09-16 Luca Natile , Giuseppe Savaré

The autocovariance and cross-covariance functions naturally appear in many time series procedures (e.g., autoregression or prediction). Under assumptions, empirical versions of the autocovariance and cross-covariance are asymptotically…

统计理论 · 数学 2023-05-09 Andreas Anastasiou , Tobias Kley

Wasserstein gradient flows are continuous time dynamics that define curves of steepest descent to minimize an objective function over the space of probability measures (i.e., the Wasserstein space). This objective is typically a divergence…

最优化与控制 · 数学 2021-02-23 Adil Salim , Anna Korba , Giulia Luise

This paper deals with bilateral-gamma (BG) approximation to functionals of an isonormal Gaussian process. We use Malliavin-Stein method to obtain the error bounds for the smooth Wasserstein distance. As by-products, the error bounds for…

概率论 · 数学 2024-10-01 Kalyan Barman , Tomoyuki Ichiba , Palaniappan Vellaisamy

We establish a rigorous connection between pathwise (reparameterization) and score-function (Malliavin) gradient estimators by showing that both arise from the Malliavin integration-by-parts identity. Building on this equivalence, we…

机器学习 · 计算机科学 2026-02-20 Kevin D. Oden

We consider the problem of approximating the Langevin dynamics of inertial particles being transported by a background flow. In particular, we study an acceleration corrected advection-diffusion approximation to the Langevin dynamics, a…

概率论 · 数学 2026-02-24 Yoichiro Mori , Chanoknun Sintavanuruk , Truong-Son P. Van

In this paper, we construct a type of interacting particle systems to approximate a class of stochastic different equations whose coefficients depend on the conditional probability distributions of the processes given partial observations.…

概率论 · 数学 2024-03-27 Kai Du , Yunzhang Li , Yuyang Ye

This paper studies sampling error bounds for denoising diffusion probabilistic models (DDPMs) in the 2-Wasserstein distance. Our contributions are threefold. (i) Under general Lipschitz-type conditions on the score function and for a broad…

机器学习 · 统计学 2026-05-19 Yuta Koike

This paper applies several well-known tricks from the numerical treatment of deterministic differential equations to improve the efficiency of the Multilevel Monte Carlo (MLMC) method for stochastic differential equations (SDEs) and…

数值分析 · 数学 2014-12-23 Eike H. Mueller , Rob Scheichl , Tony Shardlow

In this paper we present a numerical scheme for stochastic differential equations based upon the Wiener chaos expansion. The approximation of a square integrable stochastic differential equation is obtained by cutting off the infinite chaos…

概率论 · 数学 2019-06-05 Tony Huschto , Mark Podolskij , Sebastian Sager

We investigate proximal descent methods, inspired by the minimizing movement scheme introduced by Jordan, Kinderlehrer and Otto, for optimizing entropy-regularized functionals on the Wasserstein space. We establish linear convergence under…

最优化与控制 · 数学 2024-11-25 Razvan-Andrei Lascu , Mateusz B. Majka , David Šiška , Łukasz Szpruch

We develop a new continuous-time stochastic gradient descent method for optimizing over the stationary distribution of stochastic differential equation (SDE) models. The algorithm continuously updates the SDE model's parameters using an…

机器学习 · 计算机科学 2023-08-29 Ziheng Wang , Justin Sirignano