中文
相关论文

相关论文: Analysis of Langevin midpoint methods using an ant…

200 篇论文

Langevin MCMC gradient optimization is a class of increasingly popular methods for estimating a posterior distribution. This paper addresses the algorithm as applied in a decentralized setting, wherein data is distributed across a network…

最优化与控制 · 数学 2020-09-22 Vyacheslav Kungurtsev

Statistical models can involve implicitly defined quantities, such as solutions to nonlinear ordinary differential equations (ODEs), that unavoidably need to be numerically approximated in order to evaluate the model. The approximation…

统计计算 · 统计学 2024-09-16 Juho Timonen , Nikolas Siccha , Ben Bales , Harri Lähdesmäki , Aki Vehtari

We present a novel statistically-based discretization paradigm and derive a class of maximum a posteriori (MAP) estimators for solving ill-conditioned linear inverse problems. We are guided by the theory of sparse stochastic processes,…

信息论 · 计算机科学 2015-06-11 Emrah Bostan , Ulugbek S. Kamilov , Masih Nilchian , Michael Unser

In this article, we propose a Milstein finite difference scheme for a stochastic partial differential equation (SPDE) describing a large particle system. We show, by means of Fourier analysis, that the discretisation on an unbounded domain…

数值分析 · 数学 2012-04-09 Michael B. Giles , Christoph Reisinger

Mean-field SDEs, also known as McKean-Vlasov equations, are stochastic differential equations where the drift and diffusion depend on the current distribution in addition to the current position. We describe an efficient numerical method…

数值分析 · 数学 2017-04-25 Peter Kloeden , Tony Shardlow

We investigate solutions of backward stochastic differential equations (BSDE) with time delayed generators driven by Brownian motions and Poisson random measures, that constitute the two components of a Levy process. In this new type of…

概率论 · 数学 2010-05-27 Łukasz Delong , Peter Imkeller

This paper presents a novel stochastic optimisation methodology to perform empirical Bayesian inference in semi-blind image deconvolution problems. Given a blurred image and a parametric class of possible operators, the proposed…

应用统计 · 统计学 2024-03-12 Charlesquin Kemajou Mbakam , Marcelo Pereyra , Jean-François Giovannelli

We study the convergence analysis for general degenerate and non-reversible stochastic differential equations (SDEs). We apply the Lyapunov method to analyze the Fokker-Planck equation, in which the Lyapunov functional is chosen as a…

动力系统 · 数学 2025-02-17 Qi Feng , Wuchen Li

In this article we consider likelihood-based estimation of static parameters for a class of partially observed McKean-Vlasov (POMV) diffusion process with discrete-time observations over a fixed time interval. In particular, using the…

统计方法学 · 统计学 2024-11-12 Ajay Jasra , Mohamed Maama , Raul Tempone

In this paper, we consider the underdamped Langevin diffusion (ULD) and propose a numerical approximation using its associated ordinary differential equation (ODE). When used as a Markov Chain Monte Carlo (MCMC) algorithm, we show that the…

数值分析 · 数学 2021-01-26 James Foster , Terry Lyons , Harald Oberhauser

Stochastic gradient Markov Chain Monte Carlo (SGMCMC) is considered the gold standard for Bayesian inference in large-scale models, such as Bayesian neural networks. Since practitioners face speed versus accuracy tradeoffs in these models,…

机器学习 · 计算机科学 2022-07-19 Antonios Alexos , Alex Boyd , Stephan Mandt

This paper develops a new efficient scheme for approximations of expectations of the solutions to stochastic differential equations (SDEs). In particular, we present a method for connecting approximate operators based on an asymptotic…

概率论 · 数学 2016-05-05 Akihiko Takahashi , Toshihiro Yamada

We study Langevin-type algorithms for sampling from Gibbs distributions such that the potentials are dissipative and their weak gradients have finite moduli of continuity not necessarily convergent to zero. Our main result is a…

统计理论 · 数学 2024-03-01 Shogo Nakakita

Sampling from a target distribution is a fundamental problem. Traditional Markov chain Monte Carlo (MCMC) algorithms, such as the unadjusted Langevin algorithm (ULA), derived from the overdamped Langevin dynamics, have been extensively…

最优化与控制 · 数学 2024-10-29 Xinzhe Zuo , Stanley Osher , Wuchen Li

The main result of this article regards a small time approximation for the Girsanov's exponential. We prove that the latter is well described over short time intervals by the solution of a deterministic partial differential equation.The…

概率论 · 数学 2021-11-29 Ramiro Scorolli

We study a variation of vanilla stochastic gradient descent where the optimizer only has access to a Markovian sampling scheme. These schemes encompass applications that range from decentralized optimization with a random walker (token…

最优化与控制 · 数学 2023-06-26 Mathieu Even

Discretization of continuous-time diffusion processes is a widely recognized method for sampling. However, the canonical Euler-Maruyama discretization of the Langevin diffusion process, also named as Langevin Monte Carlo (LMC), studied…

统计计算 · 统计学 2020-10-06 Anh Duc Doan , Xin Dang , Dao Nguyen

Recent work has suggested using Monte Carlo methods based on piecewise deterministic Markov processes (PDMPs) to sample from target distributions of interest. PDMPs are non-reversible continuous-time processes endowed with momentum, and…

机器学习 · 统计学 2024-06-28 Paul Fearnhead , Sebastiano Grazzi , Chris Nemeth , Gareth O. Roberts

We generalize the multilevel Monte Carlo (MLMC) method of Giles to the simulation of systems of particles that interact via a mean field. When the number of particles is large, these systems are described by a McKean-Vlasov process - a…

数值分析 · 数学 2015-08-11 L. F. Ricketson

We establish a systematic framework of unbiased quantum sampling and estimation protocols for the classical Gibbs expectation. This framework generalizes existing approaches to the partition function estimation and has broader applications…

量子物理 · 物理学 2026-04-02 Xinmiao Li , Jin-Peng Liu