中文
相关论文

相关论文: Entropic effects in large-scale Monte Carlo simula…

200 篇论文

Consider a central problem in randomized approximation schemes that use a Monte Carlo approach. Given a sequence of independent, identically distributed random variables $X_1,X_2,\ldots$ with mean $\mu$ and standard deviation at most $c…

统计理论 · 数学 2014-11-18 Mark Huber

We consider systems of stochastic differential equations with multiple scales and small noise and assume that the coefficients of the equations are ergodic and stationary random fields. Our goal is to construct provably-efficient importance…

概率论 · 数学 2015-09-29 Konstantinos Spiliopoulos

This paper discusses some convergence properties in the entropic sampling Monte Carlo methods with multiple random walkers, particularly in the Wang-Landau (WL) and $1/t$ algorithms. The classical algorithms are modified by the use of $m$…

统计力学 · 物理学 2016-06-22 R. E. Belardinelli , V. D. Pereyra

Closed-form stochastic filtering equations can be derived in a general setting where probability distributions are replaced by some specific outer measures. In this article, we study how the principles of the sequential Monte Carlo method…

统计方法学 · 统计学 2018-05-07 Jeremie Houssineau , Branko Ristic

The problem of optimising functions with intractable gradients frequently arise in machine learning and statistics, ranging from maximum marginal likelihood estimation procedures to fine-tuning of generative models. Stochastic approximation…

机器学习 · 统计学 2026-01-30 James Cuin , Davide Carbone , Yanbo Tang , O. Deniz Akyildiz

We consider conservation laws with discontinuous flux where the initial datum, the flux function, and the discontinuous spatial dependency coefficient are subject to randomness. We establish a notion of random adapted entropy solutions to…

This work proposes an adaptive sequential Monte Carlo sampling algorithm to solve Bayesian inverse problems in scenarios where likelihood evaluations are costly but can be approximated using a surrogate model built from previous evaluations…

统计计算 · 统计学 2025-08-26 Frederic Cerou , Patrick Heas , Mathias Rousset

In several implementations of Sequential Monte Carlo (SMC) methods it is natural, and important in terms of algorithmic efficiency, to exploit the information of the history of the samples to optimally tune their subsequent propagations. In…

统计计算 · 统计学 2014-02-07 Alexandros Beskos , Ajay Jasra , Nikolas Kantas , Alexandre Thiery

In this paper we develop the large deviations principle and a rigorous mathematical framework for asymptotically efficient importance sampling schemes for general, fully dependent systems of stochastic differential equations of slow and…

概率论 · 数学 2013-01-29 Konstantinos Spiliopoulos

We give the first rigorous proof of the convergence of Riemannian Hamiltonian Monte Carlo, a general (and practical) method for sampling Gibbs distributions. Our analysis shows that the rate of convergence is bounded in terms of natural…

数据结构与算法 · 计算机科学 2017-10-18 Yin Tat Lee , Santosh S. Vempala

High-dimensional distributions, especially those with heavy tails, are notoriously difficult for off-the-shelf MCMC samplers: the combination of unbounded state spaces, diminishing gradient information, and local moves results in…

统计计算 · 统计学 2024-02-22 Jun Yang , Krzysztof Łatuszyński , Gareth O. Roberts

Sampling-based motion planning methods, while effective in high-dimensional spaces, often suffer from inefficiencies due to irregular sampling distributions, leading to suboptimal exploration of the configuration space. In this paper, we…

机器人学 · 计算机科学 2025-08-28 Makram Chahine , T. Konstantin Rusch , Zach J. Patterson , Daniela Rus

The weak law of large numbers implies that, under mild assumptions on the source, the Renyi entropy per produced symbol converges (in probability) towards the Shannon entropy rate. This paper quantifies the speed of this convergence for…

信息论 · 计算机科学 2017-05-01 Maciej Skorski

We use single-cluster Monte Carlo simulations to study the role of topological defects in the three-dimensional classical Heisenberg model on simple cubic lattices of size up to $80^3$. By applying reweighting techniques to time series…

高能物理 - 格点 · 物理学 2009-10-22 Christian Holm , Wolfhard Janke

It has been widely realized that Monte Carlo methods (approximation via a sample ensemble) may fail in large scale systems. This work offers some theoretical insight into this phenomenon in the context of the particle filter. We demonstrate…

统计理论 · 数学 2008-12-18 Thomas Bengtsson , Peter Bickel , Bo Li

We describe an embarrassingly parallel, anytime Monte Carlo method for likelihood-free models. The algorithm starts with the view that the stochasticity of the pseudo-samples generated by the simulator can be controlled externally by a…

机器学习 · 计算机科学 2015-12-03 Edward Meeds , Max Welling

This paper concerns numerical assessment of Monte Carlo error in particle filters. We show that by keeping track of certain key features of the genealogical structure arising from resampling operations, it is possible to estimate variances…

统计计算 · 统计学 2016-06-29 Anthony Lee , Nick Whiteley

Bayesian inference for models that have an intractable partition function is known as a doubly intractable problem, where standard Monte Carlo methods are not applicable. The past decade has seen the development of auxiliary variable Monte…

统计计算 · 统计学 2017-10-13 Richard G. Everitt , Dennis Prangle , Philip Maybank , Mark Bell

We investigate the properties of the Hybrid Monte-Carlo algorithm (HMC) in high dimensions. HMC develops a Markov chain reversible w.r.t. a given target distribution $\Pi$ by using separable Hamiltonian dynamics with potential $-\log\Pi$.…

Lifted samplers form a class of Markov chain Monte Carlo methods which has drawn a lot attention in recent years due to superior performance in challenging Bayesian applications. A canonical example of lifted samplers is the one that is…

统计计算 · 统计学 2026-05-01 Philippe Gagnon , Florian Maire