English
Related papers

Related papers: Limit theorems for weighted and regular Multilevel…

200 papers

We propose and analyze a novel Multi-Index Monte Carlo (MIMC) method for weak approximation of stochastic models that are described in terms of differential equations either driven by random measures or with random coefficients. The MIMC…

Numerical Analysis · Mathematics 2015-03-26 Abdul-Lateef Haji-Ali , Fabio Nobile , Raul Tempone

We consider the outstanding problem of sampling from an unnormalized density that may be non-log-concave and multimodal. To enhance the performance of simple Markov chain Monte Carlo (MCMC) methods, techniques of annealing type have been…

Machine Learning · Statistics 2025-02-18 Wei Guo , Molei Tao , Yongxin Chen

This paper proposes a theory for $\ell_1$-norm penalized high-dimensional $M$-estimators, with nonconvex risk and unrestricted domain. Under high-level conditions, the estimators are shown to attain the rate of convergence…

Statistics Theory · Mathematics 2022-04-14 Jad Beyhum , François Portier

Modern computational advances have enabled easy parallel implementations of Markov chain Monte Carlo (MCMC). However, almost all work in estimating the variance of Monte Carlo averages, including the efficient batch means (BM) estimator,…

Methodology · Statistics 2024-07-23 Kushagra Gupta , Dootika Vats

Multilevel Monte Carlo (MLMC) has become an important methodology in applied mathematics for reducing the computational cost of weak approximations. For many problems, it is well-known that strong pairwise coupling of numerical solutions in…

Numerical Analysis · Mathematics 2022-10-11 Neil K. Chada , Håkon Hoel , Ajay Jasra , Georgios E. Zouraris

This paper introduces a new biased estimator for the negative binomial regression model that is a generalization of Liu-type estimator proposed for the linear model in [12]. Since the variance of the maximum likelihood estimator (MLE) is…

Methodology · Statistics 2016-04-11 Yasin Asar

This paper addresses the key challenge of estimating the asymptotic covariance associated with the Markov chain central limit theorem, which is essential for visualizing and terminating Markov Chain Monte Carlo (MCMC) simulations. We focus…

Computation · Statistics 2024-08-29 James M. Flegal , Rebecca P. Kurtz-Garcia

We develop a theoretical framework for studying numerical estimation of lower previsions, generally applicable to two-level Monte Carlo methods, importance sampling methods, and a wide range of other sampling methods one might devise. We…

Computation · Statistics 2018-07-12 Matthias C. M. Troffaes

Existence and local-uniqueness theorems for weak solutions of a system consisting of the drift-diffusion-Poisson equations and the Poisson-Boltzmann equation, all with stochastic coefficients, are presented. For the numerical approximation…

Analysis of PDEs · Mathematics 2017-04-05 Leila Taghizadeh , Amirreza Khodadadian , Clemens Heitzinger

We study the approximation of $\mathbb{E}f(X_T)$ by a Monte Carlo algorithm, where $X$ is the solution of a stochastic differential equation and $f$ is a given function. We introduce a new variance reduction method, which can be viewed as a…

Probability · Mathematics 2007-05-23 Ahmed Kebaier

Constructing unbiased estimators from Markov chain Monte Carlo (MCMC) outputs is a difficult problem that has recently received a lot of attention in the statistics and machine learning communities. However, the current unbiased MCMC…

Computation · Statistics 2022-12-27 Guanyang Wang , Tianze Wang

In this article, we propose a space-time Multi-Index Monte Carlo (MIMC) estimator for a one-dimensional parabolic stochastic partial differential equation (SPDE) of Zakai type. We compare the complexity with the Multilevel Monte Carlo…

Numerical Analysis · Mathematics 2016-12-09 Zhenru Wang , Christoph Reisinger

Hamiltonian Monte Carlo is a prominent Markov Chain Monte Carlo algorithm, which employs symplectic integrators to sample from high dimensional target distributions in many applications, such as statistical mechanics, Bayesian statistics…

Numerical Analysis · Mathematics 2025-02-13 Geoffrey McGregor , Andy T. S. Wan

Consider a central problem in randomized approximation schemes that use a Monte Carlo approach. Given a sequence of independent, identically distributed random variables $X_1,X_2,\ldots$ with mean $\mu$ and standard deviation at most $c…

Statistics Theory · Mathematics 2014-11-18 Mark Huber

In predictive modeling with simulation or machine learning, it is critical to accurately assess the quality of estimated values through output analysis. In recent decades output analysis has become enriched with methods that quantify the…

Methodology · Statistics 2023-10-27 Kimia Vahdat , Sara Shashaani

We introduce $5/2$- and $7/2$-order $L^2$-accurate randomized Runge-Kutta-Nystr\"{o}m methods, tailored for approximating Hamiltonian flows within non-reversible Markov chain Monte Carlo samplers, such as unadjusted Hamiltonian Monte Carlo…

Numerical Analysis · Mathematics 2025-02-10 Nawaf Bou-Rabee , Tore Selland Kleppe

Distributed learning methods have gained substantial momentum in recent years, with communication overhead often emerging as a critical bottleneck. Gradient compression techniques alleviate communication costs but involve an inherent…

Machine Learning · Computer Science 2025-07-09 Ze'ev Zukerman , Bassel Hamoud , Kfir Y. Levy

Recently, Giles et al. [14] proved that the efficiency of the Multilevel Monte Carlo (MLMC) method for evaluating Down-and-Out barrier options for a diffusion process $(X_t)_{t\in[0,T]}$ with globally Lipschitz coefficients, can be improved…

Probability · Mathematics 2024-09-17 Mouna Ben Derouich , Ahmed Kebaier

A simulation method based on the RG blocking is shown to yield statistical errors smaller than that of the crude MC using absolute values of the original measures. The new method is particularly suitable to apply to the sign problem of…

High Energy Physics - Lattice · Physics 2009-10-30 J. F. Markham , T. D. Kieu

A simple-to-implement weak-sense numerical method to approximate reflected stochastic differential equations (RSDEs) is proposed and analysed. It is proved that the method has the first order of weak convergence. Together with the Monte…

Numerical Analysis · Mathematics 2024-02-06 B. Leimkuhler , A. Sharma , M. V. Tretyakov