English
Related papers

Related papers: A new method of normal approximation

200 papers

We establish a general Berry-Esseen type bound which gives optimal bounds in many situations under suitable moment assumptions. By combining the general bound with Palm theory, we deduce a new error bound for assessing the accuracy of…

Probability · Mathematics 2020-09-01 Louis H. Y. Chen , Adrian Röllin , Aihua Xia

We consider stochastic approximations of sampling algorithms, such as Stochastic Gradient Langevin Dynamics (SGLD) and the Random Batch Method (RBM) for Interacting Particle Dynamcs (IPD). We observe that the noise introduced by the…

Probability · Mathematics 2023-10-10 Aniket Das , Dheeraj Nagaraj , Anant Raj

We analyze a simple randomized subgradient method for approximating solutions to stochastic systems of convex functional constraints, the only input to the algorithm being the size of minibatches. By introducing a new notion of what is…

Optimization and Control · Mathematics 2021-08-30 James Renegar , Song Zhou

In this paper, we study a stochastic strongly convex optimization problem and propose three classes of variable sample-size stochastic first-order methods including the standard stochastic gradient descent method, its accelerated variant,…

Optimization and Control · Mathematics 2024-05-08 Jinlong Lei , Uday V. Shanbhag

We generalize the well-known zero bias distribution and the $\lambda$-Stein pair to an approximate zero bias distribution and an approximate $\lambda,R$-Stein pair, respectively. Berry Esseen type bounds to the normal, based on approximate…

Probability · Mathematics 2017-11-27 Nathakhun Wiroonsri

In the paper, a variant of the \ssstar Newton method is developed for the numerical solution of generalized equations, in which the multi-valued part is a so-called SCD (subspace containing derivative) mapping. Under a rather mild…

Numerical Analysis · Mathematics 2022-10-13 H. Gfrerer , M. Mandlmayr , J. V. Outrata , J. Valdman

We establish Cram\'er-type moderate deviation theorems for sums of locally dependent random variables and combinatorial central limit theorems. Under some mild exponential moment conditions, optimal error bounds and convergence ranges are…

Probability · Mathematics 2021-12-22 Song-Hao Liu , Zhuo-Song Zhang

Dynamical systems with $\epsilon$ small random perturbations appear in both continuous mechanical motions and discrete stochastic chemical kinetics. The present work provides a detailed analysis of the central limit theorem (CLT), with a…

Mathematical Physics · Physics 2021-03-17 Yu-Chen Cheng , Hong Qian

Bayesian inference problems require sampling or approximating high-dimensional probability distributions. The focus of this paper is on the recently introduced Stein variational gradient descent methodology, a class of algorithms that rely…

Machine Learning · Statistics 2023-02-14 A. Duncan , N. Nuesken , L. Szpruch

We develop a new formulation of Stein's method to obtain computable upper bounds on the total variation distance between the geometric distribution and a distribution of interest. Our framework reduces the problem to the construction of a…

Probability · Mathematics 2013-03-21 Erol A. Peköz , Adrian Röllin , Nathan Ross

The $k$-nearest neighbour ($k$-NN) classifier is one of the oldest and most important supervised learning algorithms for classifying datasets. Traditionally the Euclidean norm is used as the distance for the $k$-NN classifier. In this…

Machine Learning · Statistics 2015-12-02 Stan Hatko

In Stein's method, the exchangeable pair approach is commonly used to estimate the approximation errors in normal approximation. In this paper, we establish a Cram\'er-type moderate deviation theorem of normal approximation for unbounded…

Probability · Mathematics 2022-09-26 Zhuo-Song Zhang

We use a method developed by Bj\"orklund and Gorodnik to show a central limit theorem (as $T$ tends to $\infty$) for the counting functions $\# \left( \Lambda \cap \Omega_T \right)$ where $\Lambda$ ranges over the space $Y_{2d}$ of…

Number Theory · Mathematics 2023-04-18 Kristian Holm

We propose a new embedding method which is particularly well-suited for settings where the sample size greatly exceeds the ambient dimension. Our technique consists of partitioning the space into simplices and then embedding the data points…

Machine Learning · Computer Science 2020-02-07 Lee-Ad Gottlieb , Eran Kaufman , Aryeh Kontorovich , Gabriel Nivasch , Ofir Pele

We consider a system of differential equations in a fast long range dependent random environment and prove a homogenization theorem involving multiple scaling constants. The effective dynamics solves a rough differential equation, which is…

Probability · Mathematics 2019-12-02 Johann Gehringer , Xue-Mei Li

The paper starts with a concise description of the recently developed semismooth* Newton method for the solution of general inclusions. This method is then applied to a class of variational inequalities of the second kind. As a result, one…

Optimization and Control · Mathematics 2020-07-23 Helmut Gfrerer , Jiri V. Outrata , Jan Valdman

In this manuscript, we propose a general proximal quasi-Newton method tailored for nonconvex and nonsmooth optimization problems, where we do not require the sequence of the variable metric (or Hessian approximation) to be uniformly bounded…

Optimization and Control · Mathematics 2025-07-28 Xiaoxi Jia

The central limit theorem is one of the most fundamental results in probability and has been successfully extended to locally dependent data and strongly-mixing random fields. In this paper, we establish its rate of convergence for…

Probability · Mathematics 2023-09-18 Tianle Liu , Morgane Austern

We study the accuracy of a scaled Poisson approximation to the weighted sum of independent Poisson random variables, focusing on in particular the relative error of the tail distribution. A bound on the relative approximation error is…

Probability · Mathematics 2024-03-18 Yue Tan , Yingdong Lu , Cathy Xia

We investigate the snaking of localised patterns, seen in numerous physical applications, using a variational approximation. This method naturally introduces the exponentially small terms responsible for the snaking structure, that are not…

Pattern Formation and Solitons · Physics 2015-05-20 H. Susanto , P. C. Matthews