English
Related papers

Related papers: An algebra of Stein operators

200 papers

We present a new particle filtering algorithm for nonlinear systems in the discrete-time setting. Our algorithm is based on the Stein variational gradient descent (SVGD) framework, which is a general approach to sample from a target…

Computational Engineering, Finance, and Science · Computer Science 2021-06-22 Jiaojiao Fan , Amirhossein Taghvaei , Yongxin Chen

We develop Stein's method for the half-normal distribution and apply it to derive rates of convergence in distributional limit theorems for three statistics of the simple symmetric random walk: the maximum value, the number of returns to…

Probability · Mathematics 2015-11-24 Christian Döbler

We show that the Riemannian Gaussian distributions on symmetric spaces, introduced in recent years, are of standard random matrix type. We exploit this to compute analytically marginals of the probability density functions. This can be done…

Mathematical Physics · Physics 2021-10-29 Leonardo Santilli , Miguel Tierz

Learning a stationary diffusion amounts to estimating the parameters of a stochastic differential equation whose stationary distribution matches a target distribution. We build on the recently introduced kernel deviation from stationarity…

Machine Learning · Statistics 2026-01-30 Fabian Bleile , Sarah Lumpp , Mathias Drton

We estimate the derivative of a probability density function defined on $[0,\infty)$. For this purpose, we choose the class of kernel estimators with asymmetric gamma kernel functions. The use of gamma kernels is fruitful due to the fact…

Statistics Theory · Mathematics 2015-02-10 L. A. Markovich

We introduce a simple iterative technique for bounding derivatives of solutions of Stein equations $Lf=h-\mathbb{E}h(Z)$, where $L$ is a linear differential operator and $Z$ is the limit random variable. Given bounds on just the solutions…

Probability · Mathematics 2017-11-17 Christian Döbler , Robert E. Gaunt , Sebastian J. Vollmer

We review some probabilistic properties of the sum-of-digits function of random integers. New asymptotic approximations to the total variation distance and its refinements are also derived. Four different approaches are used: a classical…

Probability · Mathematics 2014-10-14 Louis H. Y. Chen , Hsien-Kuei Hwang , Vytas Zacharovas

We establish inequalities for assessing the distance between the distribution of errors of partially observed high-frequency statistics of multidimensional L\'evy processes and that of a mixed Gaussian random variable. Furthermore, we…

Probability · Mathematics 2025-04-14 Chiara Amorino , Arturo Jaramillo , Mark Podolskij

The generalized hyperbolic (GH) distributions form a five parameter family of probability distributions that includes many standard distributions as special or limiting cases, such as the generalized inverse Gaussian distribution, Student's…

Probability · Mathematics 2017-12-15 Robert E. Gaunt

Implicit models, which allow for the generation of samples but not for point-wise evaluation of probabilities, are omnipresent in real-world problems tackled by machine learning and a hot topic of current research. Some examples include…

Machine Learning · Statistics 2018-04-27 Yingzhen Li , Richard E. Turner

In this paper, we explore some links between transforms derived by Stein's method and concentration inequalities. In particular, we show that the stochastic domination of the zero bias transform of a random variable is equivalent to…

Probability · Mathematics 2022-11-24 Santiago Arenas-Velilla , Emilien Joly

As more of topology's tools become popular in analyzing high dimensional data sets, the goal of understanding the underlying probabilistic properties of these tools becomes even more important. While much attention has been given to…

Algebraic Topology · Mathematics 2018-08-07 Matthew Zabka

We apply concepts of random differential geometry connected to the random matrix ensembles of the random linear operators acting on finite dimensional Hilbert spaces. The values taken by random linear operators belong to the Liouville…

Statistical Mechanics · Physics 2007-05-23 Maciej M. Duras

We use Stein characterisations to derive new moment-type estimators for the parameters of several truncated multivariate distributions in the i.i.d. case; we also derive the asymptotic properties of these estimators. Our examples include…

Statistics Theory · Mathematics 2024-06-18 Adrian Fischer , Robert E. Gaunt , Yvik Swan

We propose a novel adaptive importance sampling algorithm which incorporates Stein variational gradient decent algorithm (SVGD) with importance sampling (IS). Our algorithm leverages the nonparametric transforms in SVGD to iteratively…

Machine Learning · Statistics 2017-07-26 Jun Han , Qiang Liu

For a sample of absolutely bounded i.i.d. random variables with a continuous density the cumulative distribution function of the sample variance is represented by a univariate integral over a Fourier series. If the density is a polynomial…

Statistics Theory · Mathematics 2008-10-10 T. Royen

Stochastic Gradient Descent (SGD) is an important algorithm in machine learning. With constant learning rates, it is a stochastic process that, after an initial phase of convergence, generates samples from a stationary distribution. We show…

Machine Learning · Statistics 2017-09-12 Stephan Mandt , Matthew D. Hoffman , David M. Blei

Stein discrepancies (SDs) monitor convergence and non-convergence in approximate inference when exact integration and sampling are intractable. However, the computation of a Stein discrepancy can be prohibitive if the Stein operator - often…

Machine Learning · Statistics 2020-10-26 Jackson Gorham , Anant Raj , Lester Mackey

We study the convergence of Bernstein type operators leading to two results. The first: The kernel $K_n$ of the Bernstein-Durrmeyer operator at each point $x \in (0, 1)$ $\unicode{x2013}$ that is $K_n(x, t) dt$ $\unicode{x2013}$ once…

Classical Analysis and ODEs · Mathematics 2023-12-05 Mohammed Taariq Mowzer

We study Schroedinger operators with a random potential of alloy type. The single site potentials are allowed to change sign. For a certain class of them we prove a Wegner estimate. This is a key ingredient in an existence proof of pure…

Mathematical Physics · Physics 2018-09-28 Ivan Veselic'