English
Related papers

Related papers: The Stein-Dirichlet-Malliavin method

200 papers

We propose a fast and scalable variational method for Bayesian inference in high-dimensional parameter space, which we call projected Stein variational Newton (pSVN) method. We exploit the intrinsic low-dimensional geometric structure of…

Optimization and Control · Mathematics 2020-02-11 Peng Chen , Keyi Wu , Joshua Chen , Thomas O'Leary-Roseberry , Omar Ghattas

Recently there have been increasing interests in learning and inference with implicit distributions (i.e., distributions without tractable densities). To this end, we develop a gradient estimator for implicit distributions based on Stein's…

Machine Learning · Statistics 2018-06-11 Jiaxin Shi , Shengyang Sun , Jun Zhu

A new Berry-Esseen bound for non-linear functionals of non-symmetric and non-homogeneous infinite Rademacher sequences is established. It is based on a discrete version of the Malliavin-Stein method and an analysis of the discrete…

Probability · Mathematics 2015-11-13 Kai Krokowski , Anselm Reichenbachs , Christoph Thaele

We study Langevin-type algorithms for sampling from Gibbs distributions such that the potentials are dissipative and their weak gradients have finite moduli of continuity not necessarily convergent to zero. Our main result is a…

Statistics Theory · Mathematics 2024-03-01 Shogo Nakakita

In this article, a discrete analogue of continuous Teissier distribution is presented. Its several important distributional characteristics have been derived. The estimation of the unknown parameter has been done using the method of maximum…

Methodology · Statistics 2021-10-22 Bhupendra Singh , Varun Agiwal , Ravindra Pratap Singh , Abhishek Tyagi

Narayana numbers appear in many places in combinatorics and probability, and it is known that they are asymptotically normal. Using Stein's method of exchangeable pairs, we provide an error of approximation in total variation to a symmetric…

Probability · Mathematics 2020-05-13 Jason Fulman , Adrian Röllin

Generalized sliced Wasserstein distance is a variant of sliced Wasserstein distance that exploits the power of non-linear projection through a given defining function to better capture the complex structures of the probability…

Machine Learning · Statistics 2022-10-20 Dung Le , Huy Nguyen , Khai Nguyen , Trang Nguyen , Nhat Ho

This paper provides an introduction to the Stein method framework in the context of steady-state diffusion approximations. The framework consists of three components: the Poisson equation and gradient bounds, generator coupling, and moment…

Probability · Mathematics 2017-02-21 Anton Braverman , J. G. Dai , Jiekun Feng

In this paper we propose and analyze a novel multilevel version of Stein variational gradient descent (SVGD). SVGD is a recent particle based variational inference method. For Bayesian inverse problems with computationally expensive…

Numerical Analysis · Mathematics 2024-02-05 Simon Weissmann , Jakob Zech

We establish uniform bounds on the low-order derivatives of Stein equation solutions for a broad class of multivariate, strongly log-concave target distributions. These "Stein factor" bounds deliver control over Wasserstein and related…

Probability · Mathematics 2016-11-24 Lester Mackey , Jackson Gorham

For parameter estimation of continuous and discrete distributions, we propose a generalization of the method of moments (MM), where Stein identities are utilized for improved estimation performance. The construction of these Stein-type…

Methodology · Statistics 2023-12-25 Simon Nik , Christian H. Weiß

We develop a new technique, based on Stein's method, for comparing two stationary distributions of irreducible Markov Chains whose update rules are `close enough'. We apply this technique to compare Ising models on $d$-regular expander…

Probability · Mathematics 2018-09-18 Guy Bresler , Dheeraj M. Nagaraj

We consider estimating the parametric components of semi-parametric multiple index models in a high-dimensional and non-Gaussian setting. Such models form a rich class of non-linear models with applications to signal processing, machine…

Statistics Theory · Mathematics 2018-07-19 Zhuoran Yang , Krishnakumar Balasubramanian , Han Liu

We show how it is possible to assess the rate of convergence in the Gaussian approximation of triangular arrays of $U$-statistics, built from wavelets coefficients evaluated on a homogeneous spherical Poisson field of arbitrary dimension.…

Probability · Mathematics 2017-12-20 Solesne Bourguin , Claudio Durastanti , Domenico Marinucci , Giovanni Peccati

We propose a mean-field method to calculate approximately the spacing distribution functions $p^{(n)}(s)$ in 1D classical many-particle systems. We compare our method with two other commonly used methods, the independent interval…

Statistical Mechanics · Physics 2015-01-12 Diego Luis González , Alberto Pimpinelli , T. L. Einstein

We review some probabilistic properties of the sum-of-digits function of random integers. New asymptotic approximations to the total variation distance and its refinements are also derived. Four different approaches are used: a classical…

Probability · Mathematics 2014-10-14 Louis H. Y. Chen , Hsien-Kuei Hwang , Vytas Zacharovas

We study the accuracy of a scaled Poisson approximation to the weighted sum of independent Poisson random variables, focusing on in particular the relative error of the tail distribution. A bound on the relative approximation error is…

Probability · Mathematics 2024-03-18 Yue Tan , Yingdong Lu , Cathy Xia

In Bayesian inference, the posterior distributions are difficult to obtain analytically for complex models such as neural networks. Variational inference usually uses a parametric distribution for approximation, from which we can easily…

Machine Learning · Statistics 2019-02-01 Futoshi Futami , Zhenghang Cui , Issei Sato , Masashi Sugiyama

Stein's formula states that a random variable of the form $z^\top f(z) - \text{div} f(z)$ is mean-zero for functions $f$ with integrable gradient. Here, $\text{div} f$ is the divergence of the function $f$ and $z$ is a standard normal…

Statistics Theory · Mathematics 2020-02-10 Pierre C Bellec , Cun-Hui Zhang

While the existing stochastic control theory is well equipped to handle dynamical systems with stochastic uncertainties, a paradigm shift using distance measure based decision making is required for the effective further exploration of the…

Optimization and Control · Mathematics 2025-12-02 Venkatraman Renganathan , Sei Zhen Khong
‹ Prev 1 8 9 10 Next ›