English
Related papers

Related papers: Convergence Rates for Hierarchical Gibbs Samplers

200 papers

One of the fundamental tasks of science is to find explainable relationships between observed phenomena. One approach to this task that has received attention in recent years is based on probabilistic graphical modelling with sparsity…

Machine Learning · Statistics 2014-04-16 Peter Orchard , Felix Agakov , Amos Storkey

Computing the exact likelihood of data in large Bayesian networks consisting of thousands of vertices is often a difficult task. When these models contain many deterministic conditional probability tables and when the observed values are…

Computation · Statistics 2012-06-26 Ydo Wexler , Dan Geiger

While there have been a lot of recent developments in the context of Bayesian model selection and variable selection for high dimensional linear models, there is not much work in the presence of change point in literature, unlike the…

Methodology · Statistics 2021-02-26 Nilabja Guha , Jyotishka Datta

We consider the problem of Bayesian density estimation on the positive semiline for possibly unbounded densities. We propose a hierarchical Bayesian estimator based on the gamma mixture prior which can be viewed as a location mixture. We…

Statistics Theory · Mathematics 2020-02-25 Natalia Bochkina , Judith Rousseau

We consider a generic class of log-concave, possibly random, (Gibbs) measures. We prove the concentration of an infinite family of order parameters called multioverlaps. Because they completely parametrise the quenched Gibbs measure of the…

Probability · Mathematics 2022-12-22 Jean Barbier , Dmitry Panchenko , Manuel Sáenz

Subspace learning and matrix factorization problems have great many applications in science and engineering, and efficient algorithms are critical as dataset sizes continue to grow. Many relevant problem formulations are non-convex, and in…

Numerical Analysis · Computer Science 2022-02-22 Dejiao Zhang , Laura Balzano

Consider a sequence of polynomials of bounded degree evaluated in independent Gaussian, Gamma or Beta random variables. We show that, if this sequence converges in law to a nonconstant distribution, then (i) the limit distribution is…

Probability · Mathematics 2013-05-14 Ivan Nourdin , Guillaume Poly

The Coordinate Ascent Variational Inference scheme is a popular algorithm used to compute the mean-field approximation of a probability distribution of interest. We analyze its random scan version, under log-concavity assumptions on the…

Machine Learning · Statistics 2024-09-24 Hugo Lavenant , Giacomo Zanella

We propose a new method of histogram construction, providing a fully Bayesian approach to irregular histograms. Our procedure applies Bayesian model selection to a piecewise constant model of the underlying distribution, resulting in a…

Methodology · Statistics 2026-03-13 Oskar Høgberg Simensen , Dennis Christensen , Nils Lid Hjort

We propose an exact slice sampler for Hierarchical Dirichlet process (HDP) and its associated mixture models (Teh et al., 2006). Although there are existing MCMC algorithms for sampling from the HDP, a slice sampler has been missing from…

Machine Learning · Statistics 2019-03-22 Arash A. Amini , Marina Paez , Lizhen Lin , Zahra S. Razaee

This paper investigates Frequentist consistency properties of the posterior distributions constructed via Generalized Variational Inference (GVI). A number of generic and novel strategies are given for proving consistency, relying on the…

Statistics Theory · Mathematics 2019-12-12 Jeremias Knoblauch

Solving ill-posed inverse problems by Bayesian inference has recently attracted considerable attention. Compared to deterministic approaches, the probabilistic representation of the solution by the posterior distribution can be exploited to…

Numerical Analysis · Mathematics 2016-11-03 Felix Lucka

We consider the problem of estimating the support of a measure from a finite, independent, sample. The estimators which are considered are constructed based on the empirical Christoffel function. Such estimators have been proposed for the…

Statistics Theory · Mathematics 2020-05-20 Mai Trang Vu , François Bachoc , Edouard Pauwels

For a skew normal random sequence, convergence rates of the distribution of its partial maximum to the Gumbel extreme value distribution are derived. The asymptotic expansion of the distribution of the normalized maximum is given under an…

Methodology · Statistics 2012-12-06 Xin Liao , Zuoxiang Peng , Saralees Nadarajah , Xiaoqian Wang

We employ stabilization methods and second order Poincar\'e inequalities to establish rates of multivariate normal convergence for a large class of vectors $(H_s^{(1)},...,H_s^{(m)})$, $s \geq 1$, of statistics of marked Poisson processes…

Probability · Mathematics 2021-03-02 Matthias Schulte , J. E. Yukich

We give sufficient conditions under which a random graph with a specified degree sequence is symmetric or asymmetric. In the case of bounded degree sequences, our characterisation captures the phase transition of the symmetry of the random…

Combinatorics · Mathematics 2020-04-07 Lochlan Brick , Pu Gao , Angus Southwell

This paper provides rates of convergence for empirical (generalised) barycenters on compact geodesic metric spaces under general conditions using empirical processes techniques. Our main assumption is termed a variance inequality and…

Statistics Theory · Mathematics 2019-06-03 Adil Ahidar-Coutrix , Thibaut Le Gouic , Quentin Paris

Given F:[a,b]^k\to [a,b] and a nonconstant X_0 with P(X_0\in [a,b])=1, define the hierarchical sequence of random variables {X_n}_{n\ge 0} by X_{n+1}=F(X_{n,1},...,X_{n,k}), where X_{n,i} are i.i.d. as X_n. Such sequences arise from…

Probability · Mathematics 2007-05-23 Larry Goldstein

Let $Y$ be a Gaussian vector of $\mathbb{R}^n$ of mean $s$ and diagonal covariance matrix $\Gamma$. Our aim is to estimate both $s$ and the entries $\sigma_i=\Gamma_{i,i}$, for $i=1,...,n$, on the basis of the observation of two independent…

Statistics Theory · Mathematics 2008-12-30 Xavier Gendre

The Lasso is one of the most important approaches for parameter estimation and variable selection in high dimensional linear regression. At the heart of its success is the attractive rate of convergence result even when $p$, the dimension…

Statistics Theory · Mathematics 2019-08-09 Junlong Zhao , Chenlei Leng