English
Related papers

Related papers: Convergence rate of a collapsed Gibbs sampler for …

200 papers

For random matrix ensembles with non-gaussian matrix elements that may exhibit some correlations, it is shown that centered traces of polynomials in the matrix converge in distribution to a Gaussian process whose covariance matrix is…

Mathematical Physics · Physics 2009-04-24 Jeffrey Schenker , Hermann Schulz-Baldes

Joint modelling of longitudinal observations and event times continues to remain a topic of considerable interest in biomedical research. For example, in HIV studies, the longitudinal bio-marker such as CD4 cell count in a patient's blood…

Methodology · Statistics 2024-07-19 Srimanti Dutta , Arindom Chakraborty , Dipankar Bandyopadhyay

Recently there has been much interest in data that, in statistical language, may be described as having a large crossed and severely unbalanced random effects structure. Such data sets arise for recommender engines and information retrieval…

Applications · Statistics 2007-12-18 Art B. Owen

We study the asymptotic behaviour of the escape rate of a Gibbs measure supported on a conformal repeller through a small hole. There are additional applications to the convergence of Hausdorff dimension of the survivor set.

Dynamical Systems · Mathematics 2011-03-08 Andrew Ferguson , Mark Pollicott

Machine learning models are increasingly trained or fine-tuned on synthetic data. Recursively training on such data has been observed to significantly degrade performance in a wide range of tasks, often characterized by a progressive drift…

Machine Learning · Statistics 2026-02-19 Nail B. Khelifa , Richard E. Turner , Ramji Venkataramanan

In recent papers it has been demonstrated that sampling a Gibbs distribution from an appropriate time-irreversible Langevin process is, from several points of view, advantageous when compared to sampling from a time-reversible one. Adding…

Probability · Mathematics 2015-02-20 Luc Rey-Bellet , Konstantinos Spiliopoulos

We address the question of convergence in the loopy belief propagation (LBP) algorithm. Specifically, we relate convergence of LBP to the existence of a weak limit for a sequence of Gibbs measures defined on the LBP s associated computation…

Artificial Intelligence · Computer Science 2013-01-07 Sekhar Tatikonda , Michael I. Jordan

This chapter surveys the most standard Monte Carlo methods available for simulating from a posterior distribution associated with a mixture and conducts some experiments about the robustness of the Gibbs sampler in high dimensional Gaussian…

A powerful tool for the analysis of nonrandomized observational studies has been the potential outcomes model. Utilization of this framework allows analysts to estimate average treatment effects. This article considers the situation in…

Statistics Theory · Mathematics 2019-05-31 Debashis Ghosh , Efrén Cruz-Cortés

The paper is concerned with stochastic approximation procedures having three main characteristics: truncations with random moving bounds, a matrix valued random step-size sequence, and a dynamically changing random regression function. We…

Statistics Theory · Mathematics 2016-11-14 Teo Sharia , Lei Zhong

We study general coordinate-wise MCMC schemes (such as Metropolis-within-Gibbs samplers), which are commonly used to fit Bayesian non-conjugate hierarchical models. We relate their convergence properties to the ones of the corresponding…

Computation · Statistics 2026-01-12 Filippo Ascolani , Gareth O. Roberts , Giacomo Zanella

Non-linear latent variable models have become increasingly popular in a variety of applications. However, there has been little study on theoretical properties of these models. In this article, we study rates of posterior contraction in…

Statistics Theory · Mathematics 2017-01-27 Shuang Zhou , Debdeep Pati , Anirban Bhattacharya , David Dunson

Estimation of causal effects using machine learning methods has become an active research field in econometrics. In this paper, we study the finite sample performance of meta-learners for estimation of heterogeneous treatment effects under…

Econometrics · Economics 2022-02-01 Gabriel Okasa

We study the zero-range process on the complete graph. It is a Markov chain model for a microcanonical ensemble. We prove that the process converges to a fluid limit. The fluid limit rapidly relaxes to the appropriate Gibbs distribution.

Probability · Mathematics 2009-06-12 Benjamin T. Graham

We analyze equilibration times of subsystems of a larger system under a random total Hamiltonian, in which the basis of the Hamiltonian is drawn from the Haar measure. We obtain that the time of equilibration is of the order of the inverse…

The maximum a-posteriori (MAP) perturbation framework has emerged as a useful approach for inference and learning in high dimensional complex models. By maximizing a randomly perturbed potential function, MAP perturbations generate unbiased…

Machine Learning · Computer Science 2013-10-17 Francesco Orabona , Tamir Hazan , Anand D. Sarwate , Tommi Jaakkola

We consider the estimation of large covariance and precision matrices from high-dimensional sub-Gaussian or heavier-tailed observations with slowly decaying temporal dependence. The temporal dependence is allowed to be long-range so with…

Statistics Theory · Mathematics 2019-12-23 Hai Shu , Bin Nan

Mixture models are a standard tool in statistical analyses, widely used for density modeling and model-based clustering. In this work, we propose a Bayesian mixture model with repulsion between mixture components. Such repulsion helps…

Methodology · Statistics 2026-02-24 Hanxi Sun , Boqian Zhang , Minhyeok Kim , Vinayak Rao

Unlike standard linear regression, quantile regression captures the relationship between covariates and the conditional response distribution as a whole, rather than only the relationship between covariates and the expected value of the…

Methodology · Statistics 2019-11-19 Isabella N Grabski , Roberta De Vito , Barbara E Engelhardt

The MC$^3$ (Madigan and York, 1995) and Gibbs (George and McCulloch, 1997) samplers are the most widely implemented algorithms for Bayesian Model Averaging (BMA) in linear regression models. These samplers draw a variable at random in each…

Computation · Statistics 2013-06-26 Demetris Lamnisos , Jim E. Griffin , Mark F. J. Steel