English
Related papers

Related papers: Rejoinder: Gibbs Sampling, Exponential Families an…

200 papers

Gibbs-type random probability measures and the exchangeable random partitions they induce represent the subject of a rich and active literature. They provide a probabilistic framework for a wide range of theoretical and applied problems…

Statistics Theory · Mathematics 2015-04-06 Sergio Bacallado , Stefano Favaro , Lorenzo Trippa

The problem of joint estimation of multiple graphical models from high dimensional data has been studied in the statistics and machine learning literature, due to its importance in diverse fields including molecular biology, neuroscience…

Methodology · Statistics 2019-07-04 Peyman Jalali , Kshitij Khare , George Michailidis

Gibbs random fields play an important role in statistics, however, the resulting likelihood is typically unavailable due to an intractable normalizing constant. Composite likelihoods offer a principled means to construct useful…

Statistics Theory · Mathematics 2026-02-09 Julien Stoehr , Nial Friel

We provide the first stochastic convergence rates for a family of adaptive quadrature rules used to normalize the posterior distribution in Bayesian models. Our results apply to the uniform relative error in the approximate posterior…

Methodology · Statistics 2022-10-27 Blair Bilodeau , Alex Stringer , Yanbo Tang

We consider various versions of adaptive Gibbs and Metropolis-within-Gibbs samplers, which update their selection probabilities (and perhaps also their proposal distributions) on the fly during a run by learning as they go in an attempt to…

Computation · Statistics 2013-02-28 Krzysztof Łatuszyński , Gareth O. Roberts , Jeffrey S. Rosenthal

We prove that any stable method for resolving the Gibbs phenomenon - that is, recovering high-order accuracy from the first $m$ Fourier coefficients of an analytic and nonperiodic function - can converge at best root-exponentially fast in…

Numerical Analysis · Mathematics 2013-02-04 Ben Adcock , Anders C. Hansen , Alexei Shadrin

The emergence of big data has led to so-called convergence complexity analysis, which is the study of how Markov chain Monte Carlo (MCMC) algorithms behave as the sample size, $n$, and/or the number of parameters, $p$, in the underlying…

Statistics Theory · Mathematics 2020-06-24 Bryant Davis , James P. Hobert

We study the computational complexity of estimating local observables for Gibbs distributions. A simple combinatorial example is the average size of an independent set in a graph. In a recent work, we established NP-hardness of…

Computational Complexity · Computer Science 2022-06-24 Andreas Galanis , Daniel Stefankovic , Eric Vigoda

Applications such as the analysis of microbiome data have led to renewed interest in statistical methods for compositional data, i.e., multivariate data in the form of probability vectors that contain relative proportions. In particular,…

Methodology · Statistics 2021-09-13 Shiqing Yu , Mathias Drton , Ali Shojaie

Languages for open-universe probabilistic models (OUPMs) can represent situations with an unknown number of objects and iden- tity uncertainty. While such cases arise in a wide range of important real-world appli- cations, existing general…

Artificial Intelligence · Computer Science 2012-03-19 Nimar S. Arora , Rodrigo de Salvo Braz , Erik B. Sudderth , Stuart Russell

This paper considers the objective comparison of stochastic models to solve inverse problems, more specifically image restoration. Most often, model comparison is addressed in a supervised manner, that can be time-consuming and partly…

Computation · Statistics 2020-10-14 Benjamin Harroué , Jean-François Giovannelli , Marcelo Pereyra

Gibbs sampling is a common procedure used to fit finite mixture models. However, it is known to be slow to converge when exploring correlated regions of a parameter space and so blocking correlated parameters is sometimes implemented in…

Statistics Theory · Mathematics 2024-11-04 David Michael Swanson

Diffusion models have emerged as powerful tools for solving inverse problems, yet prior work has primarily focused on observations with Gaussian measurement noise, restricting their use in real-world scenarios. This limitation persists due…

Machine Learning · Statistics 2025-02-11 Alessandro Micheli , Mélodie Monod , Samir Bhatt

We develop a general class of Bayesian repulsive Gaussian mixture models that encourage well-separated clusters, aiming at reducing potentially redundant components produced by independent priors for locations (such as the Dirichlet…

Methodology · Statistics 2017-10-24 Fangzheng Xie , Yanxun Xu

Mixture models are a standard tool in statistical analyses, widely used for density modeling and model-based clustering. In this work, we propose a Bayesian mixture model with repulsion between mixture components. Such repulsion helps…

Methodology · Statistics 2026-02-24 Hanxi Sun , Boqian Zhang , Minhyeok Kim , Vinayak Rao

In this paper, we propose a new class of distributions by exponentiating the random variables associated with the probability density functions of composite distributions. We also derive some mathematical properties of this new class of…

Methodology · Statistics 2022-04-05 Bowen Liu , Malwane M. A. Ananda

We study Bayesian estimation of mixture models and argue in favor of fitting the marginal posterior distribution over component assignments directly, rather than Gibbs sampling from the joint posterior on components and parameters as is…

Computation · Statistics 2025-11-03 M. E. J. Newman

Hierarchical Bayesian Poisson regression models (HBPRMs) provide a flexible modeling approach of the relationship between predictors and count response variables. The applications of HBPRMs to large-scale datasets require efficient…

Machine Learning · Computer Science 2024-07-03 Jin-Zhu Yu , Hiba Baroud

In mathematical finance, Levy processes are widely used for their ability to model both continuous variation and abrupt, discontinuous jumps. These jumps are practically relevant, so reliable inference on the feature that controls jump…

Statistics Theory · Mathematics 2021-09-21 Zhe Wang , Ryan Martin

Mixture models are widely used in Bayesian statistics and machine learning, in particular in computational biology, natural language processing and many other fields. Variational inference, a technique for approximating intractable…

Statistics Theory · Mathematics 2020-08-03 Badr-Eddine Chérief-Abdellatif , Pierre Alquier