English
Related papers

Related papers: Rapidly Mixing Gibbs Sampling for a Class of Facto…

200 papers

The Hamiltonian Monte Carlo (HMC) algorithm is often lauded for its ability to effectively sample from high-dimensional distributions. In this paper we challenge the presumed domination of HMC for the Bayesian analysis of GLMs. By utilizing…

Variational Bayesian inference and (collapsed) Gibbs sampling are the two important classes of inference algorithms for Bayesian networks. Both have their advantages and disadvantages: collapsed Gibbs sampling is unbiased but is also…

Machine Learning · Computer Science 2012-06-18 Max Welling , Yee Whye Teh , Hilbert Kappen

Using graph neural networks for large graphs is challenging since there is no clear way of constructing mini-batches. To solve this, previous methods have relied on sampling or graph clustering. While these approaches often lead to good…

Machine Learning · Computer Science 2022-12-20 Johannes Gasteiger , Chendi Qian , Stephan Günnemann

We consider local Markov chain Monte-Carlo algorithms for sampling from the weighted distribution of independent sets with activity $\l$, where the weight of an independent set $I$ is $\l^{|I|}$. A recent result has established that Gibbs…

Probability · Mathematics 2007-05-23 Elchanan Mossel , Dror Weitz , Nicholas Wormald

The numerical representation of high-dimensional Gibbs distributions is challenging due to the curse of dimensionality manifesting through the intractable normalization constant calculations. This work addresses this challenge by performing…

Numerical Analysis · Mathematics 2025-01-30 Nan Sheng , Xun Tang , Haoxuan Chen , Lexing Ying

Many real-world networks of interest are embedded in physical space. We present a new random graph model aiming to reflect the interplay between the geometries of the graph and of the underlying space. The model favors configurations with…

Probability · Mathematics 2017-06-14 Jean-Christophe Mourrat , Daniel Valesin

Statistical modelling in the presence of data organized in groups is a crucial task in Bayesian statistics. The present paper conceives a mixture model based on a novel family of Bayesian priors designed for multilevel data and obtained by…

Methodology · Statistics 2024-07-01 Alessandro Colombi , Raffaele Argiento , Federico Camerlenghi , Lucia Paci

Many problems of interest in computer science and information theory can be phrased in terms of a probability distribution over discrete variables associated to the vertices of a large (but finite) sparse graph. In recent years,…

Probability · Mathematics 2009-11-11 Amir Dembo , Andrea Montanari

The Glauber dynamics on the colourings of a graph is a random process which consists in recolouring at each step a random vertex of a graph with a new colour chosen uniformly at random among the colours not already present in its…

Combinatorics · Mathematics 2020-11-04 Marc Heinrich

We study the spatial Gibbs random graphs introduced in [MV16] from the point of view of local convergence. These are random graphs embedded in an ambient space consisting of a line segment, defined through a probability measure that favors…

Probability · Mathematics 2017-12-12 Eric Ossami Endo , Daniel Valesin

Graph sampling via crawling has become increasingly popular and important in the study of measuring various characteristics of large scale complex networks. While powerful, it is known to be challenging when the graph is loosely connected…

Social and Information Networks · Computer Science 2014-05-21 Junzhou Zhao , John C. S. Lui , Don Towsley , Pinghui Wang , Xiaohong Guan

Monte Carlo methods are essential tools for Bayesian inference. Gibbs sampling is a well-known Markov chain Monte Carlo (MCMC) algorithm, extensively used in signal processing, machine learning, and statistics, employed to draw samples from…

Computation · Statistics 2017-12-21 Luca Martino , Victor Elvira , Gustau Camps-Valls

Hierarchical Bayesian Poisson regression models (HBPRMs) provide a flexible modeling approach of the relationship between predictors and count response variables. The applications of HBPRMs to large-scale datasets require efficient…

Machine Learning · Computer Science 2024-07-03 Jin-Zhu Yu , Hiba Baroud

Given a countable graph $\mathcal{G}$ and a finite graph $\mathrm{H}$, we consider $\mathrm{Hom}(\mathcal{G},\mathrm{H})$ the set of graph homomorphisms from $\mathcal{G}$ to $\mathrm{H}$ and we study Gibbs measures supported on…

Combinatorics · Mathematics 2015-10-07 Raimundo Briceño , Ronnie Pavlov

We develop a new Gibbs sampler for a linear mixed model with a Dirichlet process random effect term, which is easily extended to a generalized linear mixed model with a probit link function. Our Gibbs sampler exploits the properties of the…

Statistics Theory · Mathematics 2010-02-26 Minjung Kyung , Jeff Gill , George Casella

The particle Gibbs sampler is a Markov chain Monte Carlo (MCMC) algorithm to sample from the full posterior distribution of a state-space model. It does so by executing Gibbs sampling steps on an extended target distribution defined on the…

Computation · Statistics 2015-07-29 Nicolas Chopin , Sumeetpal S. Singh

We establish bounds on the conductance for the systematic-scan and random-scan Gibbs samplers when the target distribution satisfies a Poincar\'e or log-Sobolev inequality and possesses sufficiently regular conditional distributions. These…

Statistics Theory · Mathematics 2026-04-28 Alexander Goyal , George Deligiannidis , Nikolas Kantas

Over the last decade, a large variety of clustering algorithms have been developed to detect coregulatory relationships among genes from microarray gene expression data. Model based clustering approaches have emerged as statistically well…

Quantitative Methods · Quantitative Biology 2008-01-15 Anagha Joshi , Yves Van de Peer , Tom Michoel

An energy efficient use of large scale sensor networks necessitates activating a subset of possible sensors for estimation at a fusion center. The problem is inherently combinatorial; to this end, a set of iterative, randomized algorithms…

Information Theory · Computer Science 2017-09-13 Arpan Chattopadhyay , Urbashi Mitra

This paper addresses the mapping problem. Using a conjugate prior form, we derive the exact theoretical batch multi-object posterior density of the map given a set of measurements. The landmarks in the map are modeled as extended objects,…

Machine Learning · Statistics 2018-11-09 Maryam Fatemi , Karl Granström , Lennart Svensson , Francisco J. R. Ruiz , Lars Hammarstrand