English
Related papers

Related papers: On Sampling from the Gibbs Distribution with Rando…

200 papers

We consider discrete nonparametric priors which induce Gibbs-type exchangeable random partitions and investigate their posterior behavior in detail. In particular, we deduce conditional distributions and the corresponding Bayesian…

Probability · Mathematics 2008-08-22 Antonio Lijoi , Igor Prünster , Stephen G. Walker

This paper introduces a stochastic plug-and-play (PnP) sampling algorithm that leverages variable splitting to efficiently sample from a posterior distribution. The algorithm based on split Gibbs sampling (SGS) draws inspiration from the…

Machine Learning · Statistics 2023-04-24 Florentin Coeurdoux , Nicolas Dobigeon , Pierre Chainais

The maximum independent set (MIS) problem is a well-studied combinatorial optimization problem that naturally arises in many applications, such as wireless communication, information theory and statistical mechanics. MIS problem is NP-hard,…

Discrete Mathematics · Computer Science 2015-04-20 Rémi Varloot , Ana Bušić , Anne Bouillard

We study parameter inference in large-scale latent variable models. We first propose an unified treatment of online inference for latent variable models from a non-canonical exponential family, and draw explicit links between several…

Machine Learning · Computer Science 2018-02-01 Christophe Dupuy , Francis Bach

Optimized sensing is important for computational imaging in low-resource environments, when images must be recovered from severely limited measurements. In this paper, we propose a physics-constrained, fully differentiable, autoencoder that…

Image and Video Processing · Electrical Eng. & Systems 2020-03-24 He Sun , Adrian V. Dalca , Katherine L. Bouman

Kelly (2007, hereafter K07) described an efficient algorithm, using Gibbs sampling, for performing linear regression in the fairly general case where non-zero measurement errors exist for both the covariates and response variables, where…

Instrumentation and Methods for Astrophysics · Physics 2016-02-17 Adam B. Mantz

We consider the structured-output prediction problem through probabilistic approaches and generalize the "perturb-and-MAP" framework to more challenging weighted Hamming losses, which are crucial in applications. While in principle our…

Machine Learning · Statistics 2018-11-22 Tatiana Shpakova , Francis Bach , Anton Osokin

High-dimensional and complex discrete distributions often exhibit multimodal behavior due to inherent discontinuities, posing significant challenges for sampling. Gradient-based discrete samplers, while effective, frequently become trapped…

Machine Learning · Computer Science 2026-04-14 Pinaki Mohanty , Ruqi Zhang

In wireless networks, the transmission rate of a link is determined by received signal strength, interference from simultaneous transmissions, and available coding-modulation schemes. Rate allocation is a key problem in wireless network…

Networking and Internet Architecture · Computer Science 2012-10-24 Shan Zhou , Xinzhou Wu , Lei Ying

One of the fundamental tasks of science is to find explainable relationships between observed phenomena. One approach to this task that has received attention in recent years is based on probabilistic graphical modelling with sparsity…

Machine Learning · Statistics 2014-04-16 Peter Orchard , Felix Agakov , Amos Storkey

Integration against, and hence sampling from, high-dimensional probability distributions is of essential importance in many application areas and has been an active research area for decades. One approach that has drawn increasing attention…

Numerical Analysis · Mathematics 2023-08-22 Ilja Klebanov , T. J. Sullivan

The Partially Collapsed Gibbs (PCG) sampler offers a new strategy for improving the convergence of a Gibbs sampler. PCG achieves faster convergence by reducing the conditioning in some of the draws of its parent Gibbs sampler. Although this…

Computation · Statistics 2016-02-19 David A. van Dyk , Xiyun Jiao

This paper proposes a Bayesian method for estimating the parameters of a normal distribution when only limited summary statistics (sample mean, minimum, maximum, and sample size) are available. To estimate the parameters of a normal…

Methodology · Statistics 2024-11-21 Tomoki Matsumoto

We study different variants of the Gibbs sampler algorithm from the perspective of their applicability to the estimation of power spectra of the cosmic microwave background (CMB) anisotropies. These include approaches studied earlier in the…

Cosmology and Nongalactic Astrophysics · Physics 2022-05-13 Gabriel Ducrocq , Nicolas Chopin , Josquin Errard , Radek Stompor

Gibbs states are familiar from statistical mechanics, yet their use is not limited to that domain. For instance, they also feature in the maximum entropy reconstruction of quantum states from incomplete measurement data. Outside the…

Quantum Physics · Physics 2011-07-04 Jochen Rau

Motivated by de Finetti's representation theorem for almost exchangeable arrays, we want to sample $\mathbf p \in [0,1]^d$ from a distribution with density proportional to $\exp(-A^2\sum_{i<j}c_{ij}(p_i-p_j)^2)$, where $A$ is large and…

Probability · Mathematics 2020-12-22 Balázs Gerencsér , Andrea Ottolini

Gibbs-type random probability measures and the exchangeable random partitions they induce represent an important framework both from a theoretical and applied point of view. In the present paper, motivated by species sampling problems, we…

Probability · Mathematics 2013-09-06 Stefano Favaro , Antonio Lijoi , Igor Prünster

Ising and Potts models are an important class of discrete probability distributions which originated from statistical physics and since then have found applications in several disciplines. Simulation from these models is a well known…

Computation · Statistics 2026-03-17 Charles C. Margossian , Chenyang Zhong , Sumit Mukherjee

The goal of this presentation is to build an efficient non-parametric Bayes classifier in the presence of large numbers of predictors. When analyzing such data, parametric models are often too inflexible while non-parametric procedures tend…

Methodology · Statistics 2013-01-07 Abhishek Bhattacharya

The popularity of Adaptive MCMC has been fueled on the one hand by its success in applications, and on the other hand, by mathematically appealing and computationally straightforward optimisation criteria for the Metropolis algorithm…

Computation · Statistics 2018-01-30 Cyril Chimisov , Krzysztof Latuszynski , Gareth Roberts