English
Related papers

Related papers: On Sampling from the Gibbs Distribution with Rando…

200 papers

This paper considers a non-standard problem of generating samples from a low-temperature Gibbs distribution with \emph{constrained} support, when some of the coordinates of the mode lie on the boundary. These coordinates are referred to as…

Statistics Theory · Mathematics 2026-02-27 Ruixiao Wang , Xiaohong Chen , Sinho Chewi

In this paper, we propose generative probabilistic models for label aggregation. We use Gibbs sampling and a novel variational inference algorithm to perform the posterior inference. Empirical results show that our methods consistently…

Artificial Intelligence · Computer Science 2017-10-04 Chi Hong

Computing the conditional mode of a distribution, better known as the $\mathit{maximum\ a\ posteriori}$ (MAP) assignment, is a fundamental task in probabilistic inference. However, MAP estimation is generally intractable, and remains hard…

Machine Learning · Computer Science 2026-01-23 Matthew Shorvon , Frederik Mallmann-Trenn , David S. Watson

We study linear models under heavy-tailed priors from a probabilistic viewpoint. Instead of computing a single sparse most probable (MAP) solution as in standard deterministic approaches, the focus in the Bayesian compressed sensing…

Computer Vision and Pattern Recognition · Computer Science 2014-03-05 George Papandreou , Alan Yuille

This paper is devoted to the problem of sampling Gaussian fields in high dimension. Solutions exist for two specific structures of inverse covariance : sparse and circulant. The proposed approach is valid in a more general case and…

Computation · Statistics 2011-05-31 F. Orieux , O. Féron , J. -F. Giovannelli

In this work, we propose and analyze a class of distributed algorithms performing the joint optimization of radio resources in heterogeneous cellular networks made of a juxtaposition of macro and small cells. Within this context, it is…

Optimization and Control · Mathematics 2013-07-30 Chung Shue Chen , Francois Baccelli

The inadequate mixing of conventional Markov Chain Monte Carlo (MCMC) methods for multi-modal distributions presents a significant challenge in practical applications such as Bayesian inference and molecular dynamics. Addressing this, we…

Machine Learning · Statistics 2024-05-30 Wenlin Chen , Mingtian Zhang , Brooks Paige , José Miguel Hernández-Lobato , David Barber

In many safety-critical settings, probabilistic ML systems have to make predictions subject to algebraic constraints, e.g., predicting the most likely trajectory that does not cross obstacles. These real-world constraints are rarely convex,…

Machine Learning · Computer Science 2026-02-11 Leander Kurscheidt , Gabriele Masina , Roberto Sebastiani , Antonio Vergari

Sparse structure learning in high-dimensional Gaussian graphical models is an important problem in multivariate statistical signal processing; since the sparsity pattern naturally encodes the conditional independence relationship among…

Methodology · Statistics 2023-09-26 Ksheera Sagar , Jyotishka Datta , Sayantan Banerjee , Anindya Bhadra

This paper proposes a distributed version of Determinant Point Processing (DPP) inference to enhance multi-source data diversification under limited communication bandwidth. DPP is a popular probabilistic approach that improves data…

Machine Learning · Computer Science 2023-11-21 Xiwen Chen , Huayu Li , Rahul Amin , Abolfazl Razi

In this paper we consider Bayesian estimation for the parameters of inverse Gaussian distribution. Our emphasis is on Markov Chain Monte Carlo methods. We provide complete implementation of the Gibbs sampler algorithm. Assuming an…

Methodology · Statistics 2012-10-17 B. N. Pandey , Pulastya Bandyopadhyay

Many problems of interest in computer science and information theory can be phrased in terms of a probability distribution over discrete variables associated to the vertices of a large (but finite) sparse graph. In recent years,…

Probability · Mathematics 2009-11-11 Amir Dembo , Andrea Montanari

Inference for belief networks using Gibbs sampling produces a distribution for unobserved variables that differs from the correct distribution by a (usually) unknown error, since convergence to the right distribution occurs only…

Artificial Intelligence · Computer Science 2013-01-18 Michael Harvey , Radford M. Neal

We present a probabilistic graphical model formulation for the graph clustering problem. This enables to locally represent uncertainty of image partitions by approximate marginal distributions in a mathematically substantiated way, and to…

Computer Vision and Pattern Recognition · Computer Science 2016-01-12 Jörg Hendrik Kappes , Paul Swoboda , Bogdan Savchynskyy , Tamir Hazan , Christoph Schnörr

Solving ill-posed inverse problems by Bayesian inference has recently attracted considerable attention. Compared to deterministic approaches, the probabilistic representation of the solution by the posterior distribution can be exploited to…

Numerical Analysis · Mathematics 2016-11-03 Felix Lucka

Gibbs sampling is one of the most commonly used Markov Chain Monte Carlo (MCMC) algorithms due to its simplicity and efficiency. It cycles through the latent variables, sampling each one from its distribution conditional on the current…

Machine Learning · Computer Science 2024-08-26 Yanbo Wang , Wenyu Chen , Shimin Shan

Denoising diffusion models have driven significant progress in the field of Bayesian inverse problems. Recent approaches use pre-trained diffusion models as priors to solve a wide range of such problems, only leveraging inference-time…

Machine Learning · Statistics 2025-02-06 Yazid Janati , Badr Moufad , Mehdi Abou El Qassime , Alain Durmus , Eric Moulines , Jimmy Olsson

Sampling from distributions of implicitly defined shapes enables analysis of various energy functionals used for image segmentation. Recent work describes a computationally efficient Metropolis-Hastings method for accomplishing this task.…

Computer Vision and Pattern Recognition · Computer Science 2012-05-17 Jason Chang , John W. Fisher

An explicit optimal linear spatial predictor is derived. The spatial correlations are imposed by means of Gibbs energy functionals with explicit coupling coefficients instead of covariance matrices. The model inference process is based on…

Data Analysis, Statistics and Probability · Physics 2007-05-23 D. T. Hristopulos , S. N. Elogne

This paper presents a new Markov chain Monte Carlo method to sample from the posterior distribution of conjugate mixture models. This algorithm relies on a flexible split-merge procedure built using the particle Gibbs sampler. Contrary to…

Computation · Statistics 2017-05-30 Alexandre Bouchard-Côté , Arnaud Doucet , Andrew Roth