English
Related papers

Related papers: A Generalized Loop Correction Method for Approxima…

200 papers

Bayesian belief networks can be used to represent and to reason about complex systems with uncertain, incomplete and conflicting information. Belief networks are graphs encoding and quantifying probabilistic dependence and conditional…

Artificial Intelligence · Computer Science 2013-03-08 Carlos Rojas-Guzman , Mark A. Kramer

We consider distributed estimation of the inverse covariance matrix, also called the concentration or precision matrix, in Gaussian graphical models. Traditional centralized estimation often requires global inference of the covariance…

Machine Learning · Statistics 2015-06-15 Zhaoshi Meng , Dennis Wei , Ami Wiesel , Alfred O. Hero

Undirected graphical models are a widely used class of probabilistic models in machine learning that capture prior knowledge or putative pairwise interactions between variables. Those interactions are encoded in a graph for pairwise…

Statistics Theory · Mathematics 2025-03-21 Grégoire Sergeant-Perthuis , Toby St Clere Smithe , Léo Boitel

We present a novel distributed Gauss-Newton method for the non-linear state estimation (SE) model based on a probabilistic inference method called belief propagation (BP). The main novelty of our work comes from applying BP sequentially…

Information Theory · Computer Science 2018-08-28 Mirsad Cosovic , Dejan Vukobratovic

Generalized Bayesian inference (GBI) is an alternative inference framework motivated by robustness to modeling errors, where a specific loss function is used to link the model parameters with observed data, instead of the log-likelihood…

Methodology · Statistics 2025-02-18 Marko Järvenpää , Jukka Corander , Henri Pesonen

Gaussian Process Regression (GPR) is a popular regression method, which unlike most Machine Learning techniques, provides estimates of uncertainty for its predictions. These uncertainty estimates however, are based on the assumption that…

Machine Learning · Computer Science 2024-08-29 Harris Papadopoulos

Approximate Bayesian Computation (ABC) is a useful class of methods for Bayesian inference when the likelihood function is computationally intractable. In practice, the basic ABC algorithm may be inefficient in the presence of discrepancy…

Statistics Theory · Mathematics 2015-05-14 Stefano Cabras , Maria Eugenia Castellanos Nueda , Erlis Ruli

Approximate Bayesian inference methods provide a powerful suite of tools for finding approximations to intractable posterior distributions. However, machine learning applications typically involve selecting actions, which -- in a Bayesian…

Machine Learning · Statistics 2022-01-11 Michael J. Morais , Jonathan W. Pillow

The clique tree algorithm is the standard method for doing inference in Bayesian networks. It works by manipulating clique potentials - distributions over the variables in a clique. While this approach works well for many networks, it is…

Artificial Intelligence · Computer Science 2013-01-30 Daphne Koller , Uri Lerner , Dragomir Anguelov

We consider the estimation of an i.i.d.\ random vector observed through a linear transform followed by a componentwise, probabilistic (possibly nonlinear) measurement channel. A novel algorithm, called generalized approximate message…

Information Theory · Computer Science 2012-08-15 Sundeep Rangan

Reliable spatial uncertainty evaluation of object detection models is of special interest and has been subject of recent work. In this work, we review the existing definitions for uncertainty calibration of probabilistic regression tasks.…

Machine Learning · Computer Science 2022-08-22 Fabian Küppers , Jonas Schneider , Anselm Haselhoff

Machine learning based approaches are being increasingly used for designing decoders for next generation communication systems. One widely used framework is neural belief propagation (NBP), which unfolds the belief propagation (BP)…

Information Theory · Computer Science 2024-04-23 Sudarshan Adiga , Xin Xiao , Ravi Tandon , Bane Vasic , Tamal Bose

Lifted probabilistic inference algorithms have been successfully applied to a large number of symmetric graphical models. Unfortunately, the majority of real-world graphical models is asymmetric. This is even the case for relational…

Artificial Intelligence · Computer Science 2014-12-02 Guy Van den Broeck , Mathias Niepert

In prediction problems, it is common to model the data-generating process and then use a model-based procedure, such as a Bayesian predictive distribution, to quantify uncertainty about the next observation. However, if the posited model is…

Methodology · Statistics 2021-07-06 Pei-Shien Wu , Ryan Martin

The paper investigates parameterized approximate message-passing schemes that are based on bounded inference and are inspired by Pearl's belief propagation algorithm (BP). We start with the bounded inference mini-clustering algorithm and…

Artificial Intelligence · Computer Science 2014-01-16 Robert Mateescu , Kalev Kask , Vibhav Gogate , Rina Dechter

We propose a simple approach that provides accurate uncertainty quantification for Bayesian inference in misspecified or approximate models, and for generalized (Gibbs) posteriors. While existing solutions in this context are based on…

Methodology · Statistics 2026-03-11 David T. Frazier , Christopher Drovandi , Robert Kohn

This paper is concerned with the problem of exact MAP inference in general higher-order graphical models by means of a traditional linear programming relaxation approach. In fact, the proof that we have developed in this paper is a rather…

Optimization and Control · Mathematics 2026-03-23 Ikhlef Bechar

Conformal prediction (CP) provides a distribution-free approach to uncertainty quantification with finite-sample guarantees. However, applying CP to graph neural networks (GNNs) remains challenging as the combinatorial nature of graphs…

Machine Learning · Computer Science 2026-05-11 Peyman Baghershahi , Fangxin Wang , Debmalya Mandal , Sourav Medya

Generalized linear mixed models (GLMMs) are a widely used tool in statistical analysis. The main bottleneck of many computational approaches lies in the inversion of the high dimensional precision matrices associated with the random…

Computation · Statistics 2025-10-08 Andrea Pandolfi , Omiros Papaspiliopoulos , Giacomo Zanella

Random-effects models are central to meta-analysis, yet the between-study variance is often underestimated when the number of studies is small. In such settings, confidence intervals become unduly narrow and fail to attain the nominal…

Methodology · Statistics 2025-11-18 Keisuke Hanada , Tomoyuki Sugimoto