English
Related papers

Related papers: Empirical Evaluation of Approximation Algorithms f…

200 papers

Probabilistic Circuits (PCs) offer a computationally scalable framework for generative modeling, supporting exact and efficient inference of a wide range of probabilistic queries. While recent advances have significantly improved the…

Machine Learning · Computer Science 2025-10-07 Anji Liu , Zilei Shao , Guy Van den Broeck

We propose an original particle-based implementation of the Loopy Belief Propagation (LPB) algorithm for pairwise Markov Random Fields (MRF) on a continuous state space. The algorithm constructs adaptively efficient proposal distributions…

Computation · Statistics 2015-06-22 Thibaut Lienart , Yee Whye Teh , Arnaud Doucet

Factor graphs are important models for succinctly representing probability distributions in machine learning, coding theory, and statistical physics. Several computational problems, such as computing marginals and partition functions, arise…

Machine Learning · Computer Science 2017-08-09 Damian Straszak , Nisheeth K. Vishnoi

Understanding the structural mechanisms of multi-layer networks is essential for analyzing complex systems characterized by multiple interacting layers. This work studies the problem of estimating connection probabilities in multi-layer…

Methodology · Statistics 2026-02-26 Dingzi Guo , Diqing Li , Jingyi Wang , Wen-Xin Zhou

The belief propagation (BP) algorithm is widely applied to perform approximate inference on arbitrary graphical models, in part due to its excellent empirical properties and performance. However, little is known theoretically about when…

Artificial Intelligence · Computer Science 2012-06-26 Alexander T. Ihler

The Acceptance Probability Estimation Problem (APEP) is to additively approximate the acceptance probability of a Boolean circuit. This problem admits a probabilistic approximation scheme. A central question is whether we can design a…

Computational Complexity · Computer Science 2021-03-16 Peter Dixon , A. Pavan , N. V. Vinodchandran

The computational complexity of reasoning within the Dempster-Shafer theory of evidence is one of the main points of criticism this formalism has to face. To overcome this difficulty various approximation algorithms have been suggested that…

Artificial Intelligence · Computer Science 2013-02-18 Mathias Bauer

Bayesian methods are appealing in their flexibility in modeling complex data and ability in capturing uncertainty in parameters. However, when Bayes' rule does not result in tractable closed-form, most approximate inference algorithms lack…

Machine Learning · Computer Science 2016-05-09 Bo Dai , Niao He , Hanjun Dai , Le Song

This paper tackles the problem of millimeter-Wave (mmWave) channel estimation in massive MIMO communication systems. A new Bayes-optimal channel estimator is derived using recent advances in the approximate belief propagation (BP) Bayesian…

Information Theory · Computer Science 2019-03-07 Faouzi Bellili , Foad Sohrabi , Wei Yu

In this work, we consider efficient maximum-likelihood decoding of linear block codes for small-to-moderate block lengths. The presented approach is a branch-and-bound algorithm using the cutting-plane approach of Zhang and Siegel (IEEE…

Information Theory · Computer Science 2014-04-29 Michael Helmling , Eirik Rosnes , Stefan Ruzika , Stefan Scholl

We formulate in this paper the mini-bucket algorithm for approximate inference in terms of exact inference on an approximate model produced by splitting nodes in a Bayesian network. The new formulation leads to a number of theoretical and…

Artificial Intelligence · Computer Science 2012-06-26 Arthur Choi , Mark Chavira , Adnan Darwiche

Masking-based post-hoc explanation methods, such as KernelSHAP and LIME, estimate local feature importance by querying a black-box model under randomized perturbations. This paper formulates this procedure as communication over a query…

Artificial Intelligence · Computer Science 2026-04-21 Erciyes Karakaya , Ozgur Ercetin

Network coding is a highly efficient data dissemination mechanism for wireless networks. Since network coded information can only be recovered after delivering a sufficient number of coded packets, the resulting decoding delay can become…

Information Theory · Computer Science 2016-11-17 Rui A. Costa , Daniele Munaretto , Joerg Widmer , Joao Barros

This paper investigates achievable information rates and error exponents of mismatched decoding when the channel belongs to the class of channels that are close to the decoding metric in terms of relative entropy. For both discrete- and…

Information Theory · Computer Science 2025-05-28 Priyanka Patel , Francesc Molina , Albert Guillén i Fàbregas

We apply belief propagation (BP) to multi--user detection in a spread spectrum system, under the assumption of Gaussian symbols. We prove that BP is both convergent and allows to estimate the correct conditional expectation of the input…

Information Theory · Computer Science 2007-07-13 Andrea Montanari , Balaji Prabhakar , David Tse

We present a novel inference algorithm for arbitrary, binary, undirected graphs. Unlike loopy belief propagation, which iterates fixed point equations, we directly descend on the Bethe free energy. The algorithm consists of two phases,…

Artificial Intelligence · Computer Science 2013-01-14 Max Welling , Yee Whye Teh

The growing amount of applications that generate vast amount of data in short time scales render the problem of partial monitoring, coupled with prediction, a rather fundamental one. We study the aforementioned canonical problem under the…

Data Structures and Algorithms · Computer Science 2016-08-02 Michalis Kallitsis , Stilian Stoev , George Michailidis

This paper is motivated by the problem of error control in network coding when errors are introduced in a random fashion (rather than chosen by an adversary). An additive-multiplicative matrix channel is considered as a model for random…

Information Theory · Computer Science 2019-05-07 Danilo Silva , Frank R. Kschischang , Ralf Kötter

Research on fractal networks is a dynamically growing field of network science. A central issue is to analyze fractality with the so-called box-covering method. As this problem is known to be NP-hard, a plethora of approximating algorithms…

Social and Information Networks · Computer Science 2021-10-12 Péter Tamás Kovács , Marcell Nagy , Roland Molontay

We study iterative blind symbol detection for block-fading linear inter-symbol interference channels. Based on the factor graph framework, we design a joint channel estimation and detection scheme that combines the expectation maximization…

Information Theory · Computer Science 2024-08-06 Luca Schmid , Tomer Raviv , Nir Shlezinger , Laurent Schmalen