English
Related papers

Related papers: Discrete geometric analysis of message passing alg…

200 papers

We propose PROPAGATE, a fast approximation framework to estimate distance-based metrics on very large graphs such as the (effective) diameter, the (effective) radius, or the average distance within a small error. The framework assigns seeds…

Data Structures and Algorithms · Computer Science 2023-08-23 Giambattista Amati , Antonio Cruciani , Daniele Pasquini , Paola Vocca , Simone Angelini

For every physical model defined on a generic graph or factor graph, the Bethe $M$-layer construction allows building a different model for which the Bethe approximation is exact in the large $M$ limit and it coincides with the original…

Disordered Systems and Neural Networks · Physics 2023-10-20 Ada Altieri , Maria Chiara Angelini , Carlo Lucibello , Giorgio Parisi , Federico Ricci-Tersenghi , Tommaso Rizzo

Belief propagation (BP) can be a useful tool to approximately contract a tensor network, provided that the contributions from any closed loops in the network are sufficiently weak. In this manuscript we describe how a loop series expansion…

Quantum Physics · Physics 2026-03-09 Glen Evenbly , Nicola Pancotti , Ashley Milsted , Johnnie Gray , Garnet Kin-Lic Chan

Motivated by the increasing need for fast processing of large-scale graphs, we study a number of fundamental graph problems in a message-passing model for distributed computing, called $k$-machine model, where we have $k$ machines that…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-02-10 Khalid Hourani , Hartmut Klauck , William K. Moses , Danupon Nanongkai , Gopal Pandurangan , Peter Robinson , Michele Scquizzato

One of the central models in distributed computing is Linial's LOCAL model [SIAM J. Comp. 1992]. Over time, researchers have studied distributed graph problems in the LOCAL model under slightly different assumptions, such as whether nodes…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-05-14 Alkida Balliu , Sebastian Brandt , Fabian Kuhn , Dennis Olivetti , Timothé Picavet , Gustav Schmid

Gaussian belief propagation (GaBP) is an iterative algorithm for computing the mean of a multivariate Gaussian distribution, or equivalently, the minimum of a multivariate positive definite quadratic function. Sufficient conditions, such as…

Information Theory · Computer Science 2014-01-07 Nicholas Ruozzi , Sekhar Tatikonda

We present a combinatorial characterization of the Bethe entropy function of a factor graph, such a characterization being in contrast to the original, analytical, definition of this function. We achieve this combinatorial characterization…

Information Theory · Computer Science 2013-11-05 Pascal O. Vontobel

The random assignment problem asks for the minimum-cost perfect matching in the complete $n\times n$ bipartite graph $\Knn$ with i.i.d. edge weights, say uniform on $[0,1]$. In a remarkable work by Aldous (2001), the optimal cost was shown…

Probability · Mathematics 2009-02-04 Justin Salez , Devavrat Shah

We consider the application of the factor graph framework for symbol detection on linear inter-symbol interference channels. Based on the Ungerboeck observation model, a detection algorithm with appealing complexity properties can be…

Information Theory · Computer Science 2022-11-28 Luca Schmid , Laurent Schmalen

A scheme to provide various mean-field-type approximation algorithms is presented by employing the Bethe free energy formalism to a family of replicated systems in conjunction with analytical continuation with respect to the number of…

Disordered Systems and Neural Networks · Physics 2009-11-11 Yoshiyuki Kabashima

This manuscript discusses computation of the Partition Function (PF) and the Minimum Weight Perfect Matching (MWPM) on arbitrary, non-bipartite graphs. We present two novel problem formulations - one for computing the PF of a Perfect…

Statistical Mechanics · Physics 2015-06-16 Michael Chertkov , Andrew Gelfand , Jinwoo Shin

In this paper we present a new algorithm, denoted as TEP, to decode low-density parity-check (LDPC) codes over the Binary Erasure Channel (BEC). The TEP decoder is derived applying the expectation propagation (EP) algorithm with a tree-…

Information Theory · Computer Science 2012-01-05 Pablo M. Olmos , Juan José Murillo-Fuentes , Fernando Pérez-Cruz

Graphical models represent multivariate and generally not normalized probability distributions. Computing the normalization factor, called the partition function, is the main inference challenge relevant to multiple statistical and…

Machine Learning · Computer Science 2020-09-01 Michael Chertkov , Vladimir Chernyak , Yury Maximov

The standard Large Deviation Theory (LDT) mirrors the Boltzmann-Gibbs (BG) factor which describes the thermal equilibrium of short-range Hamiltonian systems, the velocity distribution of which is Maxwellian. It is generically applicable to…

General Physics · Physics 2022-02-03 Ugur Tirnakli , Mauricio Marques , Constantino Tsallis

Expectation Propagation is a generalization to Belief Propagation (BP) in two ways. First, it can be used with any exponential family distribution over the cliques in the graph. Second, it can impose additional constraints on the marginal…

Information Theory · Computer Science 2010-09-23 Pablo M. Olmos , Juan José Murillo-Fuentes

Belief propagation (BP) is a popular method for performing probabilistic inference on graphical models. In this work, we enhance BP and propose self-guided belief propagation (SBP) that incorporates the pairwise potentials only gradually.…

Machine Learning · Statistics 2024-10-30 Christian Knoll , Adrian Weller , Franz Pernkopf

Locally-biased graph algorithms are algorithms that attempt to find local or small-scale structure in a large data graph. In some cases, this can be accomplished by adding some sort of locality constraint and calling a traditional graph…

Social and Information Networks · Computer Science 2016-12-06 Kimon Fountoulakis , David Gleich , Michael Mahoney

We present a differentiable approach to learn the probabilistic factors used for inference by a nonparametric belief propagation algorithm. Existing nonparametric belief propagation methods rely on domain-specific features encoded in the…

We study the problem of approximating the partition function of the ferromagnetic Ising model in graphs and hypergraphs. Our first result is a deterministic approximation scheme (an FPTAS) for the partition function in bounded degree graphs…

Data Structures and Algorithms · Computer Science 2018-12-26 Jingcheng Liu , Alistair Sinclair , Piyush Srivastava

Message passing algorithms have proved surprisingly successful in solving hard constraint satisfaction problems on sparse random graphs. In such applications, variables are fixed sequentially to satisfy the constraints. Message passing is…

Artificial Intelligence · Computer Science 2019-06-05 Andrea Montanari , Federico Ricci-Tersenghi , Guilhem Semerjian