English
Related papers

Related papers: Loop-corrected belief propagation for lattice spin…

200 papers

We consider the optimal quantization of compressive sensing measurements following the work on generalization of relaxed belief propagation (BP) for arbitrary measurement channels. Relaxed BP is an iterative reconstruction scheme inspired…

Information Theory · Computer Science 2016-11-15 Ulugbek Kamilov , Vivek K Goyal , Sundeep Rangan

This thesis focuses on the XY model, the simplest vector spin model, used for describing numerous physical systems. It is studied for different sources of quenched disorder: random couplings, random fields, or both them. The belief…

Disordered Systems and Neural Networks · Physics 2017-06-28 Cosimo Lupo

Behavioral experiments on humans and animals suggest that the brain performs probabilistic inference to interpret its environment. Here we present a new general-purpose, biologically-plausible neural implementation of approximate inference.…

Neurons and Cognition · Quantitative Biology 2016-05-24 Rajkumar Vasudeva Raju , Xaq Pitkow

Generalized belief propagation (GBP) has proven to be a promising technique for approximate inference tasks in AI and machine learning. However, the choice of a good set of clusters to be used in GBP has remained more of an art then a…

Artificial Intelligence · Computer Science 2012-07-19 Max Welling

We generalize the belief-propagation algorithm to sparse random networks with arbitrary distributions of motifs (triangles, loops, etc.). Each vertex in these networks belongs to a given set of motifs (generalization of the configuration…

Disordered Systems and Neural Networks · Physics 2015-05-28 S. Yoon , A. V. Goltsev , S. N. Dorogovtsev , J. F. F. Mendes

Belief propagation is a powerful tool in statistical physics, machine learning, and modern coding theory. As a decoding method, it is ubiquitous in classical error correction and has also been applied to stabilizer-based quantum error…

Quantum Physics · Physics 2017-07-31 Joseph M. Renes

Computing marginal distributions of discrete or semidiscrete Markov random fields (MRFs) is a fundamental, generally intractable problem with a vast number of applications in virtually all fields of science. We present a new family of…

Statistical Mechanics · Physics 2019-07-24 Alfredo Braunstein , Giovanni Catania , Luca Dall'Asta

The canonical problem of solving a system of linear equations arises in numerous contexts in information theory, communication theory, and related fields. In this contribution, we develop a solution based upon Gaussian belief propagation…

Information Theory · Computer Science 2009-04-16 Ori Shental , Paul H. Siegel , Jack K. Wolf , Danny Bickson , Danny Dolev

We study the performance of different message passing algorithms in the two dimensional Edwards Anderson model. We show that the standard Belief Propagation (BP) algorithm converges only at high temperature to a paramagnetic solution. Then,…

Disordered Systems and Neural Networks · Physics 2011-12-26 E. Dominguez , A. Lage-Castellanos , R. Mulet , F. Ricci-Tersenghi , T. Rizzo

Many recent language model (LM) interpretability studies have adopted the circuits framework, which aims to find the minimal computational subgraph, or circuit, that explains LM behavior on a given task. Most studies determine which edges…

Machine Learning · Computer Science 2024-07-16 Michael Hanna , Sandro Pezzelle , Yonatan Belinkov

This paper develops methods of distributed Bayesian hypothesis tests for fault detection and diagnosis that are based on belief propagation and optimization in graphical models. The main challenges in developing distributed statistical…

Systems and Control · Computer Science 2015-01-20 Kwang-Ki K. Kim

Non-prehensile manipulation such as pushing is typically subject to uncertain, non-smooth dynamics. However, modeling the uncertainty of the dynamics typically results in intractable belief dynamics, making data-efficient planning under…

Robotics · Computer Science 2024-06-28 Julius Jankowski , Lara Brudermüller , Nick Hawes , Sylvain Calinon

We propose a new algorithm for binary quantization based on the Belief Propagation algorithm with decimation over factor graphs of Low Density Generator Matrix (LDGM) codes. This algorithm, which we call Bias Propagation (BiP), can be…

Information Theory · Computer Science 2007-10-03 Tomas Filler , Jessica Fridrich

The Bethe approximation, discovered in statistical physics, gives an efficient algorithm called belief propagation (BP) for approximating a partition function. BP empirically gives an accurate approximation for many problems, e.g.,…

Information Theory · Computer Science 2012-10-11 Ryuhei Mori , Toshiyuki Tanaka

Cooperative localization (CL) is an important technology for innovative services such as location-aware communication networks, modern convenience, and public safety. We consider wireless networks with mobile agents that aim to localize…

Signal Processing · Electrical Eng. & Systems 2024-01-12 Lukas Wielandner , Erik Leitinger , Florian Meyer , Klaus Witrisal

Graph neural network models have been extensively used to learn node representations for graph structured data in an end-to-end setting. These models often rely on localized first order approximations of spectral graph convolutions and…

Machine Learning · Computer Science 2020-10-20 Mohammed Haroon Dupty , Wee Sun Lee

Attack graphs provide compact representations of the attack paths that an attacker can follow to compromise network resources by analysing network vulnerabilities and topology. These representations are a powerful tool for security risk…

Cryptography and Security · Computer Science 2016-06-23 Luis Muñoz-González , Daniele Sgandurra , Andrea Paudice , Emil C. Lupu

In a complete bipartite graph with vertex sets of cardinalities $n$ and $m$, assign random weights from exponential distribution with mean 1, independently to each edge. We show that, as $n\rightarrow\infty$, with $m = \lceil…

Probability · Mathematics 2014-05-07 Mustafa Khandwawala

Decentralized coordination for multi-robot systems involves planning in challenging, high-dimensional spaces. The planning problem is particularly challenging in the presence of obstacles and different sources of uncertainty such as…

Robotics · Computer Science 2024-03-13 Jana Pavlasek , Joshua Jing Zhi Mah , Ruihan Xu , Odest Chadwicke Jenkins , Fabio Ramos

Gaussian belief propagation (GBP) is a recursive computation method that is widely used in inference for computing marginal distributions efficiently. Depending on how the factorization of the underlying joint Gaussian distribution is…

Information Theory · Computer Science 2018-01-22 Jian Du , Shaodan Ma , Yik-Chung Wu , Soummya Kar , José M. F. Moura