English
Related papers

Related papers: Belief Propagation on the random $k$-SAT model

200 papers

We develop a message-passing algorithm for noisy matrix completion problems based on matrix factorization. The algorithm is derived by approximating message distributions of belief propagation with Gaussian distributions that share the same…

Machine Learning · Statistics 2021-10-27 Koki Okajima , Yoshiyuki Kabashima

We introduce and study the problem of posterior inference on tree-structured graphical models in the presence of a malicious adversary who can corrupt some observed nodes. In the well-studied broadcasting on trees model, corresponding to…

Data Structures and Algorithms · Computer Science 2024-04-02 Samuel B. Hopkins , Anqi Li

This thesis is interested in the application of statistical physics methods and inference to sparse linear estimation problems. The main tools are the graphical models and approximate message-passing algorithm together with the cavity…

Information Theory · Computer Science 2015-11-06 Jean Barbier

A non-Hermitian region connected to semi-infinite Hermitian lattices acts either as a source or as a sink and the probability current is not conserved in a scattering typically. Even a $\mathcal{P}\mathcal{T}$-symmetric region that contains…

Mesoscale and Nanoscale Physics · Physics 2022-12-15 Abhiram Soori , M. Sivakumar , V. Subrahmanyam

The partition function of the random energy model at inverse temperature $\beta$ is a sum of random exponentials $Z_N(\beta)=\sum_{k=1}^N \exp(\beta \sqrt{n} X_k)$, where $X_1,X_2,...$ are independent real standard normal random variables…

Probability · Mathematics 2014-02-11 Zakhar Kabluchko , Anton Klimovsky

Belief Propagation (BP) is a popular, distributed heuristic for performing MAP computations in Graphical Models. BP can be interpreted, from a variational perspective, as minimizing the Bethe Free Energy (BFE). BP can also be used to solve…

Artificial Intelligence · Computer Science 2013-05-20 Andrew Gelfand , Jinwoo Shin , Michael Chertkov

We propose a new algorithm for inferring the state of hidden spins and reconstructing the connections in a synchronous kinetic Ising model, given the observed history. Focusing on the case in which the hidden spins are conditionally…

Disordered Systems and Neural Networks · Physics 2015-06-11 Claudia Battistin , John Hertz , Joanna Tyrcha , Yasser Roudi

We study several bayesian inference problems for irreversible stochastic epidemic models on networks from a statistical physics viewpoint. We derive equations which allow to accurately compute the posterior distribution of the time…

Quantitative Methods · Quantitative Biology 2014-03-28 Fabrizio Altarelli , Alfredo Braunstein , Luca Dall'Asta , Alejandro Lage-Castellanos , Riccardo Zecchina

We propose a hybrid message passing method for distributed cooperative localization and tracking of mobile agents. Belief propagation and mean field message passing are employed for, respectively, the motion-related and measurement-related…

Systems and Control · Computer Science 2016-05-25 Burak Çakmak , Daniel N. Urup , Florian Meyer , Troels Pedersen , Bernard H. Fleury , Franz Hlawatsch

We propose a plasma model for spectral statistics displaying level repulsion without long-range spectral rigidity, i.e. statistics intermediate between random matrix and Poisson statistics similar to the ones found numerically at the…

Chaotic Dynamics · Physics 2009-10-31 E. Bogomolny , U. Gerland , C. Schmit

Propositional satisfiability (SAT) is one of the most fundamental problems in computer science. Its worst-case hardness lies at the core of computational complexity theory, for example in the form of NP-hardness and the (Strong) Exponential…

Discrete Mathematics · Computer Science 2022-09-02 Tobias Friedrich , Ralf Rothenberger

In this three-sections lecture cavity method is introduced as heuristic framework from a Physics perspective to solve probabilistic graphical models and it is presented both at the replica symmetric (RS) and 1-step replica symmetry breaking…

Disordered Systems and Neural Networks · Physics 2014-09-11 Gino Del Ferraro , Chuang Wang , Dani Martí , Marc Mézard

A Monte-Carlo algorithm for discrete statistical models that combines the full power of the Belief Propagation algorithm with the advantages of a detailed-balanced heat bath approach is presented. A sub-tree inside the factor graph is first…

Statistical Mechanics · Physics 2014-07-02 Aurélien Decelle , Florent Krzakala

We prove the existence of full replica symmetry breaking (FRSB) for the Sherrington-Kirkpatrick (SK) model at low temperature. More specifically, we prove that slightly beyond the critical temperature, the Parisi measure for the SK model is…

Probability · Mathematics 2025-04-17 Yuxin Zhou

Probabilistic graphical models are a powerful concept for modeling high-dimensional distributions. Besides modeling distributions, probabilistic graphical models also provide an elegant framework for performing statistical inference;…

Artificial Intelligence · Computer Science 2022-09-13 Christian Knoll

We study the performance of different message passing algorithms in the two dimensional Edwards Anderson model. We show that the standard Belief Propagation (BP) algorithm converges only at high temperature to a paramagnetic solution. Then,…

Disordered Systems and Neural Networks · Physics 2011-12-26 E. Dominguez , A. Lage-Castellanos , R. Mulet , F. Ricci-Tersenghi , T. Rizzo

We consider the estimation of an i.i.d.\ random vector observed through a linear transform followed by a componentwise, probabilistic (possibly nonlinear) measurement channel. A novel algorithm, called generalized approximate message…

Information Theory · Computer Science 2012-08-15 Sundeep Rangan

Data assimilation is a core component of numerical weather prediction systems. The large quantity of data processed during assimilation requires the computation to be distributed across increasingly many compute nodes, yet existing…

Machine Learning · Computer Science 2025-01-15 Oscar Key , So Takao , Daniel Giles , Marc Peter Deisenroth

In Bayesian networks, exact belief propagation is achieved through message passing algorithms. These algorithms (ex: inward and outward) provide only a recursive definition of the corresponding messages. In contrast, when working on hidden…

Probability · Mathematics 2012-01-24 G. Nuel

We present Wideband Back-Projection Diffusion, an end-to-end probabilistic framework for approximating the posterior distribution induced by the inverse scattering map from wideband scattering data. This framework produces highly accurate…

Machine Learning · Computer Science 2025-05-20 Borong Zhang , Martín Guerra , Qin Li , Leonardo Zepeda-Núñez