English
Related papers

Related papers: Local stability of Belief Propagation algorithm wi…

200 papers

The Propagation-Separation approach is an iterative procedure for pointwise estimation of local constant and local polynomial functions. The estimator is defined as a weighted mean of the observations with data-driven weights. Within…

Methodology · Statistics 2013-02-06 Saskia Becker , Peter Mathé

This paper focuses on the distributed static estimation problem and a Belief Propagation (BP) based estimation algorithm is proposed. We provide a complete analysis for convergence and accuracy of it. More precisely, we offer conditions…

Systems and Control · Electrical Eng. & Systems 2020-04-07 Damián Marelli , Tianju Sui , Minyue Fu , Ximing Sun

This paper is motivated by two applications, namely i) generalizations of cuckoo hashing, a computationally simple approach to assigning keys to objects, and ii) load balancing in content distribution networks, where one is interested in…

Probability · Mathematics 2012-07-09 Mathieu Leconte , Marc Lelarge , Laurent Massoulié

Graph neural network models have been extensively used to learn node representations for graph structured data in an end-to-end setting. These models often rely on localized first order approximations of spectral graph convolutions and…

Machine Learning · Computer Science 2020-10-20 Mohammed Haroon Dupty , Wee Sun Lee

A recent paper \cite{CaeCaeSchBar06} proposed a provably optimal, polynomial time method for performing near-isometric point pattern matching by means of exact probabilistic inference in a chordal graphical model. Their fundamental result…

Computer Vision and Pattern Recognition · Computer Science 2007-10-03 Julian J. McAuley , Tiberio S. Caetano , Marconi S. Barbosa

Message propagation is fundamental in constructing distributed systems upon sparsely connected communication networks. For providing easy message propagation primitives, the mutual-exclusive propagation (MEP) of one-bit messages is…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-03-08 Shaolin Yu , Jihong Zhu , Jiali Yang

The canonical problem of solving a system of linear equations arises in numerous contexts in information theory, communication theory, and related fields. In this contribution, we develop a solution based upon Gaussian belief propagation…

Information Theory · Computer Science 2008-10-08 Ori Shental , Danny Bickson , Paul H. Siegel , Jack K. Wolf , Danny Dolev

We introduce a new class of lower bounds on the log partition function of a Markov random field which makes use of a reversed Jensen's inequality. In particular, our method approximates the intractable distribution using a linear…

Machine Learning · Computer Science 2012-03-19 Qiang Liu , Alexander T. Ihler

Learned neural solvers have successfully been used to solve combinatorial optimization and decision problems. More general counting variants of these problems, however, are still largely solved with hand-crafted solvers. To bridge this gap,…

Machine Learning · Computer Science 2020-07-02 Jonathan Kuck , Shuvam Chakraborty , Hao Tang , Rachel Luo , Jiaming Song , Ashish Sabharwal , Stefano Ermon

Over the last decade or so, Approximate Message Passing (AMP) algorithms have become extremely popular in various structured high-dimensional statistical problems. The fact that the origins of these techniques can be traced back to notions…

Statistics Theory · Mathematics 2021-05-11 Oliver Y. Feng , Ramji Venkataramanan , Cynthia Rush , Richard J. Samworth

A major benefit of graphical models is that most knowledge is captured in the model structure. Many models, however, produce inference problems with a lot of symmetries not reflected in the graphical structure and hence not exploitable by…

Artificial Intelligence · Computer Science 2012-05-14 Kristian Kersting , Babak Ahmadi , Sriraam Natarajan

We propose a new algorithm for inferring the state of hidden spins and reconstructing the connections in a synchronous kinetic Ising model, given the observed history. Focusing on the case in which the hidden spins are conditionally…

Disordered Systems and Neural Networks · Physics 2015-06-11 Claudia Battistin , John Hertz , Joanna Tyrcha , Yasser Roudi

Many machine learning algorithms rely on iterative updates of uncertainty representations, ranging from variational inference and expectation-maximization, to reinforcement learning, continual learning, and multi-agent learning. In the…

Machine Learning · Computer Science 2026-02-05 Michele Caprio , Siu Lun Chau , Krikamol Muandet

It is well known that tree-based theories can describe the properties of undirected clustered networks with extremely accurate results [S. Melnik, \textit{et al}. Phys. Rev. E 83, 036112 (2011)]. It is reasonable to suggest that a motif…

Physics and Society · Physics 2023-05-17 Peter Mann , Simon Dobson

Spreading information through a network of devices is a core activity for most distributed systems. As such, self-stabilizing algorithms implementing information spreading are one of the key building blocks enabling aggregate computing to…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-02-23 Yuanqiu Mo , Soura Dasgupta , Jacob Beal

We present a novel parametric message representation for belief propagation (BP) that provides a novel grid-based way to address the cooperative localization problem in wireless networks. The proposed Grid-BP approach allows faster…

Networking and Internet Architecture · Computer Science 2015-09-11 Panagiotis-Agis Oikonomou-Filandras , Kai-Kit Wong , Yangyang Zhang

Predictive uncertainty estimation remains a challenging problem precluding the use of deep neural networks as subsystems within safety-critical applications. Aleatoric uncertainty is a component of predictive uncertainty that cannot be…

Machine Learning · Computer Science 2023-12-12 Angel Daruna , Yunye Gong , Abhinav Rajvanshi , Han-Pang Chiu , Yi Yao

Applied macroeconomists often compute confidence intervals for impulse responses using local projections, i.e., direct linear regressions of future outcomes on current covariates. This paper proves that local projection inference robustly…

Econometrics · Economics 2026-01-15 José Luis Montiel Olea , Mikkel Plagborg-Møller

The belief propagation (BP) based algorithm is investigated as a potential decoder for both of error correcting codes and lossy compression, which are based on non-monotonic tree-like multilayer perceptron encoders. We discuss that whether…

Information Theory · Computer Science 2015-03-18 Kazushi Mimura , Florent Cousseau , Masato Okada

When studying interacting systems, computing their statistical properties is a fundamental problem in various fields such as physics, applied mathematics, and machine learning. However, this task can be quite challenging due to the…

Statistical Mechanics · Physics 2023-05-04 Yijia Wang , Yuwen Ebony Zhang , Feng Pan , Pan Zhang