English
Related papers

Related papers: Susceptibility Propagation by Using Diagonal Consi…

200 papers

We introduce a new class of lower bounds on the log partition function of a Markov random field which makes use of a reversed Jensen's inequality. In particular, our method approximates the intractable distribution using a linear…

Machine Learning · Computer Science 2012-03-19 Qiang Liu , Alexander T. Ihler

The Hopfield network is reconstructed as an inverse Ising problem by passing messages. The applied susceptibility propagation algorithm is shown to improve significantly on other mean-field-type methods and extends well into the low…

Disordered Systems and Neural Networks · Physics 2011-11-18 Haiping Huang

We propose consensus propagation, an asynchronous distributed protocol for averaging numbers across a network. We establish convergence, characterize the convergence rate for regular graphs, and demonstrate that the protocol exhibits better…

Information Theory · Computer Science 2007-07-13 Ciamac C. Moallemi , Benjamin Van Roy

A number of problems in statistical physics and computer science can be expressed as the computation of marginal probabilities over a Markov random field. Belief propagation, an iterative message-passing algorithm, computes exactly such…

Machine Learning · Statistics 2012-10-23 Victorin Martin , Jean-Marc Lasgouttes , Cyril Furtlehner

The aim of this paper is to propose diffusion strategies for distributed estimation over adaptive networks, assuming the presence of spatially correlated measurements distributed according to a Gaussian Markov random field (GMRF) model. The…

Systems and Control · Computer Science 2015-06-22 Paolo Di Lorenzo

We study the susceptibility propagation, a message-passing algorithm to compute correlation functions. It is applied to constraint satisfaction problems and its accuracy is examined. As a heuristic method to find a satisfying assignment, we…

Disordered Systems and Neural Networks · Physics 2010-07-29 Saburo Higuchi , Marc Mézard

The standard method for the propagation of errors, based on a Taylor series expansion, is approximate and frequently inadequate for realistic problems. A simple and generic technique is described in which the likelihood is constructed…

High Energy Physics - Experiment · Physics 2015-06-25 J. Swain , L. Taylor

Belief propagation is a widely used message passing method for the solution of probabilistic models on networks such as epidemic models, spin models, and Bayesian graphical models, but it suffers from the serious shortcoming that it works…

Statistical Mechanics · Physics 2021-04-27 Alec Kirkley , George T. Cantwell , M. E. J. Newman

We propose a new approach for propagating stable probability distributions through neural networks. Our method is based on local linearization, which we show to be an optimal approximation in terms of total variation distance for the ReLU…

Machine Learning · Computer Science 2024-02-14 Felix Petersen , Aashwin Mishra , Hilde Kuehne , Christian Borgelt , Oliver Deussen , Mikhail Yurochkin

A novel approach is suggested for improving the accuracy of fault detection in distribution networks. This technique combines adaptive probability learning and waveform decomposition to optimize the similarity of features. Its objective is…

Signal Processing · Electrical Eng. & Systems 2023-10-03 Xinliang Ma , Weihua Liu , Bingying Jin

Belief Propagation (BP) is a widely used approximation for exact probabilistic inference in graphical models, such as Markov Random Fields (MRFs). In graphs with cycles, however, no exact convergence guarantees for BP are known, in general.…

Artificial Intelligence · Computer Science 2016-12-28 Wolfgang Gatterbauer

In a complex system, perturbations propagate by following paths on the network of interactions among the system's units. In contrast to what happens with the spreading of epidemics, observations of general perturbations are often very…

Social and Information Networks · Computer Science 2018-01-08 Francesco Alessandro Massucci , Jonathan Wheeler , Raul Beltran-Debon , Jorge Joven , Marta Sales-Pardo , Roger Guimera

Gradients have been exploited in proposal distributions to accelerate the convergence of Markov chain Monte Carlo algorithms on discrete distributions. However, these methods require a natural differentiable extension of the target discrete…

Machine Learning · Computer Science 2023-02-28 Yue Xiang , Dongyao Zhu , Bowen Lei , Dongkuan Xu , Ruqi Zhang

There is currently growing interest in modeling the information diffusion on social networks across multi-disciplines. The majority of the corresponding research has focused on information diffusion independently, ignoring the network…

Physics and Society · Physics 2020-02-28 Chuang Liu , Nan Zhou , Xiu-Xiu Zhan , Gui-Quan Sun , Zi-Ke Zhang

The belief propagation (BP) algorithm is widely applied to perform approximate inference on arbitrary graphical models, in part due to its excellent empirical properties and performance. However, little is known theoretically about when…

Artificial Intelligence · Computer Science 2012-06-26 Alexander T. Ihler

Many approximate Bayesian inference methods assume a particular parametric form for approximating the posterior distribution. A multivariate Gaussian distribution provides a convenient density for such approaches; examples include the…

Methodology · Statistics 2023-02-20 Jackson Zhou , Clara Grazian , John Ormerod

We provide a novel method for sensitivity analysis of parametric robust Markov chains. These models incorporate parameters and sets of probability distributions to alleviate the often unrealistic assumption that precise probabilities are…

Machine Learning · Computer Science 2023-05-03 Thom Badings , Sebastian Junges , Ahmadreza Marandi , Ufuk Topcu , Nils Jansen

In this paper, we study a fast approximate inference method based on expectation propagation for exploring the posterior probability distribution arising from the Bayesian formulation of nonlinear inverse problems. It is capable of…

Numerical Analysis · Mathematics 2015-06-18 Matthias Gehre , Bangti Jin

We elaborate on the idea that loop corrections to belief propagation could be dealt with in a systematic way on pairwise Markov random fields, by using the elements of a cycle basis to define region in a generalized belief propagation…

Disordered Systems and Neural Networks · Physics 2016-07-20 Cyril Furtlehner , Aurélien Decelle

We develop an advanced mean field method for approximating averages in probabilistic data models that is based on the TAP approach of disorder physics. In contrast to conventional TAP, where the knowledge of the distribution of couplings…

Disordered Systems and Neural Networks · Physics 2009-11-07 Manfred Opper , Ole Winther
‹ Prev 1 2 3 10 Next ›