English
Related papers

Related papers: Percolation and matrix spectrum through NIB messag…

200 papers

Compressive sensing (CS) is an emerging field based on the revelation that a small collection of linear projections of a sparse signal contains enough information for stable, sub-Nyquist signal acquisition. When a statistical…

Information Theory · Computer Science 2009-06-25 Dror Baron , Shriram Sarvotham , Richard G. Baraniuk

As traditional neural network consumes a significant amount of computing resources during back propagation, \citet{Sun2017mePropSB} propose a simple yet effective technique to alleviate this problem. In this technique, only a small subset…

Machine Learning · Computer Science 2017-09-27 Bingzhen Wei , Xu Sun , Xuancheng Ren , Jingjing Xu

Percolation problems appear in a large variety of different contexts ranging from the design of composite materials to vaccination strategies on community networks. The key observable for many applications is the percolation threshold.…

Statistical Mechanics · Physics 2025-06-16 Fabian Coupette , Tanja Schilling

Belief Propagation algorithms are instruments used broadly to solve graphical model optimization and statistical inference problems. In the general case of a loopy Graphical Model, Belief Propagation is a heuristic which is quite successful…

Machine Learning · Statistics 2021-09-15 Andrii Riazanov , Yury Maximov , Michael Chertkov

In the quest for scalable Bayesian computational algorithms we need to exploit the full potential of existing methodologies. In this note we point out that message passing algorithms, which are very well developed for inference in graphical…

Computation · Statistics 2017-09-05 Omiros Papaspiliopoulos , Giacomo Zanella

We show that a modification of the first layer of a Graph Convolutional Network (GCN) can be used to effectively propagate label information across neighbor nodes, for binary and multi-class classification problems. This is done by…

Machine Learning · Computer Science 2021-04-07 Claudio Bellei , Hussain Alattas , Nesrine Kaaniche

The belief propagation (BP) based algorithm is investigated as a potential decoder for both of error correcting codes and lossy compression, which are based on non-monotonic tree-like multilayer perceptron encoders. We discuss that whether…

Information Theory · Computer Science 2015-03-18 Kazushi Mimura , Florent Cousseau , Masato Okada

Recently, a considerable literature has grown up around the theme of Graph Convolutional Network (GCN). How to effectively leverage the rich structural information in complex graphs, such as knowledge graphs with heterogeneous types of…

Machine Learning · Computer Science 2021-04-26 Donghan Yu , Yiming Yang , Ruohong Zhang , Yuexin Wu

This paper analyses LightGCN in the context of graph recommendation algorithms. Despite the initial design of Graph Convolutional Networks for graph classification, the non-linear operations are not always essential. LightGCN enables linear…

Information Retrieval · Computer Science 2023-12-29 Milena Kapralova , Luca Pantea , Andrei Blahovici

Inference of hidden classes in stochastic block model is a classical problem with important applications. Most commonly used methods for this problem involve na\"{\i}ve mean field approaches or heuristic spectral methods. Recently, belief…

Machine Learning · Computer Science 2013-02-05 Pan Zhang , Florent Krzakala , Jörg Reichardt , Lenka Zdeborová

Variational inference algorithms such as belief propagation have had tremendous impact on our ability to learn and use graphical models, and give many insights for developing or understanding exact and approximate inference. However,…

Artificial Intelligence · Computer Science 2012-10-19 Qiang Liu , Alexander T. Ihler

As belief networks are used to model increasingly complex situations, the need to automatically construct them from large databases will become paramount. This paper concentrates on solving a part of the belief network induction problem:…

Artificial Intelligence · Computer Science 2013-03-08 Ron Musick

Blockchain is based on a P2P network, supporting decentralized consensus of current cryptocurrencies. Since bitcoin and altcoins all utilize an underlying blockchain, they are therefore greatly affected by the performance of the P2P…

Networking and Internet Architecture · Computer Science 2018-09-17 Wei Bi , Huawei Yang , Maolin Zheng

We study the problem of minimizing a sum of convex objective functions where the components of the objective are available at different nodes of a network and nodes are allowed to only communicate with their neighbors. The use of…

Optimization and Control · Mathematics 2015-04-24 Aryan Mokhtari , Qing Ling , Alejandro Ribeiro

Quantum communication demands efficient distribution of quantum entanglement across a network of connected partners. The search for efficient strategies for the entanglement distribution may be based on percolation theory, which describes…

Quantum Physics · Physics 2016-08-23 Michael Siomau

In this letter, we propose a new molecular modulation scheme for nanonetworks. To evaluate the scheme we introduce a more realistic system model for molecule dissemination and propagation processes based on the Poisson distribution. We…

Information Theory · Computer Science 2012-09-26 Hamidreza Arjmandi , Amin Gohari , Masoume Nasiri Kenari , Farshid Bateni

We present new message passing algorithms for performing inference with graphical models. Our methods are designed for the most difficult inference problems where loopy belief propagation and other heuristics fail to converge. Belief…

Artificial Intelligence · Computer Science 2022-07-19 Anna Grim , Pedro Felzenszwalb

Generally, convolutional neural networks (CNNs) process data on a regular grid, e.g. data generated by ordinary cameras. Designing CNNs for sparse and irregularly spaced input data is still an open research problem with numerous…

Computer Vision and Pattern Recognition · Computer Science 2019-08-06 Abdelrahman Eldesokey , Michael Felsberg , Fahad Shahbaz Khan

We present a novel parametric message representation for belief propagation (BP) that provides a novel grid-based way to address the cooperative localization problem in wireless networks. The proposed Grid-BP approach allows faster…

Networking and Internet Architecture · Computer Science 2015-09-11 Panagiotis-Agis Oikonomou-Filandras , Kai-Kit Wong , Yangyang Zhang

Information diffusion in Online Social Networks is a new and crucial problem in social network analysis field and requires significant research attention. Efficient diffusion of information are of critical importance in diverse situations…

Social and Information Networks · Computer Science 2022-12-22 Soumita Das , Anupam Biswas , Ravi Kishore Devarapalli