English
Related papers

Related papers: Heterogeneous message passing for heterogeneous ne…

200 papers

Much effort has been directed at algorithms for obtaining the highest probability configuration in a probabilistic random field model known as the maximum a posteriori (MAP) inference problem. In many situations, one could benefit from…

Artificial Intelligence · Computer Science 2012-10-19 Dhruv Batra

Message-passing methods provide a powerful approach for calculating the expected size of cascades either on random networks (e.g., drawn from a configuration-model ensemble or its generalizations) asymptotically as the number $N$ of nodes…

Physics and Society · Physics 2024-01-31 James P. Gleeson , Mason A. Porter

Over the last decade or so, Approximate Message Passing (AMP) algorithms have become extremely popular in various structured high-dimensional statistical problems. The fact that the origins of these techniques can be traced back to notions…

Statistics Theory · Mathematics 2021-05-11 Oliver Y. Feng , Ramji Venkataramanan , Cynthia Rush , Richard J. Samworth

Bayesian neural networks (BNNs) offer the potential for reliable uncertainty quantification and interpretability, which are critical for trustworthy AI in high-stakes domains. However, existing methods often struggle with issues such as…

Machine Learning · Computer Science 2025-01-28 Romeo Sommerfeld , Christian Helms , Ralf Herbrich

Message-passing theories have proved to be invaluable tools in studying percolation, non-recurrent epidemics and similar dynamical processes on real-world networks. At the heart of the message-passing method is the nonbacktracking matrix…

Physics and Society · Physics 2021-11-25 G. Timár , R. A. da Costa , S. N. Dorogovtsev , J. F. F. Mendes

We propose regularized approximate message passing (RAMP), a low-complexity algorithm for discrete signal detection in overloaded multiple-input multiple-output (MIMO) systems where the number of transmit antennas exceeds the number of…

Signal Processing · Electrical Eng. & Systems 2026-04-07 Shreesal Shrestha , Getuar Rexhepi , Kuranage Roche Rayan Ranasinghe , Hyeon Seok Rou , Giuseppe Thadeu Freitas de Abreu

Graph neural networks (GNNs) are a powerful inductive bias for modelling algorithmic reasoning procedures and data structures. Their prowess was mainly demonstrated on tasks featuring Markovian dynamics, where querying any associated data…

Machine Learning · Computer Science 2021-04-28 Heiko Strathmann , Mohammadamin Barekatain , Charles Blundell , Petar Veličković

This paper concerns the analysis of a multiscale method for wave propagation problems in microscopically nonhomogeneous media. A direct numerical approximation of such problems is prohibitively expensive as it requires resolving the…

Numerical Analysis · Mathematics 2017-02-20 Doghonay Arjmand , Olof Runborg

We explore unique considerations involved in fitting ML models to data with very high precision, as is often required for science applications. We empirically compare various function approximation methods and study how they scale with…

Machine Learning · Computer Science 2023-02-01 Eric J. Michaud , Ziming Liu , Max Tegmark

We present an efficient routing approach for delivering packets in complex networks. On delivering a message from a node to a destination, a node forwards the message to a neighbor by estimating the waiting time along the shortest path from…

Networking and Internet Architecture · Computer Science 2008-06-12 Huan Zhang , Zonghua Liu , Ming Tang , P. M. Hui

Constructing a minimal vertex cover of a graph can be seen as a prototype for a combinatorial optimization problem under hard constraints. In this paper, we develop and analyze message passing techniques, namely warning and survey…

Statistical Mechanics · Physics 2007-05-23 Martin Weigt , Haijun Zhou

Global transport and communication networks enable information, ideas and infectious diseases now to spread at speeds far beyond what has historically been possible. To effectively monitor, design, or intervene in such epidemic-like…

Physics and Society · Physics 2020-02-13 Sam Moore , Tim Rogers

Orthogonal Matching Pursuit (OMP) has been a powerful method in sparse signal recovery and approximation. However, OMP suffers computational issues when the signal has a large number of non-zeros. This paper advances OMP and its extension…

Computer Vision and Pattern Recognition · Computer Science 2025-04-28 Huiyuan Yu , Jia He , Maggie Cheng

This letter proposes a novel message-passing algorithm for signal recovery in compressed sensing. The proposed algorithm solves the disadvantages of approximate message-passing (AMP) and orthogonal/vector AMP, and realizes their advantages.…

Information Theory · Computer Science 2020-04-22 Keigo Takeuchi

This paper considers the massive connectivity problem in an asynchronous grant-free random access system, where a huge number of devices sporadically transmit data to a base station (BS) with imperfect synchronization. The goal is to design…

Information Theory · Computer Science 2021-01-05 Weifeng Zhu , Meixia Tao , Xiaojun Yuan , Yunfeng Guan

We present a novel method for learning the weights of an artificial neural network - a Message Passing Learning Protocol (MPLP). In MPLP, we abstract every operations occurring in ANNs as independent agents. Each agent is responsible for…

Machine Learning · Computer Science 2020-07-06 Ettore Randazzo , Eyvind Niklasson , Alexander Mordvintsev

With many frameworks based on message passing neural networks proposed to predict molecular and bulk properties, machine learning methods have tremendously shifted the paradigms of computational sciences underpinning physics, material…

Machine Learning · Computer Science 2021-09-03 Zun Wang , Chong Wang , Sibo Zhao , Yong Xu , Shaogang Hao , Chang Yu Hsieh , Bing-Lin Gu , Wenhui Duan

As a powerful representation paradigm for networked and multi-typed data, the heterogeneous information network (HIN) is ubiquitous. Meanwhile, defining proper relevance measures has always been a fundamental problem and of great pragmatic…

Social and Information Networks · Computer Science 2019-02-22 Yu Shi , Po-Wei Chan , Honglei Zhuang , Huan Gui , Jiawei Han

Message passing neural networks have shown a lot of success on graph-structured data. However, there are many instances where message passing can lead to over-smoothing or fail when neighboring nodes belong to different classes. In this…

The growing demands of the worldwide IT infrastructure stress the need for reduced power consumption, which is addressed in so-called transprecision computing by improving energy efficiency at the expense of precision. For example, reducing…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-07-30 Andrea Borghesi , Giuseppe Tagliavini , Michele Lombardi , Luca Benini , Michela Milano