English
Related papers

Related papers: Optimality of Message-Passing Architectures for Sp…

200 papers

With the wide-spread availability of complex relational data, semi-supervised node classification in graphs has become a central machine learning problem. Graph neural networks are a recent class of easy-to-train and accurate methods for…

Machine Learning · Computer Science 2021-06-08 Junteng Jia , Cenk Baykal , Vamsi K. Potluru , Austin R. Benson

Graph Neural Networks (GNNs) and their message passing framework that leverages both structural and feature information, have become a standard method for solving graph-based machine learning problems. However, these approaches still…

Machine Learning · Computer Science 2024-11-20 Simon Delarue , Thomas Bonald , Tiphaine Viard

Inference and optimization of real-value edge variables in sparse graphs are studied using the Bethe approximation and replica method of statistical physics. Equilibrium states of general energy functions involving a large set of real…

Disordered Systems and Neural Networks · Physics 2009-11-11 K. Y. Michael Wong , D. Saad

Graph Neural Networks (GNN) exhibit superior performance in graph representation learning, but their inference cost can be high, due to an aggregation operation that can require a memory fetch for a very large number of nodes. This…

Machine Learning · Computer Science 2025-03-18 Yaochen Hu , Mai Zeng , Ge Zhang , Pavel Rumiantsev , Liheng Ma , Yingxue Zhang , Mark Coates

In machine learning, classifiers are typically susceptible to noise in the training data. In this work, we aim at reducing intra-class noise with the help of graph filtering to improve the classification performance. Considered graphs are…

Machine Learning · Statistics 2021-01-26 Mounia Hamidouche , Carlos Lassance , Yuqing Hu , Lucas Drumetz , Bastien Pasdeloup , Vincent Gripon

Bayesian networks are basic graphical models, used widely both in statistics and artificial intelligence. These statistical models of conditional independence structure are described by acyclic directed graphs whose nodes correspond to…

Optimization and Control · Mathematics 2010-12-01 Raymond Hemmecke , Silvia Lindner , Milan Studený

Graph Neural Networks (GNNs) are prominent in handling sparse and unstructured data efficiently and effectively. Specifically, GNNs were shown to be highly effective for node classification tasks, where labelled information is available for…

Machine Learning · Computer Science 2022-12-01 Moshe Eliasof , Eldad Haber , Eran Treister

This paper begins with considering the identification of sparse linear time-invariant networks described by multivariable ARX models. Such models possess relatively simple structure thus used as a benchmark to promote further research. With…

Systems and Control · Computer Science 2016-10-03 J. Jin , Y. Yuan , W. Pan , D. L. T. Pham , C. J. Tomlin , A. Webb , J. Goncalves

In computational physics, machine learning has now emerged as a powerful complementary tool to explore efficiently candidate designs in engineering studies. Outputs in such supervised problems are signals defined on meshes, and a natural…

Machine Learning · Statistics 2025-03-11 Raphaël Carpintero Perez , Sébastien da Veiga , Josselin Garnier , Brian Staber

This paper studies asynchronous message passing (AMP), a new paradigm for applying neural network based learning to graphs. Existing graph neural networks use the synchronous distributed computing model and aggregate their neighbors in each…

Machine Learning · Computer Science 2022-05-25 Lukas Faber , Roger Wattenhofer

Constructing a spanning tree of a graph is one of the most basic tasks in graph theory. We consider a relaxed version of this problem in the setting of local algorithms. The relaxation is that the constructed subgraph is a sparse spanning…

Data Structures and Algorithms · Computer Science 2021-04-28 Reut Levi , Dana Ron , Ronitt Rubinfeld

Consider a sensor network made of remote nodes connected to a common fusion center. In a recent work Blum and Sadler [1] propose the idea of ordered transmissions -sensors with more informative samples deliver their messages first- and…

Information Theory · Computer Science 2011-03-29 Paolo Braca , Stefano Marano , Vincenzo Matta

In this paper, we are interested in learning the underlying graph structure behind training data. Solving this basic problem is essential to carry out any graph signal processing or machine learning task. To realize this, we assume that the…

Machine Learning · Computer Science 2018-05-08 Sundeep Prabhakar Chepuri , Sijia Liu , Geert Leus , Alfred O. Hero

This paper presents a general asymptotic theory of sequential Bayesian estimation giving results for the strongest, almost sure convergence. We show that under certain smoothness conditions on the probability model, the greedy information…

Statistics Theory · Mathematics 2016-01-11 Janne V. Kujala

We propose new mathematical optimization models for generating sparse dynamical graphs, or networks, that can achieve synchronization. The synchronization phenomenon is studied using the Kuramoto model, defined in terms of the adjacency…

Optimization and Control · Mathematics 2020-06-23 Regina S. Burachik , Alexander C. Kalloniatis , C. Yalçın Kaya

Neural networks are usually not the tool of choice for nonparametric high-dimensional problems where the number of input features is much larger than the number of observations. Though neural networks can approximate complex multivariate…

Methodology · Statistics 2019-06-25 Jean Feng , Noah Simon

We consider the problem of estimating the parameters of a Gaussian or binary distribution in such a way that the resulting undirected graphical model is sparse. Our approach is to solve a maximum likelihood problem with an added l_1-norm…

Artificial Intelligence · Computer Science 2007-07-06 Onureena Banerjee , Laurent El Ghaoui , Alexandre d'Aspremont

This paper considers the optimal multi-agent persistent monitoring problem defined for a team of agents on a set of nodes (targets) interconnected according to a fixed network topology. The aim is to control this team so as to minimize a…

Optimization and Control · Mathematics 2020-12-14 Shirantha Welikala , Christos G. Cassandras

The problem of clock offset estimation in a two way timing message exchange regime is considered when the likelihood function of the observation time stamps is Gaussian, exponential or log-normally distributed. A parametrized solution to…

Information Theory · Computer Science 2012-02-01 Aitzaz Ahmad , Davide Zennaro , Erchin Serpedin , Lorenzo Vangelista

Graph Neural Networks (GNNs) have been predominant for graph learning tasks; however, recent studies showed that a well-known graph algorithm, Label Propagation (LP), combined with a shallow neural network can achieve comparable performance…

Machine Learning · Computer Science 2022-12-01 Zhiqiang Zhong , Sergey Ivanov , Jun Pang