English
Related papers

Related papers: Optimality of Message-Passing Architectures for Sp…

200 papers

Colouring sparse graphs under various restrictions is a theoretical problem of significant practical relevance. Here we consider the problem of maximizing the number of different colours available at the nodes and their neighbourhoods,…

Data Structures and Algorithms · Computer Science 2009-11-13 K. Y. Michael Wong , David Saad

We consider the problem of information aggregation in sensor networks, where one is interested in computing a function of the sensor measurements. We allow for block processing and study in-network function computation in directed graphs…

Information Theory · Computer Science 2015-03-19 Hemant Kowshik , P. R. Kumar

Graph representation learning has achieved great success in many areas, including e-commerce, chemistry, biology, etc. However, the fundamental problem of choosing the appropriate dimension of node embedding for a given graph still remains…

Machine Learning · Computer Science 2021-09-01 Gongxu Luo , Jianxin Li , Jianlin Su , Hao Peng , Carl Yang , Lichao Sun , Philip S. Yu , Lifang He

This article studies the asymptotic properties of Bayesian or frequentist estimators of a vector of parameters related to structural properties of sequences of graphs. The estimators studied originate from a particular class of graphex…

Statistics Theory · Mathematics 2025-02-06 Zacharie Naulet , Judith Rousseau , François Caron

In this work, we discover that causal inference provides a promising approach to capture heterophilic message-passing in Graph Neural Network (GNN). By leveraging cause-effect analysis, we can discern heterophilic edges based on asymmetric…

Machine Learning · Computer Science 2024-11-28 Botao Wang , Jia Li , Heng Chang , Keli Zhang , Fugee Tsung

The problem of network-constrained averaging is to compute the average of a set of values distributed throughout a graph G using an algorithm that can pass messages only along graph edges. We study this problem in the noisy setting, in…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-06-15 Nima Noorshams , Martin Wainwright

Most Graph Neural Networks (GNNs) operate at the first-order scale, even though multi-scale representations are known to be crucial in domains such as image classification. In this work, we investigate whether GNNs can similarly benefit…

Machine Learning · Computer Science 2026-04-15 Qin Jiang , Chengjia Wang , Michael Lones , Dongdong Chen , Wei Pang

Shape matching has been a long-studied problem for the computer graphics and vision community. The objective is to predict a dense correspondence between meshes that have a certain degree of deformation. Existing methods either consider the…

Computer Vision and Pattern Recognition · Computer Science 2022-02-04 Mahdi Saleh , Shun-Cheng Wu , Luca Cosmo , Nassir Navab , Benjamin Busam , Federico Tombari

Graph alignment, the problem of identifying corresponding nodes across multiple graphs, is fundamental to numerous applications. Most existing unsupervised methods embed node features into latent representations to enable cross-graph…

Machine Learning · Computer Science 2025-09-30 Maysam Behmanesh , Erkan Turan , Maks Ovsjanikov

The max-product algorithm, a local message-passing scheme that attempts to compute the most probable assignment (MAP) of a given probability distribution, has been successfully employed as a method of approximate inference for applications…

Information Theory · Computer Science 2014-01-07 Nicholas Ruozzi , Sekhar Tatikonda

We study large-scale systems operating under the JSQ$(d)$ policy in the presence of stringent task-server compatibility constraints. Consider a system with $N$ identical single-server queues and $M(N)$ task types, where each server is able…

Probability · Mathematics 2020-08-25 Daan Rutten , Debankur Mukherjee

This paper aims to propose and theoretically analyze a new distributed scheme for sparse linear regression and feature selection. The primary goal is to learn the few causal features of a high-dimensional dataset based on noisy observations…

Machine Learning · Statistics 2021-11-05 Hanie Barghi , Amir Najafi , Seyed Abolfazl Motahari

We study optimal estimation for sparse principal component analysis when the number of non-zero elements is small but on the same order as the dimension of the data. We employ approximate message passing (AMP) algorithm and its state…

Information Theory · Computer Science 2020-01-22 Thibault Lesieur , Florent Krzakala , Lenka Zdeborova

We consider a class of spreading processes on networks, which generalize commonly used epidemic models such as the SIR model or the SIS model with a bounded number of re-infections. We analyse the related problem of inference of the…

Disordered Systems and Neural Networks · Physics 2024-07-22 D. Ghio , A. L. M. Aragon , I. Biazzo , L. Zdeborova

Matching local features across images is a fundamental problem in computer vision. Targeting towards high accuracy and efficiency, we propose Seeded Graph Matching Network, a graph neural network with sparse structure to reduce redundant…

Computer Vision and Pattern Recognition · Computer Science 2021-08-20 Hongkai Chen , Zixin Luo , Jiahui Zhang , Lei Zhou , Xuyang Bai , Zeyu Hu , Chiew-Lan Tai , Long Quan

In deep neural networks, better results can often be obtained by increasing the complexity of previously developed basic models. However, it is unclear whether there is a way to boost performance by decreasing the complexity of such models.…

Machine Learning · Computer Science 2022-06-07 Junran Wu , Shangzhe Li , Jianhao Li , Yicheng Pan , Ke Xu

Stochastic optimization algorithms update models with cheap per-iteration costs sequentially, which makes them amenable for large-scale data analysis. Such algorithms have been widely studied for structured sparse models where the sparsity…

Machine Learning · Computer Science 2019-05-10 Baojian Zhou , Feng Chen , Yiming Ying

This study utilizes community structures to address node degree biases in message-passing (MP) via learnable graph augmentations and novel graph transformers. Recent augmentation-based methods showed that MP neural networks often perform…

Machine Learning · Computer Science 2023-12-29 Van Thuy Hoang , O-Joun Lee

Various alignment problems arising in cryo-electron microscopy, community detection, time synchronization, computer vision, and other fields fall into a common framework of synchronization problems over compact groups such as Z/L, U(1), or…

Information Theory · Computer Science 2018-09-14 Amelia Perry , Alexander S. Wein , Afonso S. Bandeira , Ankur Moitra

This paper addresses the problem of learning a sparse structure Bayesian network from high-dimensional discrete data. Compared to continuous Bayesian networks, learning a discrete Bayesian network is a challenging problem due to the large…

Machine Learning · Computer Science 2022-09-27 Nazanin Shajoonnezhad , Amin Nikanjam