English
Related papers

Related papers: Fast Decentralized Linear Functions via Successive…

200 papers

Decentralized optimization over time-varying networks has a wide range of applications in distributed learning, signal processing and various distributed control problems. The agents of the distributed system locally hold optimization…

Optimization and Control · Mathematics 2023-12-14 Alexander Rogozin , Alexander Gasnikov , Aleksander Beznosikov , Dmitry Kovalev

Transformers have demonstrated success in graph learning, particularly for node-level tasks. However, existing methods encounter an information bottleneck when generating graph-level representations. The prevalent single token paradigm…

Machine Learning · Computer Science 2026-02-11 Ruixiang Wang , Yuyang Hong , Shiming Xiang , Chunhong Pan

In graph signal processing, one of the most important subjects is the study of filters, i.e., linear transformations that capture relations between graph signals. One of the most important families of filters is the space of shift invariant…

Signal Processing · Electrical Eng. & Systems 2022-09-29 Feng Ji , See Hian Lee , Wee Peng Tay

Basic operations in graph signal processing consist in processing signals indexed on graphs either by filtering them, to extract specific part out of them, or by changing their domain of representation, using some transformation or…

Signal Processing · Electrical Eng. & Systems 2017-11-07 Nicolas Tremblay , Paulo Gonçalves , Pierre Borgnat

Different layouts can characterize different aspects of the same graph. Finding a "good" layout of a graph is thus an important task for graph visualization. In practice, users often visualize a graph in multiple layouts by using different…

Social and Information Networks · Computer Science 2019-10-16 Oh-Hyun Kwon , Kwan-Liu Ma

Many neural networks for graphs are based on the graph convolution operator, proposed more than a decade ago. Since then, many alternative definitions have been proposed, that tend to add complexity (and non-linearity) to the model. In this…

Machine Learning · Computer Science 2021-06-11 Luca Pasa , Nicolò Navarin , Wolfgang Erb , Alessandro Sperduti

Transformers have recently emerged as powerful neural networks for graph learning, showcasing state-of-the-art performance on several graph property prediction tasks. However, these results have been limited to small-scale graphs, where the…

Machine Learning · Computer Science 2023-12-19 Vijay Prakash Dwivedi , Yozen Liu , Anh Tuan Luu , Xavier Bresson , Neil Shah , Tong Zhao

In the realm of generative models for graphs, extensive research has been conducted. However, most existing methods struggle with large graphs due to the complexity of representing the entire joint distribution across all node pairs and…

Social and Information Networks · Computer Science 2024-05-15 Andreas Bergmeister , Karolis Martinkus , Nathanaël Perraudin , Roger Wattenhofer

We propose a decentralised "local2global"' approach to graph representation learning, that one can a-priori use to scale any embedding technique. Our local2global approach proceeds by first dividing the input graph into overlapping…

Machine Learning · Computer Science 2022-01-14 Lucas G. S. Jeub , Giovanni Colavizza , Xiaowen Dong , Marya Bazzi , Mihai Cucuringu

Minimizing transmission delay in wireless multi-hop networks is a fundamental yet challenging task due to the complex coupling among interference, queue dynamics, and distributed control. Traditional scheduling algorithms, such as…

Signal Processing · Electrical Eng. & Systems 2025-12-10 Boxuan Wen , Junyu Luo

Many systems comprising entities in interactions can be represented as graphs, whose structure gives significant insights about how these systems work. Network theory has undergone further developments, in particular in relation to…

Data Analysis, Statistics and Probability · Physics 2016-06-14 Ronan Hamon , Pierre Borgnat , Patrick Flandrin , Céline Robardet

We suggest a new concept of functional-differential operators with constant delay on geometrical graphs that involves {\it global} delay parameter. Differential operators on graphs model various processes in many areas of science and…

Spectral Theory · Mathematics 2022-11-01 Sergey Buterin

We show theoretically and empirically that the linear Transformer, when applied to graph data, can implement algorithms that solve canonical problems such as electric flow and eigenvector decomposition. The Transformer has access to…

Machine Learning · Computer Science 2025-03-04 Xiang Cheng , Lawrence Carin , Suvrit Sra

This chapter deals with decentralized learning algorithms for in-network processing of graph-valued data. A generic learning problem is formulated and recast into a separable form, which is iteratively minimized using the…

Optimization and Control · Mathematics 2015-04-01 Georgios B. Giannakis , Qing Ling , Gonzalo Mateos , Ioannis D. Schizas , Hao Zhu

We present a new algorithmic paradigm for the decentralized solution of graph-structured optimization problems that arise in the estimation and control of network systems. A key and novel design concept of the proposed approach is that it…

Optimization and Control · Mathematics 2020-04-01 Sungho Shin , Victor M. Zavala , Mihai Anitescu

Graph neural networks (GNNs) have significantly improved the representation power for graph-structured data. Despite of the recent success of GNNs, the graph convolution in most GNNs have two limitations. Since the graph convolution is…

Machine Learning · Computer Science 2021-12-30 Jinyoung Park , Sungdong Yoo , Jihwan Park , Hyunwoo J. Kim

This paper introduces a design method for densergraph-frequency graph Fourier frames (DGFFs) to enhance graph signal processing and analysis. The graph Fourier transform (GFT) enables us to analyze graph signals in the graph spectral domain…

Signal Processing · Electrical Eng. & Systems 2025-03-18 Kaito Nitani , Seisuke Kyochi

In this paper, we discuss how to design the graph topology to reduce the communication complexity of certain algorithms for decentralized optimization. Our goal is to minimize the total communication needed to achieve a prescribed accuracy.…

Optimization and Control · Mathematics 2016-12-06 Yat-Tin Chow , Wei Shi , Tianyu Wu , Wotao Yin

Graph transformers are a recent advancement in machine learning, offering a new class of neural network models for graph-structured data. The synergy between transformers and graph learning demonstrates strong performance and versatility…

Machine Learning · Computer Science 2025-12-23 Ahsan Shehzad , Feng Xia , Shagufta Abid , Ciyuan Peng , Shuo Yu , Dongyu Zhang , Karin Verspoor

Graph signal processing is an emerging field which aims to model processes that exist on the nodes of a network and are explained through diffusion over this structure. Graph signal processing works have heretofore assumed knowledge of the…

Signal Processing · Electrical Eng. & Systems 2021-04-21 Matthew W. Morency , Geert Leus