English
Related papers

Related papers: Fast Graph Filters for Decentralized Subspace Proj…

200 papers

This paper revisits the problem of multi-agent consensus from a graph signal processing perspective. Describing a consensus protocol as a graph spectrum filter, we present an effective new approach to the analysis and design of consensus…

Systems and Control · Computer Science 2018-08-07 Jingwen Yi , Li Chai , Jingxin Zhang

The aim of this work is to develop a fully-distributed algorithmic framework for training graph convolutional networks (GCNs). The proposed method is able to exploit the meaningful relational structure of the input data, which are collected…

Machine Learning · Computer Science 2022-12-21 Simone Scardapane , Indro Spinelli , Paolo Di Lorenzo

Solving large-scale systems of nonlinear equations/inequalities is a fundamental problem in computing and optimization. In this paper, we propose a generic successive projection (SP) framework for this problem. The SP sequentially projects…

Numerical Analysis · Mathematics 2020-12-15 Wen-Jun Zeng , Jieping Ye

In this work, we are interested in adaptive and distributed estimation of graph filters from streaming data. We formulate this problem as a consensus estimation problem over graphs, which can be addressed with diffusion LMS strategies. Most…

Signal Processing · Electrical Eng. & Systems 2019-12-13 Fei Hua , Roula Nassif , Cédric Richard , Haiyan Wang , Ali H. Sayed

We consider the problem of decentralized optimization in networks with communication delays. To accommodate delays, we need decentralized optimization algorithms that work on directed graphs. Existing approaches require nodes to know their…

Optimization and Control · Mathematics 2024-12-31 Tomas Ortega , Hamid Jafarkhani

The rise of graph analytic systems has created a need for ways to measure and compare the capabilities of these systems. Graph analytics present unique scalability difficulties. The machine learning, high performance computing, and visual…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-03-07 Siddharth Samsi , Vijay Gadepally , Michael Hurley , Michael Jones , Edward Kao , Sanjeev Mohindra , Paul Monticciolo , Albert Reuther , Steven Smith , William Song , Diane Staheli , Jeremy Kepner

We propose graph-dependent implicit regularisation strategies for distributed stochastic subgradient descent (Distributed SGD) for convex problems in multi-agent learning. Under the standard assumptions of convexity, Lipschitz continuity,…

Machine Learning · Computer Science 2018-09-20 Dominic Richards , Patrick Rebeschini

For many applications in signal processing and machine learning, we are tasked with minimizing a large sum of convex functions subject to a large number of convex constraints. In this paper, we devise a new random projection method (RPM) to…

Optimization and Control · Mathematics 2024-04-08 Zhichun Yang , Fu-quan Xia , Kai Tu , Man-Chung Yue

Graph filter design is central to spectral collaborative filtering, yet most existing methods rely on manually tuned hyperparameters rather than fully learnable filters. We show that this challenge stems from a bias in traditional…

Information Retrieval · Computer Science 2026-04-27 Yunhang He , Cong Xu , Zhangchi Zhu , Hongzhi Yin , Wei Zhang

This paper explores the application diffusion maps as graph shift operators in understanding the underlying geometry of graph signals. The study evaluates the improvements in graph learning when using diffusion map generated filters to the…

Machine Learning · Computer Science 2023-12-25 Todd Hildebrant

Graph partitioning is the problem of dividing the nodes of a graph into balanced partitions while minimizing the edge cut across the partitions. Due to its combinatorial nature, many approximate solutions have been developed, including…

Machine Learning · Computer Science 2019-03-05 Azade Nazi , Will Hang , Anna Goldie , Sujith Ravi , Azalia Mirhoseini

Let $N$ local decision makers in a sensor network communicate with their neighbors to reach a decision \emph{consensus}. Communication is local, among neighboring sensors only, through noiseless or noisy links. We study the design of the…

Information Theory · Computer Science 2007-07-13 Soummya Kar , Saeed Aldosari , José M. F. Moura

Two distributed algorithms are described that enable all users connected over a network to cooperatively solve the problem of minimizing the sum of all users' objective functions over the intersection of all users' constraint sets, where…

Optimization and Control · Mathematics 2015-10-27 Hideaki Iiduka

We propose a data-driven approach for deep convolutional neural network compression that achieves high accuracy with high throughput and low memory requirements. Current network compression methods either find a low-rank factorization of…

Computer Vision and Pattern Recognition · Computer Science 2019-03-13 Breton Minnehan , Andreas Savakis

Structured sparse optimization is an important and challenging problem for analyzing high-dimensional data in a variety of applications such as bioinformatics, medical imaging, social networks, and astronomy. Although a number of structured…

Artificial Intelligence · Computer Science 2016-10-03 Baojian Zhou , Feng Chen

Recently, many researchers have been focusing on the definition of neural networks for graphs. The basic component for many of these approaches remains the graph convolution idea proposed almost a decade ago. In this paper, we extend this…

Machine Learning · Computer Science 2018-11-27 Dinh Van Tran , Nicolò Navarin , Alessandro Sperduti

The network embedding problem that maps nodes in a graph to vectors in Euclidean space can be very useful for addressing several important tasks on a graph. Recently, graph neural networks (GNNs) have been proposed for solving such a…

Machine Learning · Computer Science 2020-09-23 Ping-En Lu , Cheng-Shang Chang

Many real-world problems can be represented as graph-based learning problems. In this paper, we propose a novel framework for learning spatial and attentional convolution neural networks on arbitrary graphs. Different from previous…

Machine Learning · Computer Science 2019-02-26 Hao Peng , Jianxin Li , Qiran Gong , Senzhang Wang , Yuanxing Ning , Philip S. Yu

When a large collection of objects (e.g., robots, sensors, etc.) has to be deployed in a given environment, it is often required to plan a coordinated motion of the objects from their initial position to a final configuration enjoying some…

Data Structures and Algorithms · Computer Science 2014-07-03 Davide Bilò Luciano Gualà , Stefano Leucci , Guido Proietti

The problem of unsupervised learning node embeddings in graphs is one of the important directions in modern network science. In this work we propose a novel framework, which is aimed to find embeddings by \textit{discriminating…

Machine Learning · Statistics 2020-01-24 Stanislav Tsepa , Maxim Panov