English
Related papers

Related papers: Learning Backbones: Sparsifying Graphs through Zer…

200 papers

Graph neural networks (GNNs) are shown to be successful in modeling applications with graph structures. However, training an accurate GNN model requires a large collection of labeled data and expressive features, which might be inaccessible…

Machine Learning · Computer Science 2019-06-03 Ziniu Hu , Changjun Fan , Ting Chen , Kai-Wei Chang , Yizhou Sun

Graph Neural Networks (GNNs) as deep learning models working on graph-structure data have achieved advanced performance in many works. However, it has been proved repeatedly that, not all edges in a graph are necessary for the training of…

Social and Information Networks · Computer Science 2022-11-11 Zishan Gu , Jintang Li , Liang Chen

Graph learning has a wide range of applications in many scenarios, which require more need for data privacy. Federated learning is an emerging distributed machine learning approach that leverages data from individual devices or data centers…

Machine Learning · Computer Science 2023-07-20 Peilin Liu , Yanni Tang , Mingyue Zhang , Wu Chen

In this paper, we propose Graph Retention Networks (GRNs) as a unified architecture for deep learning on dynamic graphs. The GRN extends the concept of retention into dynamic graph data as graph retention, equipping the model with three key…

Machine Learning · Computer Science 2026-04-14 Qian Chang , Xia Li , Xiufeng Cheng , Runsong Jia , Jinqing Yang , Guoping Hu , Ciprian Doru Giurcaneanu

Graph Neural Networks (GNNs) have become the backbone for a myriad of tasks pertaining to graphs and similar topological data structures. While many works have been established in domains related to node and graph classification/regression…

Machine Learning · Computer Science 2022-09-07 Appan Rakaraddi , Siew Kei Lam , Mahardhika Pratama , Marcus De Carvalho

Outstanding achievements of graph neural networks for spatiotemporal time series analysis show that relational constraints introduce an effective inductive bias into neural forecasting architectures. Often, however, the relational…

Machine Learning · Computer Science 2023-08-03 Andrea Cini , Daniele Zambon , Cesare Alippi

In this letter, we propose an algorithm for learning a sparse weighted graph by estimating its adjacency matrix under the assumption that the observed signals vary smoothly over the nodes of the graph. The proposed algorithm is based on the…

Signal Processing · Electrical Eng. & Systems 2022-05-11 Ghania Fatima , Aakash Arora , Prabhu Babu , Petre Stoica

Scalability of graph neural networks remains one of the major challenges in graph machine learning. Since the representation of a node is computed by recursively aggregating and transforming representation vectors of its neighboring nodes…

Machine Learning · Computer Science 2021-06-10 Zengfeng Huang , Shengzhong Zhang , Chong Xi , Tang Liu , Min Zhou

Learning a graph topology to reveal the underlying relationship between data entities plays an important role in various machine learning and data analysis tasks. Under the assumption that structured data vary smoothly over a graph, the…

Machine Learning · Statistics 2023-08-23 Xingyue Pu , Tianyue Cao , Xiaoyun Zhang , Xiaowen Dong , Siheng Chen

Graphons are limit objects of sequences of graphs and are used to analyze the behavior of large graphs. Recently, graphon signal processing has been developed to study signal processing on large graphs. A major limitation of this approach…

Signal Processing · Electrical Eng. & Systems 2024-03-26 Feng Ji , Xingchao Jian , Wee Peng Tay

We propose a multi-stage learning approach for pruning the search space of maximum clique enumeration, a fundamental computationally difficult problem arising in various network analysis tasks. In each stage, our approach learns the…

Machine Learning · Computer Science 2019-10-02 Marco Grassia , Juho Lauri , Sourav Dutta , Deepak Ajwani

Sparse training is a natural idea to accelerate the training speed of deep neural networks and save the memory usage, especially since large modern neural networks are significantly over-parameterized. However, most of the existing methods…

Machine Learning · Computer Science 2021-11-11 Xiao Zhou , Weizhong Zhang , Zonghao Chen , Shizhe Diao , Tong Zhang

The increasing prevalence of graph-structured data across various domains has intensified greater interest in graph classification tasks. While numerous sophisticated graph learning methods have emerged, their complexity often hinders…

Machine Learning · Computer Science 2025-09-03 Saiful Islam , Md. Nahid Hasan , Pitambar Khanra

Graph neural networks (GNNs) have shown advantages in graph-based analysis tasks. However, most existing methods have the homogeneity assumption and show poor performance on heterophilic graphs, where the linked nodes have dissimilar…

Machine Learning · Computer Science 2024-04-16 Tianhao Peng , Wenjun Wu , Haitao Yuan , Zhifeng Bao , Zhao Pengrui , Xin Yu , Xuetao Lin , Yu Liang , Yanjun Pu

A long-standing goal in deep learning has been to characterize the learning behavior of black-box models in a more interpretable manner. For graph neural networks (GNNs), considerable advances have been made in formalizing what functions…

Machine Learning · Computer Science 2024-06-19 Chenxiao Yang , Qitian Wu , David Wipf , Ruoyu Sun , Junchi Yan

Sparse connectivity is a hallmark of the brain and a desired property of artificial neural networks. It promotes energy efficiency, simplifies training, and enhances the robustness of network function. Thus, a detailed understanding of how…

Disordered Systems and Neural Networks · Physics 2024-09-10 Mirza M. Junaid Baig , Armen Stepanyants

Many material response functions depend strongly on microstructure, such as inhomogeneities in phase or orientation. Homogenization presents the task of predicting the mean response of a sample of the microstructure to external loading for…

Machine Learning · Computer Science 2022-10-04 Reese Jones , Cosmin Safta , Ari Frankel

With the development of foundation models such as large language models, zero-shot transfer learning has become increasingly significant. This is highlighted by the generative capabilities of NLP models like GPT-4, and the retrieval-based…

Machine Learning · Computer Science 2024-06-25 Yuhan Li , Peisong Wang , Zhixun Li , Jeffrey Xu Yu , Jia Li

Ensuring fairness in Graph Neural Networks is fundamental to promoting trustworthy and socially responsible machine learning systems. In response, numerous fair graph learning methods have been proposed in recent years. However, most of…

Machine Learning · Computer Science 2025-12-29 Zichong Wang , Zhipeng Yin , Liping Yang , Jun Zhuang , Rui Yu , Qingzhao Kong , Wenbin Zhang

Graph Neural Networks (GNN) rely on graph convolutions to learn features from network data. GNNs are stable to different types of perturbations of the underlying graph, a property that they inherit from graph filters. In this paper we…

Machine Learning · Computer Science 2022-02-11 Juan Cervino , Luana Ruiz , Alejandro Ribeiro