English
Related papers

Related papers: Learning Backbones: Sparsifying Graphs through Zer…

200 papers

Compression and sparsification algorithms are frequently applied in a preprocessing step before analyzing or optimizing large networks/graphs. In this paper we propose and study a new framework contracting edges of a graph (merging vertices…

Data Structures and Algorithms · Computer Science 2019-02-14 Aaron Bernstein , Karl Däubel , Yann Disser , Max Klimm , Torsten Mütze , Frieder Smolny

Graph Neural Networks (GNNs) have demonstrated superior performance across various graph learning tasks but face significant computational challenges when applied to large-scale graphs. One effective approach to mitigate these challenges is…

Machine Learning · Computer Science 2024-10-04 Guibin Zhang , Xiangguo Sun , Yanwei Yue , Chonghe Jiang , Kun Wang , Tianlong Chen , Shirui Pan

Graph Neural Networks (GNNs) have become powerful tools for learning from graph-structured data, finding applications across diverse domains. However, as graph sizes and connectivity increase, standard GNN training methods face significant…

Machine Learning · Computer Science 2025-12-01 Eshed Gal , Moshe Eliasof , Carola-Bibiane Schönlieb , Ivan I. Kyrchei , Eldad Haber , Eran Treister

We present the Graph Forward-Forward (GFF) algorithm, an extension of the Forward-Forward procedure to graphs, able to handle features distributed over a graph's nodes. This allows training graph neural networks with forward passes only,…

Machine Learning · Computer Science 2023-02-13 Daniele Paliotta , Mathieu Alain , Bálint Máté , François Fleuret

We propose Sparse Neural Network architectures that are based on random or structured bipartite graph topologies. Sparse architectures provide compression of the models learned and speed-ups of computations, they can also surpass their…

Machine Learning · Computer Science 2017-06-20 Alfred Bourely , John Patrick Boueri , Krzysztof Choromonski

Graph neural networks (GNNs) have been widely used in representation learning on graphs and achieved superior performance in tasks such as node classification. However, analyzing heterogeneous graph of different types of nodes and links…

Machine Learning · Computer Science 2021-01-08 Shin-woo Park , Byung Jun Bae , Jinyoung Yeo , Seung-won Hwang

Turning the weights to zero when training a neural network helps in reducing the computational complexity at inference. To progressively increase the sparsity ratio in the network without causing sharp weight discontinuities during…

Computer Vision and Pattern Recognition · Computer Science 2023-01-25 Antoine Vanderschueren , Christophe De Vleeschouwer

In this paper, we propose a general framework for constructing tight framelet systems on graphs with localized supports based on partition trees. Our construction of framelets provides a simple and efficient way to obtain the orthogonality…

Signal Processing · Electrical Eng. & Systems 2025-09-09 Ruigang Zheng , Xiaosheng Zhuang

Recent work in Deep Learning has re-imagined the representation of data as functions mapping from a coordinate space to an underlying continuous signal. When such functions are approximated by neural networks this introduces a compelling…

Machine Learning · Statistics 2022-08-09 Jonathan Richard Schwarz , Yee Whye Teh

Graph signals offer a very generic and natural representation for data that lives on networks or irregular structures. The actual data structure is however often unknown a priori but can sometimes be estimated from the knowledge of the…

Machine Learning · Computer Science 2017-07-19 Hermina Petric Maretic , Dorina Thanou , Pascal Frossard

Despite the tremendous success of graph-based learning systems in handling structural data, it has been widely investigated that they are fragile to adversarial attacks on homophilic graph data, where adversaries maliciously modify the…

Machine Learning · Computer Science 2025-09-05 Yulin Zhu , Yuni Lai , Xing Ai , Wai Lun LO , Gaolei Li , Jianhua Li , Di Tang , Xingxing Zhang , Mengpei Yang , Kai Zhou

Traditional classification tasks learn to assign samples to given classes based solely on sample features. This paradigm is evolving to include other sources of information, such as known relations between samples. Here we show that, even…

Machine Learning · Computer Science 2021-04-15 Yifan Qian , Paul Expert , Pietro Panzarasa , Mauricio Barahona

Deep neural networks have significantly alleviated the burden of feature engineering, but comparable efforts are now required to determine effective architectures for these networks. Furthermore, as network sizes have become excessively…

Machine Learning · Computer Science 2023-10-25 Yognjin Lee

Brain graphs, which model the structural and functional relationships between brain regions, are crucial in neuroscientific and clinical applications involving graph classification. However, dense brain graphs pose computational challenges…

Machine Learning · Computer Science 2023-06-27 Gaotang Li , Marlena Duda , Xiang Zhang , Danai Koutra , Yujun Yan

Computing latent representations for graph-structured data is an ubiquitous learning task in many industrial and academic applications ranging from molecule synthetization to social network analysis and recommender systems. Knowledge graphs…

Neural and Evolutionary Computing · Computer Science 2023-08-25 Victor Caceres Chian , Marcel Hildebrandt , Thomas Runkler , Dominik Dold

Graph structure learning is a core problem in graph-based machine learning, essential for uncovering latent relationships and ensuring model interpretability. However, most existing approaches are ill-suited for large-scale and dynamically…

Machine Learning · Computer Science 2025-05-20 Mohit Kataria , Nikita Malik , Sandeep Kumar , Jayadeva

Label propagation is a powerful and flexible semi-supervised learning technique on graphs. Neural networks, on the other hand, have proven track records in many supervised learning tasks. In this work, we propose a training framework with a…

Machine Learning · Computer Science 2017-03-16 Thang D. Bui , Sujith Ravi , Vivek Ramavajjala

Graph neural networks (GNN) are powerful models for many graph-structured tasks. Existing models often assume that the complete structure of the graph is available during training. In practice, however, graph-structured data is usually…

Machine Learning · Computer Science 2022-03-29 Chen Wang , Yuheng Qiu , Dasong Gao , Sebastian Scherer

Graph is a fundamental mathematical structure in characterizing relations between different objects and has been widely used on various learning tasks. Most methods implicitly assume a given graph to be accurate and complete. However, real…

Machine Learning · Computer Science 2024-03-07 Xuanting Xie , Zhao Kang , Wenyu Chen

Graph sparsification is a well-established technique for accelerating graph-based learning algorithms, which uses edge sampling to approximate dense graphs with sparse ones. Because the sparsification error is random and unknown, users must…

Machine Learning · Computer Science 2025-03-12 Siyao Wang , Miles E. Lopes