English
Related papers

Related papers: Gradient Derivation for Learnable Parameters in Gr…

200 papers

Graphs are fundamental mathematical structures used in various fields to represent data, signals and processes. In this paper, we propose a novel framework for learning/estimating graphs from data. The proposed framework includes (i)…

Machine Learning · Computer Science 2017-07-07 Hilmi E. Egilmez , Eduardo Pavez , Antonio Ortega

In this survey, we dive into Tabular Data Learning (TDL) using Graph Neural Networks (GNNs), a domain where deep learning-based approaches have increasingly shown superior performance in both classification and regression tasks compared to…

Machine Learning · Computer Science 2024-01-05 Cheng-Te Li , Yu-Che Tsai , Chih-Yao Chen , Jay Chiehen Liao

Theoretical and empirical evidence indicates that the depth of neural networks is crucial for their success. However, training becomes more difficult as depth increases, and training of very deep networks remains an open problem. Here we…

Machine Learning · Computer Science 2015-11-24 Rupesh Kumar Srivastava , Klaus Greff , Jürgen Schmidhuber

Graph Neural Networks (GNNs) have become a central tool for learning on graph-structured data, yet their applicability to real-world systems remains limited by key challenges such as scalability, temporality, directionality, data…

Machine Learning · Computer Science 2025-10-28 Emanuele Rossi

We propose an adaptive node feature selection approach for graph neural networks (GNNs) that identifies and removes unnecessary features during training. The ability to measure how features contribute to model output is key for interpreting…

Machine Learning · Computer Science 2026-05-04 Ali Azizpour , Madeline Navarro , Santiago Segarra

Topological metrics of graphs provide a natural way to describe the prominent features of various types of networks. Graph metrics describe the structure and interplay of graph edges and have found applications in many scientific fields. In…

Data Structures and Algorithms · Computer Science 2018-06-21 Loukianos Spyrou , Javier Escudero

Gating is a key feature in modern neural networks including LSTMs, GRUs and sparsely-gated deep neural networks. The backbone of such gated networks is a mixture-of-experts layer, where several experts make regression decisions and gating…

Machine Learning · Computer Science 2020-06-19 Ashok Vardhan Makkuva , Sewoong Oh , Sreeram Kannan , Pramod Viswanath

Accurate routing network status estimation is a key component in Software Defined Networking. However, existing deep-learning-based methods for modeling network routing are not able to extrapolate towards unseen feature distributions. Nor…

Networking and Internet Architecture · Computer Science 2024-04-29 Yifei Jin , Marios Daoutis , Sarunas Girdzijauskas , Aristides Gionis

Convolutional neural networks are widely used in imaging and image recognition. Learning such networks from training data leads to the minimization of a non-convex function. This makes the analysis of standard optimization methods such as…

Optimization and Control · Mathematics 2026-01-14 Jona-Maria Diederen , Holger Rauhut , Ulrich Terstiege

Integrated Gradients (IG) is a common explainability technique to address the black-box problem of neural networks. Integrated gradients assumes continuous data. Graphs are discrete structures making IG ill-suited to graphs. In this work,…

Machine Learning · Computer Science 2025-09-10 Lachlan Simpson , Kyle Millar , Adriel Cheng , Cheng-Chew Lim , Hong Gunn Chew

Graph neural networks trained to predict observable dynamics can be used to decompose the temporal activity of complex heterogeneous systems into simple, interpretable representations. Here we apply this framework to simulated neural…

Neurons and Cognition · Quantitative Biology 2026-02-17 Cédric Allier , Larissa Heinrich , Magdalena Schneider , Stephan Saalfeld

The incredible effectiveness of adversarial attacks on fooling deep neural networks poses a tremendous hurdle in the widespread adoption of deep learning in safety and security-critical domains. While adversarial defense mechanisms have…

Machine Learning · Computer Science 2020-11-20 Hossein Aboutalebi , Mohammad Javad Shafiee Alexander Wong

This paper addresses the challenging problem of retrieval and matching of graph structured objects, and makes two key contributions. First, we demonstrate how Graph Neural Networks (GNN), which have emerged as an effective model for various…

Machine Learning · Computer Science 2019-05-14 Yujia Li , Chenjie Gu , Thomas Dullien , Oriol Vinyals , Pushmeet Kohli

Graph neural networks (GNNs) have been demonstrated as a powerful tool for analyzing non-Euclidean graph data. However, the lack of efficient distributed graph learning systems severely hinders applications of GNNs, especially when graphs…

Machine Learning · Computer Science 2023-01-18 Yongchao Liu , Houyi Li , Guowei Zhang , Xintan Zeng , Yongyong Li , Bin Huang , Peng Zhang , Zhao Li , Xiaowei Zhu , Changhua He , Wenguang Chen

Graph neural networks (GNNs) have received massive attention in the field of machine learning on graphs. Inspired by the success of neural networks, a line of research has been conducted to train GNNs to deal with various tasks, such as…

Machine Learning · Computer Science 2022-04-11 Manh Tuan Do , Noseong Park , Kijung Shin

Graph structured data, specifically text-attributed graphs (TAG), effectively represent relationships among varied entities. Such graphs are essential for semi-supervised node classification tasks. Graph Neural Networks (GNNs) have emerged…

Machine Learning · Computer Science 2024-04-18 Kaiwen Dong , Zhichun Guo , Nitesh V. Chawla

Driven by the outstanding performance of neural networks in the structured Euclidean domain, recent years have seen a surge of interest in developing neural networks for graphs and data supported on graphs. The graph is leveraged at each…

Machine Learning · Computer Science 2021-07-28 Elvin Isufi , Fernando Gama , Alejandro Ribeiro

In this work, we provide a theoretical understanding of the framelet-based graph neural networks through the perspective of energy gradient flow. By viewing the framelet-based models as discretized gradient flows of some energy, we show it…

Machine Learning · Computer Science 2022-10-11 Andi Han , Dai Shi , Zhiqi Shao , Junbin Gao

Graph Neural Networks (GNNs) are a family of graph networks inspired by mechanisms existing between nodes on a graph. In recent years there has been an increased interest in GNN and their derivatives, i.e., Graph Attention Networks (GAT),…

Machine Learning · Computer Science 2022-12-21 Maciej Krzywda , Szymon Łukasik , Amir H. Gandomi

Interpretable graph learning is in need as many scientific applications depend on learning models to collect insights from graph-structured data. Previous works mostly focused on using post-hoc approaches to interpret pre-trained models…

Machine Learning · Computer Science 2022-06-20 Siqi Miao , Miaoyuan Liu , Pan Li