English
Related papers

Related papers: Towards Dynamic Graph Neural Networks with Provabl…

200 papers

In recent years, deep neural networks (DNNs) have known an important rise in popularity. However, although they are state-of-the-art in many machine learning challenges, they still suffer from several limitations. For example, DNNs require…

Machine Learning · Computer Science 2021-10-11 Carlos Lassance , Myriam Bontonou , Mounia Hamidouche , Bastien Pasdeloup , Lucas Drumetz , Vincent Gripon

Learning useful node and graph representations with graph neural networks (GNNs) is a challenging task. It is known that deep GNNs suffer from over-smoothing where, as the number of layers increases, node representations become nearly…

Machine Learning · Computer Science 2022-02-28 Pantelis Elinas , Edwin V. Bonilla

The integration of Graph Neural Networks (GNNs) and Neural Ordinary and Partial Differential Equations has been extensively studied in recent years. GNN architectures powered by neural differential equations allow us to reason about their…

Machine Learning · Computer Science 2024-06-18 Moshe Eliasof , Eldad Haber , Eran Treister

Graph representation learning resurges as a trending research subject owing to the widespread use of deep learning for Euclidean data, which inspire various creative designs of neural networks in the non-Euclidean domain, particularly…

Developing models capable of complex, multi-step reasoning is a central goal in artificial intelligence. While representing problems as graphs is a powerful approach, Graph Neural Networks (GNNs) are fundamentally constrained by their…

Machine Learning · Computer Science 2026-02-03 Jingcheng Yu , Mingliang Zeng , Qiwei Ye

Graph Neural Networks (GNNs) have excelled in handling graph-structured data, attracting significant research interest. However, two primary challenges have emerged: interference between topology and attributes distorting node…

Machine Learning · Computer Science 2024-11-19 Yachao Yang , Yanfeng Sun , Jipeng Guo , Junbin Gao , Shaofan Wang , Fujiao Ju , Baocai Yin

Hypergraph Neural Networks (HyGNNs) have demonstrated remarkable success in modeling higher-order relationships among entities. However, their performance often degrades on heterophilic hypergraphs, where nodes connected by the same…

Machine Learning · Computer Science 2026-02-17 Tianyi Ma , Yiyue Qian , Zehong Wang , Zheyuan Zhang , Chuxu Zhang , Yanfang Ye

We introduce Hyperdimensional Graph Learner (HDGL), a novel method for node classification and link prediction in graphs. HDGL maps node features into a very high-dimensional space (\textit{hyperdimensional} or HD space for short) using the…

Machine Learning · Computer Science 2025-02-28 Abhishek Dalvi , Vasant Honavar

Temporal graph networks (TGNs) have gained prominence as models for embedding dynamic interactions, but little is known about their theoretical underpinnings. We establish fundamental results about the representational power and limits of…

Machine Learning · Computer Science 2022-10-03 Amauri H. Souza , Diego Mesquita , Samuel Kaski , Vikas Garg

Training deep graph neural networks (GNNs) poses a challenging task, as the performance of GNNs may suffer from the number of hidden message-passing layers. The literature has focused on the proposals of {over-smoothing} and…

Machine Learning · Statistics 2023-02-27 Yirui Liu , Xinghao Qiao , Liying Wang , Jessica Lam

A dynamic graph (DG) is frequently encountered in numerous real-world scenarios. Consequently, A dynamic graph convolutional network (DGCN) has been successfully applied to perform precise representation learning on a DG. However,…

Machine Learning · Computer Science 2025-04-23 Minglian Han

Hypergraphs provide a natural framework to model higher-order interactions in scientific, social, and biological systems. Hypergraph neural networks (HGNNs) aim to learn from such data, yet it remains unclear which higher-order structures…

Convolutional Neural Network (CNN) has demonstrated impressive ability to represent hyperspectral images and to achieve promising results in hyperspectral image classification. However, traditional CNN models can only operate convolution on…

Image and Video Processing · Electrical Eng. & Systems 2019-05-16 Sheng Wan , Chen Gong , Ping Zhong , Bo Du , Lefei Zhang , Jian Yang

Graph neural networks (GNNs) integrate deep architectures and topological structure modeling in an effective way. However, the performance of existing GNNs would decrease significantly when they stack many layers, because of the…

Machine Learning · Computer Science 2021-07-07 Kaixiong Zhou , Xiao Huang , Daochen Zha , Rui Chen , Li Li , Soo-Hyun Choi , Xia Hu

In recent years, a wide variety of graph neural network (GNN) architectures have emerged, each with its own strengths, weaknesses, and complexities. Various techniques, including rewiring, lifting, and node annotation with centrality…

Machine Learning · Computer Science 2024-10-14 Zhifei Li , Gerrit Großmann , Verena Wolf

Over the last few years, we have witnessed the availability of an increasing data generated from non-Euclidean domains, which are usually represented as graphs with complex relationships, and Graph Neural Networks (GNN) have gained a high…

Machine Learning · Computer Science 2023-08-15 Andrea Apicella , Francesco Isgrò , Andrea Pollastro , Roberto Prevete

The impressive expressive power of deep neural networks (DNNs) underlies their widespread applicability. However, while the theoretical capacity of deep architectures is high, the practical expressive power achieved through successful…

Machine Learning · Computer Science 2023-12-21 Zezhong Zhang , Feng Bao , Guannan Zhang

By leveraging recent progress of stochastic gradient descent methods, several works have shown that graphs could be efficiently laid out through the optimization of a tailored objective function. In the meantime, Deep Learning (DL)…

Machine Learning · Computer Science 2021-08-11 Loann Giovannangeli , Frederic Lalanne , David Auber , Romain Giot , Romain Bourqui

Graph neural networks have shown significant success in the field of graph representation learning. Graph convolutions perform neighborhood aggregation and represent one of the most important graph operations. Nevertheless, one layer of…

Machine Learning · Computer Science 2020-07-21 Meng Liu , Hongyang Gao , Shuiwang Ji

In recent years, we have witnessed a surge of Graph Neural Networks (GNNs), most of which can learn powerful representations in an end-to-end fashion with great success in many real-world applications. They have resemblance to Probabilistic…

Machine Learning · Computer Science 2023-08-03 Zhen Zhang , Mohammed Haroon Dupty , Fan Wu , Javen Qinfeng Shi , Wee Sun Lee