English
Related papers

Related papers: Learning Stochastic Graph Neural Networks with Con…

200 papers

Semi-supervised learning (SSL) over graph-structured data emerges in many network science applications. To efficiently manage learning over graphs, variants of graph neural networks (GNNs) have been developed recently. By succinctly…

Machine Learning · Computer Science 2021-10-22 Alireza Sadeghi , Meng Ma , Bingcong Li , Georgios B. Giannakis

Multivariate time series forecasting is a challenging task because the data involves a mixture of long- and short-term patterns, with dynamic spatio-temporal dependencies among variables. Existing graph neural networks (GNN) typically model…

Machine Learning · Computer Science 2021-12-08 Zhuoling Li , Gaowei Zhang , Lingyu Xu , Jie Yu

Despite much research, Graph Neural Networks (GNNs) still do not display the favorable scaling properties of other deep neural networks such as Convolutional Neural Networks and Transformers. Previous work has identified issues such as…

Machine Learning · Computer Science 2023-12-19 Ameen Ali , Hakan Cevikalp , Lior Wolf

It is well-known that deep neural networks (DNNs) have shown remarkable success in many fields. However, when adding an imperceptible magnitude perturbation on the model input, the model performance might get rapid decrease. To address this…

Machine Learning · Computer Science 2022-01-04 Hao Yang , Min Wang , Zhengfei Yu , Yun Zhou

Graph neural networks (GNNs) are a type of deep learning models that are trained on graphs and have been successfully applied in various domains. Despite the effectiveness of GNNs, it is still challenging for GNNs to efficiently scale to…

Machine Learning · Computer Science 2023-08-28 Yingxia Shao , Hongzheng Li , Xizhi Gu , Hongbo Yin , Yawen Li , Xupeng Miao , Wentao Zhang , Bin Cui , Lei Chen

Space-time graph neural networks (ST-GNNs) are recently developed architectures that learn efficient graph representations of time-varying data. ST-GNNs are particularly useful in multi-agent systems, due to their stability properties and…

Machine Learning · Computer Science 2022-10-31 Samar Hadou , Charilaos Kanatsoulis , Alejandro Ribeiro

While Graph Neural Networks (GNNs) excel on graph-structured data, their performance is fundamentally limited by the quality of the observed graph, which often contains noise, missing links, or structural properties misaligned with GNNs'…

Machine Learning · Computer Science 2026-01-14 Hao Deng , Bo Liu

Deep neural networks (DNNs) have achieved remarkable success in computer vision; however, training DNNs for satisfactory performance remains challenging and suffers from sensitivity to empirical selections of an optimization algorithm for…

Computer Vision and Pattern Recognition · Computer Science 2020-12-22 Haichao Zhang , Kuangrong Hao , Lei Gao , Bing Wei , Xuesong Tang

Graph convolutional networks (GCNs) are powerful deep neural networks for graph-structured data. However, GCN computes the representation of a node recursively from its neighbors, making the receptive field size grow exponentially with the…

Machine Learning · Statistics 2018-03-02 Jianfei Chen , Jun Zhu , Le Song

Graph Neural Networks (GNNs) have enjoyed wide spread applications in graph-structured data. However, existing graph based applications commonly lack annotated data. GNNs are required to learn latent patterns from a limited amount of…

Machine Learning · Computer Science 2023-03-22 Wenqi Wei , Mu Qiao , Divyesh Jadav

Consistency training is a popular method to improve deep learning models in computer vision and natural language processing. Graph neural networks (GNNs) have achieved remarkable performance in a variety of network science learning tasks,…

Machine Learning · Computer Science 2021-10-14 Cole Hawkins , Vassilis N. Ioannidis , Soji Adeshina , George Karypis

The success of neural networks over the past decade has established them as effective models for many relevant data generating processes. Statistical theory on neural networks indicates graceful scaling of sample complexity. For example,…

Machine Learning · Computer Science 2023-03-28 Yifan Zhu , Hong Jun Jeon , Benjamin Van Roy

Graph neural networks (GNNs) have gained traction over the past few years for their superior performance in numerous machine learning tasks. Graph Convolutional Neural Networks (GCN) are a common variant of GNNs that are known to have high…

Machine Learning · Computer Science 2022-07-06 Sannat Singh Bhasin , Vaibhav Holani , Divij Sanjanwala

There is a large variety of machine learning methodologies that are based on the extraction of spectral geometric information from data. However, the implementations of many of these methods often depend on traditional eigensolvers, which…

Machine Learning · Computer Science 2023-10-03 Chenghui Li , Rishi Sonthalia , Nicolas Garcia Trillos

Synchronous federated learning scales poorly due to the straggler effect. Asynchronous algorithms increase the update throughput by processing updates upon arrival, but they introduce two fundamental challenges: gradient staleness, which…

Machine Learning · Computer Science 2026-03-30 Abdelkrim Alahyane , Céline Comte , Matthieu Jonckheere

In recent years, graph neural networks (GNNs) have been widely applied in tackling combinatorial optimization problems. However, existing methods still suffer from limited accuracy when addressing that on complex graphs and exhibit poor…

Machine Learning · Computer Science 2025-11-13 Yuyao Long

Graph Neural Networks (GNNs) have achieved state-of-the-art performance in solving graph classification tasks. However, most GNN architectures aggregate information from all nodes and edges in a graph, regardless of their relevance to the…

Machine Learning · Statistics 2024-04-19 Pablo Sanchez-Martin , Kinaan Aamir Khan , Isabel Valera

Graph representation learning is a fundamental research issue and benefits a wide range of applications on graph-structured data. Conventional artificial neural network-based methods such as graph neural networks (GNNs) and variational…

Neural and Evolutionary Computing · Computer Science 2022-11-04 Hanxuan Yang , Ruike Zhang , Qingchao Kong , Wenji Mao

Graph neural networks (GNN) have recently emerged as a vehicle for applying deep network architectures to graph and relational data. However, given the increasing size of industrial datasets, in many practical situations the message passing…

Machine Learning · Computer Science 2021-11-16 Qingru Zhang , David Wipf , Quan Gan , Le Song

Spiking Neural Networks (SNNs) have been proposed as biologically plausible and energy-efficient alternatives to conventional Artificial Neural Networks (ANNs). However, the training of SNN usually relies on surrogate gradients due to the…

Neural and Evolutionary Computing · Computer Science 2026-05-11 Himanshu Udupi , Xiaocong Yang , ChengXiang Zhai