English
Related papers

Related papers: Not Half Bad: Exploring Half-Precision in Graph Co…

200 papers

Graph Transformers excel in long-range dependency modeling, but generally require quadratic memory complexity in the number of nodes in an input graph, and hence have trouble scaling to large graphs. Sparse attention variants such as…

Machine Learning · Computer Science 2024-11-26 Hamed Shirzad , Honghao Lin , Balaji Venkatachalam , Ameya Velingker , David Woodruff , Danica Sutherland

The Deep Graph Library (DGL) was designed as a tool to enable structure learning from graphs, by supporting a core abstraction for graphs, including the popular Graph Neural Networks (GNN). DGL contains implementations of all core graph…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-07-14 Sasikanth Avancha , Vasimuddin Md , Sanchit Misra , Ramanarayan Mohanty

We present a scalable approach for semi-supervised learning on graph-structured data that is based on an efficient variant of convolutional neural networks which operate directly on graphs. We motivate the choice of our convolutional…

Machine Learning · Computer Science 2017-02-23 Thomas N. Kipf , Max Welling

Graph Neural Networks (GNNs) have emerged as powerful tools for learning representations of graph-structured data. In addition to real-valued GNNs, quaternion GNNs also perform well on tasks on graph-structured data. With the aim of…

Machine Learning · Computer Science 2025-03-03 Rucha Bhalchandra Joshi , Sagar Prakash Barad , Nidhi Tiwari , Subhankar Mishra

Graph neural networks (GNNs) encounter significant computational challenges when handling large-scale graphs, which severely restricts their efficacy across diverse applications. To address this limitation, graph condensation has emerged as…

Machine Learning · Computer Science 2023-12-12 Xinyi Gao , Tong Chen , Yilong Zang , Wentao Zhang , Quoc Viet Hung Nguyen , Kai Zheng , Hongzhi Yin

In this work, we propose to employ information-geometric tools to optimize a graph neural network architecture such as the graph convolutional networks. More specifically, we develop optimization algorithms for the graph-based…

Machine Learning · Computer Science 2020-08-25 Mohammad Rasool Izadi , Yihao Fang , Robert Stevenson , Lizhen Lin

Recently, Graph Convolutional Networks (GCNs) and their variants have been receiving many research interests for learning graph-related tasks. While the GCNs have been successfully applied to this problem, some caveats inherited from…

Machine Learning · Computer Science 2019-11-11 Mustafa Coskun

Large-scale graph training is a notoriously challenging problem for graph neural networks (GNNs). Due to the nature of evolving graph structures into the training process, vanilla GNNs usually fail to scale up, limited by the GPU memory…

Machine Learning · Computer Science 2023-03-02 Keyu Duan , Zirui Liu , Peihao Wang , Wenqing Zheng , Kaixiong Zhou , Tianlong Chen , Xia Hu , Zhangyang Wang

Graph neural networks (GNNs) are among the most powerful tools in deep learning. They routinely solve complex problems on unstructured networks, such as node classification, graph classification, or link prediction, with high accuracy.…

Machine Learning · Computer Science 2023-08-21 Maciej Besta , Torsten Hoefler

An important part of many machine learning workflows on graphs is vertex representation learning, i.e., learning a low-dimensional vector representation for each vertex in the graph. Recently, several powerful techniques for unsupervised…

Machine Learning · Computer Science 2019-01-23 Hooman Peiro Sajjad , Andrew Docherty , Yuriy Tyshetskiy

Brain imaging data such as EEG or MEG are high-dimensional spatiotemporal data often degraded by complex, non-Gaussian noise. For reliable analysis of brain imaging data, it is important to extract discriminative, low-dimensional intrinsic…

Computer Vision and Pattern Recognition · Computer Science 2017-05-16 Yiluan Guo , Hossein Nejati , Ngai-Man Cheung

Graph learning algorithms have attained state-of-the-art performance on many graph analysis tasks such as node classification, link prediction, and clustering. It has, however, become hard to track the field's burgeoning progress. One…

Machine Learning · Computer Science 2022-04-05 Anton Tsitsulin , Benedek Rozemberczki , John Palowitch , Bryan Perozzi

Convolutional Neural Networks are extensively used in a wide range of applications, commonly including computer vision tasks like image and video classification, recognition, and segmentation. Recent research results demonstrate that…

Signal Processing · Electrical Eng. & Systems 2020-05-11 Marco Carreras , Gianfranco Deriu , Luigi Raffo , Luca Benini , Paolo Meloni

In this work, we present a memory-efficient fully convolutional network (FCN) incorporated with several memory-optimized techniques to reduce the run-time GPU memory demand during training phase. In medical image segmentation tasks,…

Image and Video Processing · Electrical Eng. & Systems 2020-03-25 Chenglong Wang , Masahiro Oda , Kensaku Mori

Graph neural networks (GNNs) have recently emerged as a promising learning paradigm in learning graph-structured data and have demonstrated wide success across various domains such as recommendation systems, social networks, and electronic…

Machine Learning · Computer Science 2023-04-25 Ruixuan Wang , Fred Lin , Daniel Moore , Sriram Sankar , Xun Jiao

The era of "data deluge" has sparked renewed interest in graph-based learning methods and their widespread applications ranging from sociology and biology to transportation and communications. In this context of graph-aware methods, the…

Machine Learning · Computer Science 2020-12-30 Vassilis N. Ioannidis , Antonio G. Marques , Georgios B. Giannakis

Graph neural networks (GNNs) have been widely applied in multi-variate time-series forecasting (MTSF) tasks because of their capability in capturing the correlations among different time-series. These graph-based learning approaches improve…

Machine Learning · Computer Science 2023-06-30 Ngoc-Dung Do , Truong Son Hy , Duy Khuong Nguyen

Deep Convolutional Neural Networks (CNNs) are widely employed in modern computer vision algorithms, where the input image is convolved iteratively by many kernels to extract the knowledge behind it. However, with the depth of convolutional…

Computer Vision and Pattern Recognition · Computer Science 2018-04-11 Chih-Ting Liu , Yi-Heng Wu , Yu-Sheng Lin , Shao-Yi Chien

We focus on graph-to-sequence learning, which can be framed as transducing graph structures to sequences for text generation. To capture structural information associated with graphs, we investigate the problem of encoding graphs using…

Computation and Language · Computer Science 2019-09-10 Zhijiang Guo , Yan Zhang , Zhiyang Teng , Wei Lu

Graph Neural Networks (GNNs) are key tools for graph representation learning, demonstrating strong results across diverse prediction tasks. In this paper, we present Convexified Message-Passing Graph Neural Networks (CGNNs), a novel and…

Machine Learning · Computer Science 2026-01-27 Saar Cohen , Noa Agmon , Uri Shaham