English
Related papers

Related papers: Characterizing and Understanding HGNNs on GPUs

200 papers

Graph neural networks for heterogeneous graph embedding is to project nodes into a low-dimensional space by exploring the heterogeneity and semantics of the heterogeneous graph. However, on the one hand, most of existing heterogeneous graph…

Machine Learning · Computer Science 2022-12-01 Zezhi Shao , Yongjun Xu , Wei Wei , Fei Wang , Zhao Zhang , Feida Zhu

In the last decade or so, we have witnessed deep learning reinvigorating the machine learning field. It has solved many problems in the domains of computer vision, speech recognition, natural language processing, and various other tasks…

Machine Learning · Computer Science 2021-09-09 Lilapati Waikhom , Ripon Patgiri

Recently, graph-based models designed for downstream tasks have significantly advanced research on graph neural networks (GNNs). GNN baselines based on neural message-passing mechanisms such as GCN and GAT perform worse as the network…

Machine Learning · Computer Science 2023-01-26 Jiayuan Chen , Xiang Zhang , Yinfei Xu , Tianli Zhao , Renjie Xie , Wei Xu

Graph Neural Networks (GNN) can capture the geometric properties of neural representations in EEG data. Here we utilise those to study how reinforcement-based motor learning affects neural activity patterns during motor planning, leveraging…

Machine Learning · Computer Science 2024-11-01 Federico Nardi , Jinpei Han , Shlomi Haar , A. Aldo Faisal

Recently, increasing attention has been paid to heterogeneous graph representation learning (HGRL), which aims to embed rich structural and semantic information in heterogeneous information networks (HINs) into low-dimensional node…

Machine Learning · Computer Science 2022-10-12 Zhiqiang Zhong , Cheng-Te Li , Jun Pang

Graph representation learning methods are highly effective in handling complex non-Euclidean data by capturing intricate relationships and features within graph structures. However, traditional methods face challenges when dealing with…

Machine Learning · Computer Science 2025-02-25 Hang Gao , Chenhao Zhang , Fengge Wu , Junsuo Zhao , Changwen Zheng , Huaping Liu

Graph neural networks (GNNs) are powerful graph-based machine-learning models that are popular in various domains, e.g., social media, transportation, and drug discovery. However, owing to complex data representations, GNNs do not easily…

Machine Learning · Computer Science 2024-05-14 Pantea Habibi , Peyman Baghershahi , Sourav Medya , Debaleena Chattopadhyay

Higher-order graph neural networks (HOGNNs) and the related architectures from Topological Deep Learning are an important class of GNN models that harness polyadic relations between vertices beyond plain edges. They have been used to…

We analyze the performance of graph neural network (GNN) architectures from the perspective of random graph theory. Our approach promises to complement existing lenses on GNN analysis, such as combinatorial expressive power and worst-case…

Machine Learning · Computer Science 2023-10-12 Drake Brown , Trevor Garrity , Kaden Parker , Jason Oliphant , Stone Carson , Cole Hanson , Zachary Boyd

Inspired by recent improvements in point cloud processing for autonomous navigation, we focus on using hierarchical graph neural networks for processing and feature learning over large-scale outdoor LiDAR point clouds. We observe that…

Computer Vision and Pattern Recognition · Computer Science 2023-01-18 Arulmolivarman Thieshanthan , Amashi Niwarthana , Pamuditha Somarathne , Tharindu Wickremasinghe , Ranga Rodrigo

Graph neural networks (GNNs) have recently exploded in popularity thanks to their broad applicability to graph-related problems such as quantum chemistry, drug discovery, and high energy physics. However, meeting demand for novel GNN models…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-10-20 Rishov Sarkar , Stefan Abi-Karam , Yuqi He , Lakshmi Sathidevi , Cong Hao

Graph neural networks (GNNs) are a powerful tool to learn representations on graphs by iteratively aggregating features from node neighbourhoods. Many variant models have been proposed, but there is limited understanding on both how to…

Machine Learning · Computer Science 2019-11-14 Michael Lingzhi Li , Meng Dong , Jiawei Zhou , Alexander M. Rush

Heterogeneous temporal graphs (HTGs) are ubiquitous data structures in the real world. Recently, to enhance representation learning on HTGs, numerous attention-based neural networks have been proposed. Despite these successes, existing…

Machine Learning · Computer Science 2025-10-22 Yili Wang , Tairan Huang , Changlong He , Qiutong Li , Jianliang Gao

This extended abstract describes a framework for analyzing the expressiveness, learning, and (structural) generalization of hypergraph neural networks (HyperGNNs). Specifically, we focus on how HyperGNNs can learn from finite datasets and…

Machine Learning · Computer Science 2023-03-10 Zhezheng Luo , Jiayuan Mao , Joshua B. Tenenbaum , Leslie Pack Kaelbling

Representing and learning from graphs is essential for developing effective machine learning models tailored to non-Euclidean data. While Graph Neural Networks (GNNs) strive to address the challenges posed by complex, high-dimensional graph…

Quantum Physics · Physics 2025-01-15 Wenxuan Wang

The task of inferring the missing links in a graph based on its current structure is referred to as link prediction. Link prediction methods that are based on pairwise node similarity are well-established approaches in the literature. They…

Social and Information Networks · Computer Science 2020-08-21 Md Kamrul Islam , Sabeur Aridhi , Malika Smail-Tabbone

Under circumstances of heterophily, where nodes with different labels tend to be connected based on semantic meanings, Graph Neural Networks (GNNs) often exhibit suboptimal performance. Current studies on graph heterophily mainly focus on…

Machine Learning · Computer Science 2024-11-13 Yilun Zheng , Jiahao Xu , Lihui Chen

Hypergraph, an expressive structure with flexibility to model the higher-order correlations among entities, has recently attracted increasing attention from various research domains. Despite the success of Graph Neural Networks (GNNs) for…

Machine Learning · Computer Science 2021-05-04 Jing Huang , Jie Yang

Graph neural networks (GNNs) have attracted increasing attention due to their superior performance in deep learning on graph-structured data. GNNs have succeeded across various domains such as social networks, chemistry, and electronic…

Cryptography and Security · Computer Science 2022-08-19 Lilas Alrahis , Satwik Patnaik , Muhammad Shafique , Ozgur Sinanoglu

GPUs are used for training, inference, and tuning the machine learning models. However, Deep Neural Network (DNN) vary widely in their ability to exploit the full power of high-performance GPUs. Spatial sharing of GPU enables multiplexing…

Neural and Evolutionary Computing · Computer Science 2020-08-11 Aditya Dhakal , Junguk Cho , Sameer G. Kulkarni , K. K. Ramakrishnan , Puneet Sharma