English
Related papers

Related papers: SoK: The Faults in our Graph Benchmarks

200 papers

Despite advances in the field of Graph Neural Networks (GNNs), only a small number (~5) of datasets are currently used to evaluate new models. This continued reliance on a handful of datasets provides minimal insight into the performance…

Machine Learning · Computer Science 2022-07-11 John Palowitch , Anton Tsitsulin , Brandon Mayer , Bryan Perozzi

The vast amounts of data used in social, business or traffic networks, biology and other natural sciences are often managed in graph-based data sets, consisting of a few thousand up to billions and trillions of vertices and edges,…

Databases · Computer Science 2021-10-22 Matthias Hauck , Ismail Oukid , Holger Fröning

Graph pooling has gained attention for its ability to obtain effective node and graph representations for various downstream tasks. Despite the recent surge in graph pooling approaches, there is a lack of standardized experimental settings…

Machine Learning · Computer Science 2026-04-03 Pengyun Wang , Junyu Luo , Yanxin Shen , Ming Zhang , Shaoen Qin , Hanwen Xing , Siyu Heng , Xiao Luo

The rise of graph analytic systems has created a need for ways to measure and compare the capabilities of these systems. Graph analytics present unique scalability difficulties. The machine learning, high performance computing, and visual…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-03-07 Siddharth Samsi , Vijay Gadepally , Michael Hurley , Michael Jones , Edward Kao , Sanjeev Mohindra , Paul Monticciolo , Albert Reuther , Steven Smith , William Song , Diane Staheli , Jeremy Kepner

Graph-level regression underpins many real-world applications, yet public benchmarks remain heavily skewed toward molecular graphs and citation networks. This limited diversity hinders progress on models that must generalize across both…

Machine Learning · Computer Science 2026-05-04 Peter Samoaa , Marcus Vukojevic , Morteza Haghir Chehreghani , Antonio Longa

Benchmark datasets have proved pivotal to the success of graph learning, and good benchmark datasets are crucial to guide the development of the field. Recent research has highlighted problems with graph-learning datasets and benchmarking…

Machine Learning · Computer Science 2025-08-21 Corinna Coupette , Jeremy Wayland , Emily Simons , Bastian Rieck

Predicting missing links in complex networks requires algorithms that are able to explore statistical regularities in the existing data. Here we investigate the interplay between algorithm efficiency and network structures through the…

Social and Information Networks · Computer Science 2025-02-14 Alexey Vlaskin , Eduardo G. Altmann

With the advent of the big data, graph are processed in an iterative manner, which incrementally described in the form of graph in big data applications. Most currently, graph processing methods treat the underlying map data as black boxes.…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-06-05 Beibei Si

Benchmark data sets are an indispensable ingredient of the evaluation of graph-based machine learning methods. We release a new data set, compiled from International Planning Competitions (IPC), for benchmarking graph classification,…

Machine Learning · Computer Science 2019-05-17 Patrick Ferber , Tengfei Ma , Siyu Huo , Jie Chen , Michael Katz

Graph neural networks (GNNs) have attracted much attention due to their ability to leverage the intrinsic geometries of the underlying data. Although many different types of GNN models have been developed, with many benchmarking procedures…

Graph mining has become crucial in fields such as social science, finance, and cybersecurity. Many large-scale real-world networks exhibit both heterogeneity, where multiple node and edge types exist in the graph, and heterophily, where…

Machine Learning · Computer Science 2025-06-04 Junhong Lin , Xiaojie Guo , Shuaicheng Zhang , Yada Zhu , Julian Shun

Graph neural networks (GNNs) are powerful tools for learning from graph-structured data but often produce biased predictions with respect to sensitive attributes. Fairness-aware GNNs have been actively studied for mitigating biased…

Machine Learning · Computer Science 2025-10-22 Yuya Sasaki

Graph classification aims to categorize graphs based on their structural and attribute features, with applications in diverse fields such as social network analysis and bioinformatics. Among the methods proposed to solve this task, those…

Machine Learning · Computer Science 2025-07-23 Lucas Potin , Rosa Figueiredo , Vincent Labatut , Christine Largeron

Nowadays, the analysis of complex phenomena modeled by graphs plays a crucial role in many real-world application domains where decisions can have a strong societal impact. However, numerous studies and papers have recently revealed that…

Machine Learning · Computer Science 2024-02-23 Charlotte Laclau , Christine Largeron , Manvi Choudhary

Graph Neural Networks (GNNs) have achieved great success on a node classification task. Despite the broad interest in developing and evaluating GNNs, they have been assessed with limited benchmark datasets. As a result, the existing…

Machine Learning · Computer Science 2022-12-29 Seiji Maekawa , Koki Noda , Yuya Sasaki , Makoto Onizuka

Graph is a well known data structure to represent the associated relationships in a variety of applications, e.g., data science and machine learning. Despite a wealth of existing efforts on developing graph processing systems for improving…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-02-28 Chuangyi Gui , Long Zheng , Bingsheng He , Cheng Liu , Xinyu Chen , Xiaofei Liao , Hai Jin

The rapidly growing number of large network analysis problems has led to the emergence of many parallel and distributed graph processing systems---one survey in 2014 identified over 80. Since then, the landscape has evolved; some packages…

Performance · Computer Science 2017-05-18 Samuel Pollard , Boyana Norris

The occurrence of diffusion on a graph is a prevalent and significant phenomenon, as evidenced by the spread of rumors, influenza-like viruses, smart grid failures, and similar events. Comprehending the behaviors of flow is a formidable…

Social and Information Networks · Computer Science 2023-08-09 Zijian Zhang , Zonghan Zhang , Zhiqian Chen

Knowledge graphs automatically constructed from text are increasingly used in real-world applications. However, their inherent noise, fragmentation, and semantic inconsistencies significantly affect the performance of Graph Neural Networks…

Machine Learning · Computer Science 2026-05-08 Othmane Kabal , Mounira Harzallah , Fabrice Guillet , Hideaki Takeda , Ryutaro Ichise

In the last few years, graph neural networks (GNNs) have become the standard toolkit for analyzing and learning from data on graphs. This emerging field has witnessed an extensive growth of promising techniques that have been applied with…

Machine Learning · Computer Science 2022-12-29 Vijay Prakash Dwivedi , Chaitanya K. Joshi , Anh Tuan Luu , Thomas Laurent , Yoshua Bengio , Xavier Bresson