English
Related papers

Related papers: On Measuring Long-Range Interactions in Graph Neur…

200 papers

Graph machine learning has enjoyed a meteoric rise in popularity since the introduction of deep learning in graph contexts. This is no surprise due to the ubiquity of graph data in large scale industrial settings. Tacitly assumed in all…

Machine Learning · Computer Science 2024-12-10 Isay Katsman , Ethan Lou , Anna Gilbert

We propose a new graph-theoretic benchmark in this paper. The benchmark is developed to address shortcomings of an existing widely-used graph benchmark. We thoroughly studied a large number of traditional and contemporary graph algorithms…

Performance · Computer Science 2010-05-06 Andy B. Yoo , Yang Liu , Sheila Vaidya , Stephen Poole

Recently, implicit graph neural networks (GNNs) have been proposed to capture long-range dependencies in underlying graphs. In this paper, we introduce and justify two weaknesses of implicit GNNs: the constrained expressiveness due to their…

Machine Learning · Computer Science 2022-10-18 Juncheng Liu , Bryan Hooi , Kenji Kawaguchi , Xiaokui Xiao

Sampling is an established technique to scale graph neural networks to large graphs. Current approaches however assume the graphs to be homogeneous in terms of relations and ignore relation types, critically important in biomedical graphs.…

Machine Learning · Computer Science 2021-05-31 Arthur Feeney , Rishabh Gupta , Veronika Thost , Rico Angell , Gayathri Chandu , Yash Adhikari , Tengfei Ma

Modelling long-range dependencies is critical for scene understanding tasks in computer vision. Although CNNs have excelled in many vision tasks, they are still limited in capturing long-range structured relationships as they typically…

Computer Vision and Pattern Recognition · Computer Science 2022-09-16 Li Zhang , Dan Xu , Anurag Arnab , Philip H. S. Torr

The problem of node-similarity in networks has motivated a plethora of such measures between node-pairs, which make use of the underlying graph structure. However, higher-order relations cannot be losslessly captured by mere graphs and…

Social and Information Networks · Computer Science 2021-11-02 Govind Sharma , Paarth Gupta , M. Narasihma Murty

Dynamic graph learning is crucial for modeling real-world systems with evolving relationships and temporal dynamics. However, the lack of a unified benchmark framework in current research has led to inaccurate evaluations of dynamic graph…

Machine Learning · Computer Science 2024-01-15 Yusen Zhang

In recent years, Graph Neural Networks (GNNs) have been popular in the graph classification task. Currently, shallow GNNs are more common due to the well-known over-smoothing problem facing deeper GNNs. However, they are sub-optimal without…

Machine Learning · Computer Science 2023-02-20 Lanning Wei , Zhiqiang He , Huan Zhao , Quanming Yao

Comparison of graph structure is a ubiquitous task in data analysis and machine learning, with diverse applications in fields such as neuroscience, cyber security, social network analysis, and bioinformatics, among others. Discovery and…

Applications · Statistics 2023-01-11 Peter Wills , Francois G. Meyer

For many graph-related problems, it can be essential to have a set of structurally diverse graphs. For instance, such graphs can be used for testing graph algorithms or their neural approximations. However, to the best of our knowledge, the…

Machine Learning · Computer Science 2024-12-13 Fedor Velikonivtsev , Mikhail Mironov , Liudmila Prokhorenkova

Graph Neural Networks (GNNs) are efficient approaches to process graph-structured data. Modelling long-distance node relations is essential for GNN training and applications. However, conventional GNNs suffer from bad performance in…

Machine Learning · Computer Science 2020-05-19 Deli Chen , Xiaoqian Liu , Yankai Lin , Peng Li , Jie Zhou , Qi Su , Xu Sun

In recent years, large language models (LLMs) have emerged as promising candidates for graph tasks. Many studies leverage natural language to describe graphs and apply LLMs for reasoning, yet most focus narrowly on performance benchmarks…

Machine Learning · Computer Science 2026-01-28 Yuxiang Wang , Xinnan Dai , Wenqi Fan , Yao Ma

Graph neural networks (GNNs) are increasingly applied to hard optimization problems, often claiming superiority over classical heuristics. However, such claims risk being unsolid due to a lack of standard benchmarks on truly hard instances.…

Large multimodal models (LMMs) have exhibited proficiencies across many visual tasks. Although numerous well-known benchmarks exist to evaluate model performance, they increasingly have insufficient headroom. As such, there is a pressing…

Computer Vision and Pattern Recognition · Computer Science 2025-10-17 Jonathan Roberts , Kai Han , Samuel Albanie

Graph embedding has recently gained momentum in the research community, in particular after the introduction of random walk and neural network based approaches. However, most of the embedding approaches focus on representing the local…

Machine Learning · Computer Science 2020-02-19 Joerg Schloetterer , Martin Wehking , Fatemeh Salehi Rizi , Michael Granitzer

Visual long-range interaction refers to modeling dependencies between distant feature points or blocks within an image, which can significantly enhance the model's robustness. Both CNN and Transformer can establish long-range interactions…

Computer Vision and Pattern Recognition · Computer Science 2023-03-13 Xiuxiu Bai , Shuaishuai Zhao , Yao Gao , Zhe Liu

Recent works have demonstrated the benefits of capturing long-distance dependency in graphs by deeper graph neural networks (GNNs). But deeper GNNs suffer from the long-lasting scalability challenge due to the neighborhood explosion problem…

Machine Learning · Computer Science 2023-06-02 Rui Xue , Haoyu Han , MohamadAli Torkamani , Jian Pei , Xiaorui Liu

Graph Neural Networks (GNNs) have been widely adopted for drug discovery with molecular graphs. Nevertheless, current GNNs mainly excel in leveraging short-range interactions (SRI) but struggle to capture long-range interactions (LRI), both…

Machine Learning · Computer Science 2024-04-02 Xuan Li , Zhanke Zhou , Jiangchao Yao , Yu Rong , Lu Zhang , Bo Han

Graph neural networks (GNNs) are popular to use for classifying structured data in the context of machine learning. But surprisingly, they are rarely applied to regression problems. In this work, we adopt GNN for a classic but challenging…

Machine Learning · Computer Science 2021-02-16 Wenzhong Yan , Di Jin , Zhidi Lin , Feng Yin

Graph neural networks have become a staple in problems addressing learning and analysis of data defined over graphs. However, several results suggest an inherent difficulty in extracting better performance by increasing the number of…

Machine Learning · Computer Science 2021-03-30 Diego Valsesia , Giulia Fracastoro , Enrico Magli