English
Related papers

Related papers: Stronger Graph Transformer with Regularized Attent…

200 papers

Graph Neural Networks (GNNs) are widely used to perform different machine learning tasks on graphs. As the size of the graphs grows, and the GNNs get deeper, training and inference time become costly in addition to the memory requirement.…

Machine Learning · Computer Science 2022-08-09 Md. Khaledur Rahman , Ariful Azad

Graph rewiring has emerged as a key technique to alleviate over-squashing in Graph Neural Networks (GNNs) and Graph Transformers by modifying the graph topology to improve information flow. While effective, rewiring inherently alters the…

Machine Learning · Computer Science 2025-10-24 Alexandre Benoit , Catherine Aitken , Yu He

Convolution Neural Networks on Graphs are important generalization and extension of classical CNNs. While previous works generally assumed that the graph structures of samples are regular with unified dimensions, in many applications, they…

Machine Learning · Computer Science 2017-08-17 Ruoyu Li , Junzhou Huang

Cooperative beamforming design has been recognized as an effective approach in modern wireless networks to meet the dramatically increasing demand of various wireless data traffics. It is formulated as an optimization problem in…

Networking and Internet Architecture · Computer Science 2022-12-16 Yunqi Wang , Yang Li , Qingjiang Shi , Yik-Chung Wu

In the field of deep learning, Graph Neural Networks (GNNs) and Graph Transformer models, with their outstanding performance and flexible architectural designs, have become leading technologies for processing structured data, especially…

Machine Learning · Computer Science 2025-02-04 Jiawei E , Yinglong Zhang , Xuewen Xia , Xing Xu

Recent efforts show that neural networks are vulnerable to small but intentional perturbations on input features in visual classification tasks. Due to the additional consideration of connections between examples (\eg articles with citation…

Machine Learning · Computer Science 2019-12-17 Fuli Feng , Xiangnan He , Jie Tang , Tat-Seng Chua

In this paper, we investigate image reconstruction for dynamic Computed Tomography. The motion of the target with respect to the measurement acquisition rate leads to highly resolved in time but highly undersampled in space measurements.…

Image and Video Processing · Electrical Eng. & Systems 2025-06-27 Pablo Arratia , Matthias Ehrhardt , Lisa Kreusser

We propose a novel benchmarking methodology for graph neural networks (GNNs) based on the graph alignment problem, a combinatorial optimization task that generalizes graph isomorphism by aligning two unlabeled graphs to maximize overlapping…

Machine Learning · Computer Science 2025-05-20 Adrien Lagesse , Marc Lelarge

Learning node representations that incorporate information from graph structure benefits wide range of tasks on graph. The majority of existing graph neural networks (GNNs) have limited power in capturing position information for a given…

Machine Learning · Computer Science 2021-06-15 Yuheng Lu , Jinpeng Chen , ChuXiong Sun , Jie Hu

Dynamic interactions between entities are prevalent in domains like social platforms, financial systems, healthcare, and e-commerce. These interactions can be effectively represented as time-evolving graphs, where predicting future…

Machine Learning · Computer Science 2026-01-21 Sidharth Agarwal , Tanishq Dubey , Shubham Gupta , Srikanta Bedathur

Graph Neural Networks (GNNs) have become important tools for machine learning on graph-structured data. In this paper, we explore the synergistic combination of graph encoding, graph rewiring, and graph attention, by introducing Graph…

Machine Learning · Computer Science 2025-03-18 Tongzhou Liao , Barnabás Póczos

The improvement of traffic efficiency at urban intersections receives strong research interest in the field of automated intersection management. So far, mostly non-learning algorithms like reservation or optimization-based ones were…

Robotics · Computer Science 2022-11-10 Marvin Klimke , Jasper Gerigk , Benjamin Völz , Michael Buchholz

Graph neural networks (GNNs) are the dominant approach to solving machine learning problems defined over graphs. Despite much theoretical and empirical work in recent years, our understanding of finer-grained aspects of architectural design…

Machine Learning · Computer Science 2024-10-15 Dhruv Rohatgi , Tanya Marwah , Zachary Chase Lipton , Jianfeng Lu , Ankur Moitra , Andrej Risteski

Graph Neural Networks (GNNs) are the first choice for learning algorithms on graph data. GNNs promise to integrate (i) node features as well as (ii) edge information in an end-to-end learning algorithm. How does this promise work out…

Machine Learning · Computer Science 2021-03-12 Lukas Faber , Yifan Lu , Roger Wattenhofer

Graph Neural Networks (GNNs) have emerged as powerful tools for learning on graph-structured data, but often struggle to balance local and global information. While graph Transformers aim to address this by enabling long-range interactions,…

Machine Learning · Computer Science 2025-11-18 Jeongwhan Choi , Seungjun Park , Sumin Park , Sung-Bae Cho , Noseong Park

Recently the Transformer structure has shown good performances in graph learning tasks. However, these Transformer models directly work on graph nodes and may have difficulties learning high-level information. Inspired by the vision…

Machine Learning · Computer Science 2023-04-11 Han Gao , Xu Han , Jiaoyang Huang , Jian-Xun Wang , Li-Ping Liu

Recent studies have highlighted significant fairness issues in Graph Transformer (GT) models, particularly against subgroups defined by sensitive features. Additionally, GTs are computationally intensive and memory-demanding, limiting their…

Machine Learning · Computer Science 2025-01-03 Renqiang Luo , Huafei Huang , Ivan Lee , Chengpei Xu , Jianzhong Qi , Feng Xia

Graph-structured data is ubiquitous in practice and often processed using graph neural networks (GNNs). With the adoption of recent laws ensuring the ``right to be forgotten'', the problem of graph data removal has become of significant…

Machine Learning · Computer Science 2022-11-01 Eli Chien , Chao Pan , Olgica Milenkovic

Graph Neural Networks (GNNs) use a fully-connected layer to extract features from the nodes of a graph and aggregate these features using message passing between nodes, combining two distinct computational patterns: dense, regular…

Hardware Architecture · Computer Science 2021-03-22 Jacob R. Stevens , Dipankar Das , Sasikanth Avancha , Bharat Kaul , Anand Raghunathan

Graph neural networks (GNNs) have achieved superior performance in various applications, but training dedicated GNNs can be costly for large-scale graphs. Some recent work started to study the pre-training of GNNs. However, none of them…

Machine Learning · Computer Science 2021-10-27 Qi Zhu , Carl Yang , Yidan Xu , Haonan Wang , Chao Zhang , Jiawei Han