English
Related papers

Related papers: Global Self-Attention as a Replacement for Graph C…

200 papers

Brain connectomes, representing neural connectivity as graphs, are crucial for understanding brain organization but costly and time-consuming to acquire, motivating generative approaches. Recent advances in graph generative modeling offer a…

Machine Learning · Computer Science 2025-08-14 Yitong Luo , Islem Rekik

In this paper, we present a novel approach to Handwritten Mathematical Expression Recognition (HMER) by leveraging graph-based modeling techniques. We introduce an End-to-end model with an Edge-weighted Graph Attention Mechanism (EGAT),…

Computer Vision and Pattern Recognition · Computer Science 2024-10-25 Yejing Xie , Richard Zanibbi , Harold Mouchère

Graph convolutional networks (GCNs) have recently become one of the most powerful tools for graph analytics tasks in numerous applications, ranging from social networks and natural language processing to bioinformatics and chemoinformatics,…

Machine Learning · Computer Science 2019-04-05 Fengwen Chen , Shirui Pan , Jing Jiang , Huan Huo , Guodong Long

Over the past decade, Deep Convolutional Neural Networks have been widely adopted for medical image segmentation and shown to achieve adequate performance. However, due to the inherent inductive biases present in the convolutional…

Computer Vision and Pattern Recognition · Computer Science 2021-07-08 Jeya Maria Jose Valanarasu , Poojan Oza , Ilker Hacihaliloglu , Vishal M. Patel

A number of problems can be formulated as prediction on graph-structured data. In this work, we generalize the convolution operator from regular grids to arbitrary graphs while avoiding the spectral domain, which allows us to handle graphs…

Computer Vision and Pattern Recognition · Computer Science 2017-08-09 Martin Simonovsky , Nikos Komodakis

Traditional convolutional neural networks are limited to handling Euclidean space data, overlooking the vast realm of real-life scenarios represented as graph data, including transportation networks, social networks, and reference networks.…

Machine Learning · Computer Science 2023-07-04 Xingyu Liu , Juan Chen , Quan Wen

Graph clustering is essential in graph analysis for revealing structural patterns and node communities. Despite recent advances in self-supervised contrastive learning that have improved clustering via structural and attribute signals,…

Machine Learning · Computer Science 2026-05-28 Lei Zhang , Fubo Sun , Haipeng Yang , Zhong Guan , Likang Wu

Graph data, also known as complex network data, is omnipresent across various domains and applications. Prior graph neural network models primarily focused on extracting task-specific structural features through supervised learning…

Machine Learning · Computer Science 2024-03-26 Hongyin Zhu

The development of graph neural networks (GCN) makes it possible to learn structural features from evolving complex networks. Even though a wide range of realistic networks are directed ones, few existing works investigated the properties…

Social and Information Networks · Computer Science 2020-08-25 Jinsong Li , Jianhua Peng , Shuxin Liu , Lintianran Weng , Cong Li

In conventional distributed learning over a network, multiple agents collaboratively build a common machine learning model. However, due to the underlying non-i.i.d. data distribution among agents, the unified learning model becomes…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-06-28 Zhuojun Tian , Zhaoyang Zhang , Zhaohui Yang , Richeng Jin , Huaiyu Dai

We introduce Attention Graphs, a new tool for mechanistic interpretability of Graph Neural Networks (GNNs) and Graph Transformers based on the mathematical equivalence between message passing in GNNs and the self-attention mechanism in…

Machine Learning · Computer Science 2025-02-26 Batu El , Deepro Choudhury , Pietro Liò , Chaitanya K. Joshi

The burgeoning volume of graph data presents significant computational challenges in training graph neural networks (GNNs), critically impeding their efficiency in various applications. To tackle this challenge, graph condensation (GC) has…

Machine Learning · Computer Science 2024-06-13 Xinyi Gao , Tong Chen , Wentao Zhang , Yayong Li , Xiangguo Sun , Hongzhi Yin

Graph neural networks (GNNs), which propagate the node features through the edges and learn how to transform the aggregated features under label supervision, have achieved great success in supervised feature extraction for both node-level…

Machine Learning · Statistics 2022-11-01 Yilin He , Chaojie Wang , Hao Zhang , Bo Chen , Mingyuan Zhou

Graph Convolutional Networks (GCNs) achieve great success in non-Euclidean structure data processing recently. In existing studies, deeper layers are used in CCNs to extract deeper features of Euclidean structure data. However, for…

Machine Learning · Computer Science 2022-03-14 Junhua Ma , Jiajun Li , Xueming Li , Xu Li

A graph is a powerful concept for representation of relations between pairs of entities. Data with underlying graph structure can be found across many disciplines and there is a natural desire for understanding such data better. Deep…

Machine Learning · Computer Science 2019-01-25 Martin Simonovsky

3D meshes are fundamental data representations for capturing complex geometric shapes in computer vision and graphics applications. While Convolutional Neural Networks (CNNs) have excelled in structured data like images, extending them to…

Graphics · Computer Science 2025-07-09 Saqib Nazir , Olivier Lézoray , Sébastien Bougleux

We present Bi-Level Attention-Based Relational Graph Convolutional Networks (BR-GCN), unique neural network architectures that utilize masked self-attentional layers with relational graph convolutions, to effectively operate on highly…

Machine Learning · Computer Science 2024-04-16 Roshni G. Iyer , Wei Wang , Yizhou Sun

Learning representation on graph plays a crucial role in numerous tasks of pattern recognition. Different from grid-shaped images/videos, on which local convolution kernels can be lattices, however, graphs are fully coordinate-free on…

Machine Learning · Computer Science 2018-11-13 Jiatao Jiang , Zhen Cui , Chunyan Xu , Jian Yang

Many real-world IoT systems, which include a variety of internet-connected sensory devices, produce substantial amounts of multivariate time series data. Meanwhile, vital IoT infrastructures like smart power grids and water distribution…

Machine Learning · Computer Science 2022-01-19 Zekai Chen , Dingshuo Chen , Xiao Zhang , Zixuan Yuan , Xiuzhen Cheng

Graph classification is an important learning task for graph-structured data. Graph neural networks (GNNs) have recently gained growing attention in graph learning and have shown significant improvements in many important graph problems.…

Machine Learning · Computer Science 2024-01-31 Tao Wen , Elynn Chen , Yuzhou Chen