English
Related papers

Related papers: Simplicial Attention Networks

200 papers

Graph neural networks (GNNs) model nonlinear representations in graph data with applications in distributed agent coordination, control, and planning among others. Current GNN architectures assume ideal scenarios and ignore link…

Signal Processing · Electrical Eng. & Systems 2021-09-01 Zhan Gao , Elvin Isufi , Alejandro Ribeiro

The stock market is characterized by a complex relationship between companies and the market. This study combines a sequential graph structure with attention mechanisms to learn global and local information within temporal time.…

Statistical Finance · Quantitative Finance 2023-01-25 Tzu-Ya Lai , Wen Jung Cheng , Jun-En Ding

We present a novel Recurrent Graph Network (RGN) approach for predicting discrete marked event sequences by learning the underlying complex stochastic process. Using the framework of Point Processes, we interpret a marked discrete event…

Machine Learning · Computer Science 2022-08-12 Saurabh Dash , Xueyuan She , Saibal Mukhopadhyay

Graph neural networks (GNNs) are commonly described as being permutation equivariant with respect to node relabeling in the graph. This symmetry of GNNs is often compared to the translation equivariance of Euclidean convolution neural…

Machine Learning · Statistics 2023-11-20 Ningyuan Huang , Ron Levie , Soledad Villar

Recently, neural network architectures have been developed to accommodate when the data has the structure of a graph or, more generally, a hypergraph. While useful, graph structures can be potentially limiting. Hypergraph structures in…

Algebraic Topology · Mathematics 2020-12-14 Eric Bunch , Qian You , Glenn Fung , Vikas Singh

Graph Self-Supervised Learning (GSSL) has emerged as a powerful paradigm for generating high-quality representations for graph-structured data. While multi-scale graph contrastive learning has received increasing attention, many existing…

Machine Learning · Computer Science 2026-05-14 Mohamed Mahmoud Amar , Nairouz Mrabah , Mohamed Bouguessa , Abdoulaye Baniré Diallo

In this work, we propose a methodology for investigating the use of semantic attention to enhance the explainability of Graph Neural Network (GNN)-based models. Graph Deep Learning (GDL) has emerged as a promising field for tasks like scene…

Machine Learning · Computer Science 2023-10-24 Efimia Panagiotaki , Daniele De Martini , Lars Kunze

This paper studies learning node representations with graph neural networks (GNNs) for unsupervised scenario. Specifically, we derive a theoretical analysis and provide an empirical demonstration about the non-steady performance of GNNs…

Machine Learning · Computer Science 2021-12-16 Lu Yu , Shichao Pei , Lizhong Ding , Jun Zhou , Longfei Li , Chuxu Zhang , Xiangliang Zhang

The dominant graph neural networks (GNNs) over-rely on the graph links, several serious performance problems with which have been witnessed already, e.g., suspended animation problem and over-smoothing problem. What's more, the inherently…

Machine Learning · Computer Science 2020-01-23 Jiawei Zhang , Haopeng Zhang , Congying Xia , Li Sun

Graph neural networks (GNNs) are typically applied to static graphs that are assumed to be known upfront. This static input structure is often informed purely by insight of the machine learning practitioner, and might not be optimal for the…

Graph Neural Networks (GNNs) have emerged as the de facto standard for modeling graph data, with attention mechanisms and transformers significantly enhancing their performance on graph-based tasks. Despite these advancements, the…

Machine Learning · Computer Science 2025-04-07 Nikhil Shivakumar Nayak

Graph Attention Networks (GATs) are the state-of-the-art neural architecture for representation learning with graphs. GATs learn attention functions that assign weights to nodes so that different nodes have different influences in the…

Machine Learning · Computer Science 2019-10-29 Guangtao Wang , Rex Ying , Jing Huang , Jure Leskovec

Following the success of deep convolutional networks in various vision and speech related tasks, researchers have started investigating generalizations of the well-known technique for graph-structured data. A recently-proposed method called…

Social and Information Networks · Computer Science 2018-09-21 John Boaz Lee , Ryan A. Rossi , Xiangnan Kong , Sungchul Kim , Eunyee Koh , Anup Rao

Graph Convolutional Neural Networks (Graph CNNs) are generalizations of classical CNNs to handle graph data such as molecular data, point could and social networks. Current filters in graph CNNs are built for fixed and shared graph…

Machine Learning · Computer Science 2018-01-11 Ruoyu Li , Sheng Wang , Feiyun Zhu , Junzhou Huang

Attention-based graph neural networks (GNNs), such as graph attention networks (GATs), have become popular neural architectures for processing graph-structured data and learning node embeddings. Despite their empirical success, these models…

Machine Learning · Statistics 2023-06-07 Dexiong Chen , Paolo Pellizzoni , Karsten Borgwardt

Abstractive text summarization is a challenging task, and one need to design a mechanism to effectively extract salient information from the source text and then generate a summary. A parsing process of the source text contains critical…

Computation and Language · Computer Science 2020-03-19 Haiyang Xu , Yun Wang , Kun Han , Baochang Ma , Junwen Chen , Xiangang Li

We present a scalable approach for semi-supervised learning on graph-structured data that is based on an efficient variant of convolutional neural networks which operate directly on graphs. We motivate the choice of our convolutional…

Machine Learning · Computer Science 2017-02-23 Thomas N. Kipf , Max Welling

Spectral Graph Neural Networks have demonstrated superior performance in graph representation learning. However, many current methods focus on employing shared polynomial coefficients for all nodes, i.e., learning node-unified filters,…

Machine Learning · Computer Science 2024-07-22 Jiahong Ma , Mingguo He , Zhewei Wei

As one of the most popular GNN architectures, the graph attention networks (GAT) is considered the most advanced learning architecture for graph representation and has been widely used in various graph mining tasks with impressive results.…

Machine Learning · Computer Science 2023-01-18 Jingbo Zhou , Yixuan Du , Ruqiong Zhang , Rui Zhang

Theoretical development and applications of graph signal processing (GSP) have attracted much attention. In classical GSP, the underlying structures are restricted in terms of dimensionality. A graph is a combinatorial object that models…

Signal Processing · Electrical Eng. & Systems 2020-05-26 Feng Ji , Giacomo Kahn , Wee Peng Tay