English
Related papers

Related papers: Dynamic Graph Representation Learning via Self-Att…

200 papers

Recurrent neural nets (RNN) and convolutional neural nets (CNN) are widely used on NLP tasks to capture the long-term and local dependencies, respectively. Attention mechanisms have recently attracted enormous interest due to their highly…

Computation and Language · Computer Science 2017-11-22 Tao Shen , Tianyi Zhou , Guodong Long , Jing Jiang , Shirui Pan , Chengqi Zhang

Deep neural networks can be powerful tools, but require careful application-specific design to ensure that the most informative relationships in the data are learnable. In this paper, we apply deep neural networks to the nonlinear…

Machine Learning · Computer Science 2019-12-04 Matthew A. Wright , Simon F. G. Ehlers , Roberto Horowitz

Embedding static graphs in low-dimensional vector spaces plays a key role in network analytics and inference, supporting applications like node classification, link prediction, and graph visualization. However, many real-world networks…

Machine Learning · Computer Science 2021-07-23 Claudio D. T. Barros , Matheus R. F. Mendonça , Alex B. Vieira , Artur Ziviani

Many irregular domains such as social networks, financial transactions, neuron connections, and natural language constructs are represented using graph structures. In recent years, a variety of graph neural networks (GNNs) have been…

Machine Learning · Computer Science 2021-05-03 Osman Asif Malik , Shashanka Ubaru , Lior Horesh , Misha E. Kilmer , Haim Avron

Graph Neural Networks (GNNs) are deep learning methods which provide the current state of the art performance in node classification tasks. GNNs often assume homophily -- neighboring nodes having similar features and labels--, and therefore…

Machine Learning · Computer Science 2021-10-26 Liheng Ma , Reihaneh Rabbany , Adriana Romero-Soriano

The (variational) graph auto-encoder is widely used to learn representations for graph-structured data. However, the formation of real-world graphs is a complicated and heterogeneous process influenced by latent factors. Existing encoders…

Machine Learning · Computer Science 2024-07-17 Di Fan , Chuanhou Gao

Due to the complex and changing interactions in dynamic scenarios, motion forecasting is a challenging problem in autonomous driving. Most existing works exploit static road graphs to characterize scenarios and are limited in modeling…

Artificial Intelligence · Computer Science 2023-03-09 Xing Gao , Xiaogang Jia , Yikang Li , Hongkai Xiong

The purpose of this paper is to infer a global (collective) model of time-varying responses of a set of nodes as a dynamic graph, where the individual time series are respectively observed at each of the nodes. The motivation of this work…

Signal Processing · Electrical Eng. & Systems 2020-02-18 Bo Jiang , Ashkan Panahi , Hamid Krim , Yiyi Yu , Spencer L. Smith

Graphs can facilitate modeling various complex systems such as gene networks and power grids, as well as analyzing the underlying relations within them. Learning over graphs has recently attracted increasing attention, particularly graph…

Machine Learning · Computer Science 2023-03-28 O. Deniz Kose , Yanning Shen

Recommender systems based on graph neural networks receive increasing research interest due to their excellent ability to learn a variety of side information including social networks. However, previous works usually focus on modeling…

Information Retrieval · Computer Science 2022-02-01 Junfa Lin , Siyuan Chen , Jiahai Wang

Graph neural networks (GNNs) have garnered significant attention due to their ability to represent graph data. Among various GNN variants, graph attention network (GAT) stands out since it is able to dynamically learn the importance of…

Machine Learning · Computer Science 2024-08-19 Tiqiao Wei , Ye Yuan

Dynamic graph learning is essential for applications involving temporal networks and requires effective modeling of temporal relationships. Seminal attention-based models like TGAT and DyGFormer rely on sinusoidal time encoders to capture…

Machine Learning · Computer Science 2025-08-05 Hsing-Huan Chung , Shravan Chaudhari , Xing Han , Yoav Wald , Suchi Saria , Joydeep Ghosh

We introduce a relational graph neural network with bi-directional attention mechanism and hierarchical representation learning for open-domain question answering task. Our model can learn contextual representation by jointly learning and…

Computation and Language · Computer Science 2019-10-21 Salvatore Vivona , Kaveh Hassani

Adaptive traffic signal control plays a significant role in the construction of smart cities. This task is challenging because of many essential factors, such as cooperation among neighboring intersections and dynamic traffic scenarios.…

Machine Learning · Computer Science 2022-03-22 Libing Wu , Min Wang , Dan Wu , Jia Wu

Graph neural network, as a powerful graph representation technique based on deep learning, has shown superior performance and attracted considerable research interest. However, it has not been fully considered in graph neural network for…

Social and Information Networks · Computer Science 2021-01-21 Xiao Wang , Houye Ji , Chuan Shi , Bai Wang , Peng Cui , P. Yu , Yanfang Ye

Graph representation learning plays a vital role in processing graph-structured data. However, prior arts on graph representation learning heavily rely on labeling information. To overcome this problem, inspired by the recent success of…

Machine Learning · Computer Science 2021-07-19 Ming Jin , Yizhen Zheng , Yuan-Fang Li , Chen Gong , Chuan Zhou , Shirui Pan

Many real-world problems can be represented as graph-based learning problems. In this paper, we propose a novel framework for learning spatial and attentional convolution neural networks on arbitrary graphs. Different from previous…

Machine Learning · Computer Science 2019-02-26 Hao Peng , Jianxin Li , Qiran Gong , Senzhang Wang , Yuanxing Ning , Philip S. Yu

Tracking a targeted subset of nodes in an evolving graph is important for many real-world applications. Existing methods typically focus on identifying anomalous edges or finding anomaly graph snapshots in a stream way. However,…

Social and Information Networks · Computer Science 2022-11-18 Xingzhi Guo , Baojian Zhou , Steven Skiena

In this paper, we focus on graph representation learning of heterogeneous information network (HIN), in which various types of vertices are connected by various types of relations. Most of the existing methods conducted on HIN revise…

Machine Learning · Computer Science 2019-12-24 Huiting Hong , Hantao Guo , Yucheng Lin , Xiaoqing Yang , Zang Li , Jieping Ye

Graph Attention Networks(GATs) are useful deep learning models to deal with the graph data. However, recent works show that the classical GAT is vulnerable to adversarial attacks. It degrades dramatically with slight perturbations.…

Machine Learning · Computer Science 2022-08-05 Xianchen Zhou , Yaoyun Zeng , Hongxia Wang