English
Related papers

Related papers: Dynamic Graph Representation Learning via Self-Att…

200 papers

Learning network representations is a fundamental task for many graph applications such as link prediction, node classification, graph clustering, and graph visualization. Many real-world networks are interpreted as dynamic networks and…

Machine Learning · Computer Science 2019-10-07 Sedigheh Mahdavi , Shima Khoshraftar , Aijun An

An important part of many machine learning workflows on graphs is vertex representation learning, i.e., learning a low-dimensional vector representation for each vertex in the graph. Recently, several powerful techniques for unsupervised…

Machine Learning · Computer Science 2019-01-23 Hooman Peiro Sajjad , Andrew Docherty , Yuriy Tyshetskiy

Event detection is a critical task for timely decision-making in graph analytics applications. Despite the recent progress towards deep learning on graphs, event detection on dynamic graphs presents particular challenges to existing…

Machine Learning · Computer Science 2023-02-15 Mert Kosan , Arlei Silva , Sourav Medya , Brian Uzzi , Ambuj Singh

We present graph attention networks (GATs), novel neural network architectures that operate on graph-structured data, leveraging masked self-attentional layers to address the shortcomings of prior methods based on graph convolutions or…

Machine Learning · Statistics 2018-02-06 Petar Veličković , Guillem Cucurull , Arantxa Casanova , Adriana Romero , Pietro Liò , Yoshua Bengio

Temporal networks have been widely used to model real-world complex systems such as financial systems and e-commerce systems. In a temporal network, the joint neighborhood of a set of nodes often provides crucial structural information…

Machine Learning · Computer Science 2022-12-02 Yuhong Luo , Pan Li

Attention mechanism in graph neural networks is designed to assign larger weights to important neighbor nodes for better representation. However, what graph attention learns is not understood well, particularly when graphs are noisy. In…

Machine Learning · Computer Science 2022-04-12 Dongkwan Kim , Alice Oh

Recently, self-supervised learning has proved to be effective to learn representations of events suitable for temporal segmentation in image sequences, where events are understood as sets of temporally adjacent images that are semantically…

Machine Learning · Computer Science 2020-12-11 Mariella Dimiccoli , Herwig Wendt

Dynamic recommendation, focusing on modeling user preference from historical interactions and providing recommendations on current time, plays a key role in many personalized services. Recent works show that pre-trained dynamic graph neural…

Social and Information Networks · Computer Science 2025-11-18 Zhen Tao , Yuehang Cao , Yang Fang , Yunhui Liu , Xiang Zhao , Tieke He

Graph representation learning has rapidly emerged as a pivotal field of study. Despite its growing popularity, the majority of research has been confined to embedding single-layer graphs, which fall short in representing complex systems…

Machine Learning · Computer Science 2024-03-29 Marco Bongiovanni , Luca Gallo , Roberto Grasso , Alfredo Pulvirenti

Graph Neural Networks are perfectly suited to capture latent interactions between various entities in the spatio-temporal domain (e.g. videos). However, when an explicit structure is not available, it is not obvious what atomic elements…

Computer Vision and Pattern Recognition · Computer Science 2021-12-08 Iulia Duta , Andrei Nicolicioiu , Marius Leordeanu

Graph representation learning aims to encode all nodes of a graph into low-dimensional vectors that will serve as input of many compute vision tasks. However, most existing algorithms ignore the existence of inherent data distribution and…

Machine Learning · Computer Science 2020-08-04 Shuai Zheng , Zhenfeng Zhu , Xingxing Zhang , Zhizhe Liu , Jian Cheng , Yao Zhao

Transformer-based models have recently shown success in representation learning on graph-structured data beyond natural language processing and computer vision. However, the success is limited to small-scale graphs due to the drawbacks of…

Machine Learning · Computer Science 2022-10-05 Jinyoung Park , Seongjun Yun , Hyeonjin Park , Jaewoo Kang , Jisu Jeong , Kyung-Min Kim , Jung-woo Ha , Hyunwoo J. Kim

Graphs are essential representations of many real-world data such as social networks. Recent years have witnessed the increasing efforts made to extend the neural network models to graph-structured data. These methods, which are usually…

Machine Learning · Computer Science 2018-11-07 Yao Ma , Ziyi Guo , Zhaochun Ren , Eric Zhao , Jiliang Tang , Dawei Yin

Heterogeneous graphs have multiple node and edge types and are semantically richer than homogeneous graphs. To learn such complex semantics, many graph neural network approaches for heterogeneous graphs use metapaths to capture multi-hop…

Machine Learning · Computer Science 2022-07-26 See Hian Lee , Feng Ji , Wee Peng Tay

Dynamic networks are ubiquitous for modelling sequential graph-structured data, e.g., brain connectome, population flows and messages exchanges. In this work, we consider dynamic networks that are temporal sequences of graph snapshots, and…

Machine Learning · Statistics 2022-03-30 Deborah Sulem , Henry Kenlay , Mihai Cucuringu , Xiaowen Dong

The primary objective of this thesis is to develop novel algorithmic approaches for Graph Representation Learning of static and single-event dynamic networks. In such a direction, we focus on the family of Latent Space Models, and more…

Machine Learning · Computer Science 2025-12-22 Nikolaos Nakis

To take full advantage of fast-growing unlabeled networked data, this paper introduces a novel self-supervised strategy for graph representation learning by exploiting natural supervision provided by the data itself. Inspired by human…

Machine Learning · Computer Science 2025-11-20 Zhen Peng , Yixiang Dong , Minnan Luo , Xiao-Ming Wu , Qinghua Zheng

Representation learning on dynamic graphs requires capturing complex dependencies that evolve across both time and structure. Existing approaches typically adopt fixed temporal decay schemes or predetermined structural propagation depths,…

Machine Learning · Computer Science 2026-05-29 Qian Chang , Ciprian Doru Giurcaneanu , Runsong Jia , Xia Li , Guoping Hu , Xiufeng Cheng , Jinqing Yang , Mengjia Wu , Yi Zhang

Neural networks for structured data like graphs have been studied extensively in recent years. To date, the bulk of research activity has focused mainly on static graphs. However, most real-world networks are dynamic since their topology…

Machine Learning · Computer Science 2020-03-03 Changmin Wu , Giannis Nikolentzos , Michalis Vazirgiannis

Dynamic Text-Attributed Graphs (DyTAGs) are a novel graph paradigm that captures evolving temporal events (edges) alongside rich textual attributes. Existing studies can be broadly categorized into TGNN-driven and LLM-driven approaches,…

Machine Learning · Computer Science 2025-08-04 Yuanyuan Xu , Wenjie Zhang , Ying Zhang , Xuemin Lin , Xiwei Xu