English
Related papers

Related papers: An Information-Theoretic Analysis of Temporal GNNs

200 papers

Graph neural networks (GNNs) are the most widely adopted model in graph-structured data oriented learning and representation. Despite their extraordinary success in real-world applications, understanding their working mechanism by theory is…

Machine Learning · Computer Science 2023-05-16 Huayi Tang , Yong Liu

Within many real-world networks the links between pairs of nodes change over time. Thus, there has been a recent boom in studying temporal graphs. Recognizing patterns in temporal graphs requires a proximity measure to compare different…

Machine Learning · Computer Science 2020-07-07 Vincent Froese , Brijnesh Jain , Rolf Niedermeier , Malte Renken

Temporal networks are commonly used to represent systems where connections between elements are active only for restricted periods of time, such as networks of telecommunication, neural signal processing, biochemical reactions and human…

Data Analysis, Statistics and Probability · Physics 2011-11-15 Lauri Kovanen , Márton Karsai , Kimmo Kaski , János Kertész , Jari Saramäki

Temporal data are ubiquitous in the financial services (FS) industry -- traditional data like economic indicators, operational data such as bank account transactions, and modern data sources like website clickstreams -- all of these occur…

Statistical Finance · Quantitative Finance 2020-09-15 Jason Wittenbach , Brian d'Alessandro , C. Bayan Bruss

Over the past few years, graph neural networks (GNNs) have become powerful and practical tools for learning on (static) graph-structure data. However, many real-world applications, such as social networks and e-commerce, involve temporal…

Social networks are of interest to researchers in part because they are thought to mediate the flow of information in communities and organizations. Here we study the temporal dynamics of communication using on-line data, including e-mail…

Physics and Society · Physics 2008-06-20 Gueorgi Kossinets , Jon Kleinberg , Duncan Watts

Many real world graphs contain time domain information. Temporal Graph Neural Networks capture temporal information as well as structural and contextual information in the generated dynamic node embeddings. Researchers have shown that these…

Machine Learning · Computer Science 2022-07-04 Hongkuan Zhou , Da Zheng , Israt Nisa , Vasileios Ioannidis , Xiang Song , George Karypis

Understanding temporal information and how the visual world changes over time is a fundamental ability of intelligent systems. In video understanding, temporal information is at the core of many current challenges, including compression,…

Computer Vision and Pattern Recognition · Computer Science 2019-10-31 Laura Sevilla-Lara , Shengxin Zha , Zhicheng Yan , Vedanuj Goswami , Matt Feiszli , Lorenzo Torresani

Graph neural networks (GNN) have shown significant capabilities in handling structured data, yet their application to dynamic, temporal data remains limited. This paper presents a new type of graph attention network, called TempoKGAT, which…

Machine Learning · Computer Science 2024-12-24 Lena Sasal , Daniel Busby , Abdenour Hadid

Information theory is a powerful framework for quantifying complexity, uncertainty, and dynamical structure in time-series data, with widespread applicability across disciplines such as physics, finance, and neuroscience. However, the…

Information Theory · Computer Science 2026-01-26 Annie G. Bryant , Oliver M. Cliff , James M. Shine , Ben D. Fulcher , Joseph T. Lizier

Compared with static knowledge graphs, temporal knowledge graphs (tKG), which can capture the evolution and change of information over time, are more realistic and general. However, due to the complexity that the notion of time introduces…

Computation and Language · Computer Science 2025-04-07 Siheng Xiong , Yuan Yang , Faramarz Fekri , James Clayton Kerce

We formulate meta learning using information theoretic concepts; namely, mutual information and the information bottleneck. The idea is to learn a stochastic representation or encoding of the task description, given by a training set, that…

Machine Learning · Computer Science 2021-07-06 Michalis K. Titsias , Francisco J. R. Ruiz , Sotirios Nikoloutsopoulos , Alexandre Galashov

Temporal Graph Neural Networks (TGNNs) aim to capture the evolving structure and timing of interactions in dynamic graphs. Although many models incorporate time through encodings or architectural design, they often compute attention over…

Machine Learning · Computer Science 2026-02-03 Govind Waghmare , Srini Rohan Gujulla Leel , Nikhil Tumbde , Sumedh B G , Sonia Gupta , Srikanta Bedathur

Integrated sensing and communication (ISAC) is a key enabler of 6G, supporting environment-aware services. A fundamental sensing task in this setting is reliable multi-target detection and tracking. This paper proposes a temporal graph…

Signal Processing · Electrical Eng. & Systems 2026-04-10 Saiedeh Maboud Sanaie , Marcus Grossmann , Markus Landmann , Thomas Dallmann

Graph Neural Networks (GNNs) have become a standard approach for learning from graph-structured data. However, their reliance on parametric classifiers (most often linear softmax layers) limits interpretability and sometimes hinders…

Machine Learning · Computer Science 2026-02-03 Zeljko Bolevic , Milos Brajovic , Isidora Stankovic , Ljubisa Stankovic

Despite their success in various domains, the growing dependence on GNNs raises a critical concern about the nature of the combinatorial reasoning underlying their predictions, which is often hidden within their black-box architectures.…

Machine Learning · Computer Science 2026-03-03 Yue Niu , Zhaokai Sun , Jiayi Yang , Xiaofeng Cao , Rui Fan , Xin Sun , Hanli Wang , Wei Ye

Graph neural networks (GNNs) are quickly becoming the standard approach for learning on graph structured data across several domains, but they lack transparency in their decision-making. Several perturbation-based approaches have been…

Machine Learning · Computer Science 2021-11-29 Anna Himmelhuber , Mitchell Joblin , Martin Ringsquandl , Thomas Runkler

Modeling multivariate time series has long been a subject that has attracted researchers from a diverse range of fields including economics, finance, and traffic. A basic assumption behind multivariate time series forecasting is that its…

Machine Learning · Computer Science 2020-05-26 Zonghan Wu , Shirui Pan , Guodong Long , Jing Jiang , Xiaojun Chang , Chengqi Zhang

Graph neural networks (GNNs) have attracted much attention due to their ability to leverage the intrinsic geometries of the underlying data. Although many different types of GNN models have been developed, with many benchmarking procedures…

Understanding the internal dynamics of Recurrent Neural Networks (RNNs) is crucial for advancing their interpretability and improving their design. This study introduces an innovative information-theoretic method to identify and analyze…

Machine Learning · Computer Science 2025-10-03 Arend Hintze , Asadullah Najam , Jory Schossau