English
Related papers

Related papers: An Information-Theoretic Analysis of Temporal GNNs

200 papers

In dynamic graphs, preserving temporal continuity is critical. However, Memory-based Dynamic Graph Neural Networks (MDGNNs) trained with large batches often disrupt event sequences, leading to temporal information loss. This discontinuity…

Machine Learning · Computer Science 2025-06-25 Yang Zhou , Xiaoning Ren

Modularity is a very widely used measure of the level of clustering or community structure in networks. Here we consider a recent generalisation of the definition of modularity to temporal graphs, whose edge-sets change over discrete…

Combinatorics · Mathematics 2025-07-24 Vilhelm Agdur , Jessica Enright , Laura Larios-Jones , Kitty Meeks , Fiona Skerman , Ella Yates

Temporal networks representing a stream of timestamped edges are seemingly ubiquitous in the real-world. However, the massive size and continuous nature of these networks make them fundamentally challenging to analyze and leverage for…

Data Structures and Algorithms · Computer Science 2021-01-08 Nesreen K. Ahmed , Nick Duffield , Ryan A. Rossi

Graph Neural Network (GNN) is a powerful tool to perform standard machine learning on graphs. To have a Euclidean representation of every node in the Non-Euclidean graph-like data, GNN follows neighbourhood aggregation and combination of…

Machine Learning · Computer Science 2021-11-18 Sucheta Dawn , Sanghamitra Bandyopadhyay

A long-standing proposition is that by emulating the operation of the brain's neocortex, a spiking neural network (SNN) can achieve similar desirable features: flexible learning, speed, and efficiency. Temporal neural networks (TNNs) are…

Neural and Evolutionary Computing · Computer Science 2021-02-24 James E. Smith

Graph Neural Networks (GNN) provide a powerful framework that elegantly integrates Graph theory with Machine learning for modeling and analysis of networked data. We consider the problem of quantifying the uncertainty in predictions of GNN…

Machine Learning · Computer Science 2022-05-23 Sai Munikoti , Deepesh Agarwal , Laya Das , Balasubramaniam Natarajan

Temporal Graph Neural Networks (TGNNs) have gained growing attention for modeling and predicting structures in temporal graphs. However, existing TGNNs primarily focus on pairwise interactions while overlooking higher-order structures that…

Machine Learning · Computer Science 2025-05-22 Jingzhe Liu , Zhigang Hua , Yan Xie , Bingheng Li , Harry Shomer , Yu Song , Kaveh Hassani , Jiliang Tang

Knowledge is inherently time-sensitive and continuously evolves over time. Although current Retrieval-Augmented Generation (RAG) systems enrich LLMs with external knowledge, they largely ignore this temporal nature. This raises two…

Information Retrieval · Computer Science 2025-10-16 Jiale Han , Austin Cheung , Yubai Wei , Zheng Yu , Xusheng Wang , Bing Zhu , Yi Yang

Graph Neural Networks (GNNs) have become a central tool for learning on graph-structured data, yet their applicability to real-world systems remains limited by key challenges such as scalability, temporality, directionality, data…

Machine Learning · Computer Science 2025-10-28 Emanuele Rossi

Graph Neural Networks (GNNs) are routinely used in molecular physics, social sciences, and economics to model many-body interactions in graph-like systems. However, GNNs are inherently local and can suffer from information flow bottlenecks.…

Computational Physics · Physics 2025-02-21 Alessandro Caruso , Jacopo Venturin , Lorenzo Giambagli , Edoardo Rolando , Frank Noé , Cecilia Clementi

Networks are used as highly expressive tools in different disciplines. In recent years, the analysis and mining of temporal networks have attracted substantial attention. Frequent pattern mining is considered an essential task in the…

Social and Information Networks · Computer Science 2021-05-14 Ali Jazayeri , Christopher C. Yang

Dynamic networks are used in a wide range of fields, including social network analysis, recommender systems, and epidemiology. Representing complex networks as structures changing over time allow network models to leverage not only…

Social and Information Networks · Computer Science 2021-06-15 Joakim Skarding , Bogdan Gabrys , Katarzyna Musial

Graph Neural Networks (GNNs) achieve an impressive performance on structured graphs by recursively updating the representation vector of each node based on its neighbors, during which parameterized transformation matrices should be learned…

Machine Learning · Computer Science 2019-06-14 Pengfei Chen , Weiwen Liu , Chang-Yu Hsieh , Guangyong Chen , Shengyu Zhang

Graph Neural Networks (GNNs) have demonstrated remarkable success in modeling complex relationships in graph-structured data. A recent innovation in this field is the family of Differential Equation-Inspired Graph Neural Networks (DE-GNNs),…

Machine Learning · Computer Science 2024-01-23 Moshe Eliasof , Eldad Haber , Eran Treister , Carola-Bibiane Schönlieb

Graph-based Neural Networks (GNNs) are recent models created for learning representations of nodes (and graphs), which have achieved promising results when detecting patterns that occur in large-scale data relating different entities. Among…

Machine Learning · Computer Science 2021-08-20 Ronald D. R. Pereira , Fabrício Murai

Dynamic networks, a.k.a. graph streams, consist of a set of vertices and a collection of timestamped interaction events (i.e., temporal edges) between vertices. Temporal motifs are defined as classes of (small) isomorphic induced subgraphs…

Methodology · Statistics 2022-02-23 Xiaojing Zhu , Eric D. Kolaczyk

The Information Bottleneck (IB) principle offers a compelling theoretical framework to understand how neural networks (NNs) learn. However, its practical utility has been constrained by unresolved theoretical ambiguities and significant…

Machine Learning · Computer Science 2026-02-02 Charles Westphal , Stephen Hailes , Mirco Musolesi

Temporal graph learning is crucial for dynamic networks where nodes and edges evolve over time and new nodes continuously join the system. Inductive representation learning in such settings faces two major challenges: effectively…

Machine Learning · Computer Science 2025-08-21 Jiafeng Xiong , Rizos Sakellariou

The information bottleneck (IB) method is a technique designed to extract meaningful information related to one random variable from another random variable, and has found extensive applications in machine learning problems. In this paper,…

Information Theory · Computer Science 2025-07-29 Lingyi Chen , Shitong Wu , Sicheng Xu , Huihui Wu , Wenyi Zhang

Multi-relational temporal graphs are powerful tools for modeling real-world data, capturing the evolving and interconnected nature of entities over time. Recently, many novel models are proposed for ML on such graphs intensifying the need…