English
Related papers

Related papers: Analyzing Neural Network Information Flow Using Di…

200 papers

Graph Neural Networks (GNNs) have been extensively used in various real-world applications. However, the predictive uncertainty of GNNs stemming from diverse sources such as inherent randomness in data and model training errors can lead to…

Machine Learning · Computer Science 2025-03-11 Fangxin Wang , Yuqing Liu , Kay Liu , Yibo Wang , Sourav Medya , Philip S. Yu

Understanding the internal dynamics of Recurrent Neural Networks (RNNs) is crucial for advancing their interpretability and improving their design. This study introduces an innovative information-theoretic method to identify and analyze…

Machine Learning · Computer Science 2025-10-03 Arend Hintze , Asadullah Najam , Jory Schossau

The characterization of complex networks with tools originating in geometry, for instance through the statistics of so-called Ricci curvatures, is a well established tool of network science. There exist various types of such Ricci…

Computational Physics · Physics 2024-02-12 Madhumita Mondal , Areejit Samal , Florentin Münch , Jürgen Jost

Graph Neural Networks (GNNs) have received increasing attention for representation learning in various machine learning tasks. However, most existing GNNs applying neighborhood aggregation usually perform poorly on the graph with…

Machine Learning · Computer Science 2024-10-29 Wei Zhuo , Guang Tan

Graph Neural Networks (GNNs) have demonstrated strong representation learning capabilities for graph-based tasks. Recent advances on GNNs leverage geometric properties, such as curvature, to enhance its representation capabilities by…

Machine Learning · Computer Science 2025-03-04 Asela Hevapathige , Ahad N. Zehmakan , Qing Wang

Network flow problems, which involve distributing traffic such that the underlying infrastructure is used effectively, are ubiquitous in transportation and logistics. Among them, the general Multi-Commodity Network Flow (MCNF) problem…

Machine Learning · Computer Science 2024-03-19 Victor-Alexandru Darvariu , Stephen Hailes , Mirco Musolesi

We propose a one-class neural network (OC-NN) model to detect anomalies in complex data sets. OC-NN combines the ability of deep networks to extract a progressively rich representation of data with the one-class objective of creating a…

Machine Learning · Computer Science 2019-01-14 Raghavendra Chalapathy , Aditya Krishna Menon , Sanjay Chawla

Deep neural networks learn feature representations via complex geometric transformations of the input data manifold. Despite the models' empirical success across domains, our understanding of neural feature representations is still…

Machine Learning · Computer Science 2025-09-29 Moritz Hehl , Max von Renesse , Melanie Weber

A fundamental challenge in understanding graph neural networks (GNNs) lies in characterizing their optimization dynamics and loss landscape geometry, critical for improving interpretability and robustness. While mode connectivity, a lens…

Machine Learning · Computer Science 2025-02-19 Bingheng Li , Zhikai Chen , Haoyu Han , Shenglai Zeng , Jingzhe Liu , Jiliang Tang

Ricci curvature and its associated flow offer powerful geometric methods for analyzing complex networks. While existing research heavily focuses on applications for undirected graphs such as community detection and core extraction, there…

Social and Information Networks · Computer Science 2025-12-12 Juan Zhao , Jicheng Ma , Yunyan Yang , Liang Zhao

Geometric deep learning (GDL) models have demonstrated a great potential for the analysis of non-Euclidian data. They are developed to incorporate the geometric and topological information of non-Euclidian data into the end-to-end deep…

Machine Learning · Computer Science 2023-06-26 Cong Shen , Xiang Liu , Jiawei Luo , Kelin Xia

Objective: Modelling the associations from high-throughput experimental molecular data has provided unprecedented insights into biological pathways and signalling mechanisms. Graphical models and networks have especially proven to be useful…

Machine Learning · Statistics 2013-04-24 Marco Scutari , Radhakrishnan Nagarajan

Graph processes exhibit a temporal structure determined by the sequence index and and a spatial structure determined by the graph support. To learn from graph processes, an information processing architecture must then be able to exploit…

Signal Processing · Electrical Eng. & Systems 2020-12-02 Luana Ruiz , Fernando Gama , Alejandro Ribeiro

Recommender systems play a crucial role in addressing the issue of information overload by delivering personalized recommendations to users. In recent years, there has been a growing interest in leveraging graph neural networks (GNNs) for…

Information Retrieval · Computer Science 2023-06-09 Ziyang Liu , Chaokun Wang , Jingcao Xu , Cheng Wu , Kai Zheng , Yang Song , Na Mou , Kun Gai

Recently, data-driven simulators based on graph neural networks have gained attention in modeling physical systems on unstructured meshes. However, they struggle with long-range dependencies in fluid flows, particularly in refined mesh…

Machine Learning · Computer Science 2025-04-08 Youn-Yeol Yu , Jeongwhan Choi , Jaehyeon Park , Kookjin Lee , Noseong Park

Deep neural networks are being increasingly used for short-term traffic flow prediction, which can be generally categorized as convolutional (CNNs) or graph neural networks (GNNs). CNNs are preferable for region-wise traffic prediction by…

Physics and Society · Physics 2021-10-12 Wei Zeng , Chengqiao Lin , Kang Liu , Juncong Lin , Anthony K. H. Tung

Graph neural networks (GNNs) are processing architectures that exploit graph structural information to model representations from network data. Despite their success, GNNs suffer from sub-optimal generalization performance given limited…

Machine Learning · Computer Science 2021-06-08 Zhan Gao , Subhrajit Bhattacharya , Leiming Zhang , Rick S. Blum , Alejandro Ribeiro , Brian M. Sadler

Accurate routing network status estimation is a key component in Software Defined Networking. However, existing deep-learning-based methods for modeling network routing are not able to extrapolate towards unseen feature distributions. Nor…

Networking and Internet Architecture · Computer Science 2024-04-29 Yifei Jin , Marios Daoutis , Sarunas Girdzijauskas , Aristides Gionis

Detecting anomalies on network traffic is a complex task due to the massive amount of traffic flows in today's networks, as well as the highly-dynamic nature of traffic over time. In this paper, we propose the use of Graph Neural Networks…

Machine Learning · Computer Science 2023-12-12 Hamid Latif-Martínez , José Suárez-Varela , Albert Cabellos-Aparicio , Pere Barlet-Ros

In neuroscience, identifying distinct patterns linked to neurological disorders, such as Alzheimer's and Autism, is critical for early diagnosis and effective intervention. Graph Neural Networks (GNNs) have shown promising in analyzing…

Machine Learning · Computer Science 2025-02-05 Jiaxing Xu , Yongqiang Chen , Xia Dong , Mengcheng Lan , Tiancheng Huang , Qingtian Bian , James Cheng , Yiping Ke