English
Related papers

Related papers: Enhancing the Inductive Biases of Graph Neural ODE…

200 papers

Controlling continuous-time dynamical systems is generally a two step process: first, identify or model the system dynamics with differential equations, then, minimize the control objectives to achieve optimal control function and optimal…

Artificial Intelligence · Computer Science 2024-04-23 Cheng Chi

The graph identification problem consists of discovering the interactions among nodes in a network given their state/feature trajectories. This problem is challenging because the behavior of a node is coupled to all the other nodes by the…

Systems and Control · Electrical Eng. & Systems 2023-10-24 Eduardo Sebastian , Thai Duong , Nikolay Atanasov , Eduardo Montijano , Carlos Sagues

Graph Neural Networks (GNNs) exploit signals from node features and the input graph topology to improve node classification task performance. However, these models tend to perform poorly on heterophilic graphs, where connected nodes have…

Machine Learning · Computer Science 2021-12-08 Vijay Lingam , Chanakya Ekbote , Manan Sharma , Rahul Ragesh , Arun Iyer , Sundararajan Sellamanickam

Graph neural networks (GNNs) have shown advantages in graph-based analysis tasks. However, most existing methods have the homogeneity assumption and show poor performance on heterophilic graphs, where the linked nodes have dissimilar…

Machine Learning · Computer Science 2024-04-16 Tianhao Peng , Wenjun Wu , Haitao Yuan , Zhifeng Bao , Zhao Pengrui , Xin Yu , Xuetao Lin , Yu Liang , Yanjun Pu

It is known that the current graph neural networks (GNNs) are difficult to make themselves deep due to the problem known as over-smoothing. Multi-scale GNNs are a promising approach for mitigating the over-smoothing problem. However, there…

Machine Learning · Computer Science 2021-01-07 Kenta Oono , Taiji Suzuki

In recent years, spiking neural networks (SNNs) have attracted substantial interest due to their potential to replicate the energy-efficient and event-driven processing of biological neurons. Despite this, the application of SNNs in graph…

Artificial Intelligence · Computer Science 2024-07-31 Mingkun Xu , Huifeng Yin , Yujie Wu , Guoqi Li , Faqiang Liu , Jing Pei , Shuai Zhong , Lei Deng

In massive multi-input multi-output (MIMO) systems, the main bottlenecks of location- and orientation-assisted beam alignment using deep neural networks (DNNs) are large training overhead and significant performance degradation. This paper…

Signal Processing · Electrical Eng. & Systems 2026-01-21 Yuzhu Lei , Qiqi Xiao , Yinghui He , Guanding Yu

Neural Ordinary Differential Equations (NODEs) are a novel neural architecture, built around initial value problems with learned dynamics which are solved during inference. Thought to be inherently more robust against adversarial…

Machine Learning · Computer Science 2023-03-10 Mustafa Zeqiri , Mark Niklas Müller , Marc Fischer , Martin Vechev

Lattice Hamiltonian systems underpin models across condensed matter, nonlinear optics, and biophysics, yet learning their dynamics from data is obstructed by two unknowns: the interaction topology and whether node dynamics are homogeneous.…

Machine Learning · Computer Science 2026-04-28 Ru Geng , Panayotis Kevrekidis , Yixian Gao , Hong-Kun Zhang , Jian Zu

The intersection of machine learning and dynamical systems has generated considerable interest recently. Neural Ordinary Differential Equations (NODEs) represent a rich overlap between these fields. In this paper, we develop a continuous…

Optimization and Control · Mathematics 2023-06-16 Maria Oprea , Mark Walth , Robert Stephany , Gabriella Torres Nothaft , Arnaldo Rodriguez-Gonzalez , William Clark

The integration of Spiking Neural Networks (SNNs) and Graph Neural Networks (GNNs) is gradually attracting attention due to the low power consumption and high efficiency in processing the non-Euclidean data represented by graphs. However,…

Neural and Evolutionary Computing · Computer Science 2025-07-15 Nan Yin , Mengzhu Wang , Zhenghan Chen , Giulia De Masi , Bin Gu , Huan Xiong

Physics-Informed Neural Networks (PINNs) and Neural Ordinary Differential Equations (NODEs) represent two distinct machine learning frameworks for modeling nonlinear neuronal dynamics. This study systematically evaluates their performance…

Dynamical Systems · Mathematics 2026-03-31 Nikolaos M. Matzakos , Chrisovalantis Sfyrakis

A dynamic graph (DG) is frequently encountered in numerous real-world scenarios. Consequently, A dynamic graph convolutional network (DGCN) has been successfully applied to perform precise representation learning on a DG. However,…

Machine Learning · Computer Science 2025-04-23 Minglian Han

Recently, graph neural networks (GNNs) have proved to be suitable in tasks on unstructured data. Particularly in tasks as community detection, node classification, and link prediction. However, most GNN models still operate with static…

Machine Learning · Computer Science 2019-06-07 Darwin Saire Pilco , Adín Ramírez Rivera

Deep learning models are able to approximate one specific dynamical system but struggle at learning generalisable dynamics, where dynamical systems obey the same laws of physics but contain different numbers of elements (e.g., double- and…

Machine Learning · Computer Science 2022-07-05 Yupu Lu , Shijie Lin , Guanqi Chen , Jia Pan

This paper introduces a novel algorithmic framework for a deep neural network (DNN), which in a mathematically rigorous manner, allows us to incorporate history (or memory) into the network -- it ensures all layers are connected to one…

Optimization and Control · Mathematics 2020-04-03 Harbir Antil , Ratna Khatri , Rainald Löhner , Deepanshu Verma

Graph Neural Networks (GNNs) are the dominant architecture for molecular machine learning, particularly for molecular property prediction and machine learning interatomic potentials (MLIPs). GNNs perform message passing on predefined graphs…

Machine Learning · Computer Science 2025-10-03 Tobias Kreiman , Yutong Bai , Fadi Atieh , Elizabeth Weaver , Eric Qu , Aditi S. Krishnapriyan

Graph neural networks (GNNs) encounter significant computational challenges when handling large-scale graphs, which severely restricts their efficacy across diverse applications. To address this limitation, graph condensation has emerged as…

Machine Learning · Computer Science 2023-12-12 Xinyi Gao , Tong Chen , Yilong Zang , Wentao Zhang , Quoc Viet Hung Nguyen , Kai Zheng , Hongzhi Yin

Data-driven modeling approaches can produce fast surrogates to study large-scale physics problems. Among them, graph neural networks (GNNs) that operate on mesh-based data are desirable because they possess inductive biases that promote…

Machine Learning · Computer Science 2023-04-04 Brian R. Bartoldson , Yeping Hu , Amar Saini , Jose Cadena , Yucheng Fu , Jie Bao , Zhijie Xu , Brenda Ng , Phan Nguyen

Learning graph representations is a fundamental task aimed at capturing various properties of graphs in vector space. The most recent methods learn such representations for static networks. However, real world networks evolve over time and…

Social and Information Networks · Computer Science 2019-08-22 Palash Goyal , Sujit Rokka Chhetri , Arquimedes Canedo