English
Related papers

Related papers: Hamiltonian Graph Networks with ODE Integrators

200 papers

In this work, we propose a meta-learner based on ODE neural networks that learns gradients. This approach makes the optimizer is more flexible inducing an automatic inductive bias to the given task. Using the simplest Hamiltonian Neural…

Machine Learning · Computer Science 2021-11-02 Aleksandr Timofeev , Andrei Afonin , Yehao Liu

Hamiltonian systems are differential equations which describe systems in classical mechanics, plasma physics, and sampling problems. They exhibit many structural properties, such as a lack of attractors and the presence of conservation…

Numerical Analysis · Mathematics 2022-01-14 Christian Offen , Sina Ober-Blöbaum

Classical neural ODEs trained with explicit methods are intrinsically limited by stability, crippling their efficiency and robustness for stiff learning problems that are common in graph learning and scientific machine learning. We present…

Machine Learning · Computer Science 2024-12-17 Hong Zhang , Ying Liu , Romit Maulik

Learning to simulate complex physical systems from data has emerged as a promising way to overcome the limitations of traditional numerical solvers, which often require prohibitive computational costs for high-fidelity solutions. Recent…

Machine Learning · Computer Science 2026-02-12 Tai Hoang , Alessandro Trenta , Alessio Gravina , Niklas Freymuth , Philipp Becker , Davide Bacciu , Gerhard Neumann

Artificial intelligence for graphs has achieved remarkable success in modeling complex systems, ranging from dynamic networks in biology to interacting particle systems in physics. However, the increasingly heterogeneous graph datasets call…

Machine Learning · Computer Science 2023-01-25 Yasha Ektefaie , George Dasoulas , Ayush Noori , Maha Farhat , Marinka Zitnik

Neural networks that synergistically integrate data and physical laws offer great promise in modeling dynamical systems. However, iterative gradient-based optimization of network parameters is often computationally expensive and suffers…

Machine Learning · Computer Science 2026-04-16 Atamert Rahma , Chinmay Datar , Felix Dietrich

Hamiltonian neural networks (HNNs) are state-of-the-art models that regress the vector field of a dynamical system under the learning bias of Hamilton's equations. A recent observation is that embedding a bias regarding the additive…

Machine Learning · Computer Science 2024-08-16 Zi-Yu Khoo , Dawen Wu , Jonathan Sze Choong Low , Stéphane Bressan

Despite the successes of machine learning methods in physical sciences, prediction of the Hamiltonian, and thus electronic properties, is still unsatisfactory. Here, based on graph neural network architecture, we present an extendable…

Materials Science · Physics 2023-01-12 Mao Su , Ji-Hui Yang , Hong-Jun Xiang , Xin-Gao Gong

Development of next-generation electronic devices for applications call for the discovery of quantum materials hosting novel electronic, magnetic, and topological properties. Traditional electronic structure methods require expensive…

Computational Physics · Physics 2020-05-28 Hexin Bai , Peng Chu , Jeng-Yuan Tsai , Nathan Wilson , Xiaofeng Qian , Qimin Yan , Haibin Ling

Graph deep learning has recently emerged as a powerful ML concept allowing to generalize successful deep neural architectures to non-Euclidean structured data. Such methods have shown promising results on a broad spectrum of applications…

Machine Learning · Computer Science 2022-05-16 Anees Kazi , Luca Cosmo , Seyed-Ahmad Ahmadi , Nassir Navab , Michael Bronstein

The rapid growth of research in exploiting machine learning to predict chaotic systems has revived a recent interest in Hamiltonian Neural Networks (HNNs) with physical constraints defined by the Hamilton's equations of motion, which…

Machine Learning · Computer Science 2021-06-02 Chen-Di Han , Bryan Glaz , Mulugeta Haile , Ying-Cheng Lai

Modeling of conservative systems with neural networks is an area of active research. A popular approach is to use Hamiltonian neural networks (HNNs) which rely on the assumptions that a conservative system is described with Hamilton's…

Artificial Intelligence · Computer Science 2024-07-18 Katsiaryna Haitsiukevich , Alexander Ilin

Graphs are a fundamental abstraction for modeling relational data. However, graphs are discrete and combinatorial in nature, and learning representations suitable for machine learning tasks poses statistical and computational challenges. In…

Machine Learning · Statistics 2019-05-16 Aditya Grover , Aaron Zweig , Stefano Ermon

Adaptive networks model social, physical, technical, or biological systems as attributed graphs evolving at the level of both their topology and data. They are naturally described by graph transformation, but the majority of authors take an…

Discrete Mathematics · Computer Science 2021-12-22 Nicolas Behr , Bello Shehu Bello , Sebastian Ehmes , Reiko Heckel

Graph learning is the fundamental task of estimating unknown graph connectivity from available data. Typical approaches assume that not only is all information available simultaneously but also that all nodes can be observed. However, in…

Machine Learning · Computer Science 2024-09-16 Andrei Buciulea , Madeline Navarro , Samuel Rey , Santiago Segarra , Antonio G. Marques

A graphical model is a structured representation of the data generating process. The traditional method to reason over random variables is to perform inference in this graphical model. However, in many cases the generating process is only a…

Machine Learning · Statistics 2019-10-31 Victor Garcia Satorras , Zeynep Akata , Max Welling

Learning continuous-time dynamics on complex networks is crucial for understanding, predicting and controlling complex systems in science and engineering. However, this task is very challenging due to the combinatorial complexities in the…

Social and Information Networks · Computer Science 2020-06-19 Chengxi Zang , Fei Wang

HNets is a class of neural networks on grounds of physical prior for learning Hamiltonian systems. This paper explains the influences of different integrators as hyper-parameters on the HNets through error analysis. If we define the network…

Numerical Analysis · Mathematics 2020-04-30 Aiqing Zhu , Pengzhan Jin , Yifa Tang

Graphical models have been popularly used for capturing conditional independence structure in multivariate data, which are often built upon independent and identically distributed observations, limiting their applicability to complex…

Methodology · Statistics 2025-07-03 Yuwen Wang , Changyu Liu , Xin He , Junhui Wang

In recent years, there has been a resurgence in methods that use distributed (neural) representations to represent and reason about semantic knowledge for robotics applications. However, while robots often observe previously unknown…

Robotics · Computer Science 2021-05-11 Angel Daruna , Mehul Gupta , Mohan Sridharan , Sonia Chernova