English
Related papers

Related papers: Thermodynamics-informed graph neural networks

200 papers

Neural networks with physics based inductive biases such as Lagrangian neural networks (LNN), and Hamiltonian neural networks (HNN) learn the dynamics of physical systems by encoding strong inductive biases. Alternatively, Neural ODEs with…

Machine Learning · Computer Science 2024-06-18 Suresh Bishnoi , Ravinder Bhattoo , Sayan Ranu , N. M. Anoop Krishnan

Real-world graphs, such as social networks, financial transactions, and recommendation systems, often demonstrate dynamic behavior. This phenomenon, known as graph stream, involves the dynamic changes of nodes and the emergence and…

Machine Learning · Computer Science 2023-05-16 Yanping Zheng , Zhewei Wei , Jiajun Liu

We study a recent class of models which uses graph neural networks (GNNs) to improve forecasting in multivariate time series. The core assumption behind these models is that there is a latent graph between the time series (nodes) that…

In this work, we present a method for node embedding in temporal graphs. We propose an algorithm that learns the evolution of a temporal graph's nodes and edges over time and incorporates this dynamics in a temporal node embedding framework…

Machine Learning · Computer Science 2021-05-20 Uriel Singer , Ido Guy , Kira Radinsky

Accurate modelling and quantification of predictive uncertainty is crucial in deep learning since it allows a model to make safer decisions when the data is ambiguous and facilitates the users' understanding of the model's confidence in its…

Machine Learning · Statistics 2025-08-26 Soumyasundar Pal , Liheng Ma , Amine Natik , Yingxue Zhang , Mark Coates

This study aims to overcome the limitations of conventional deep-learning approaches based on convolutional neural networks in complex geometries and unstructured meshes by exploring the potential of Graph U-Nets for unsteady flow-field…

Machine Learning · Computer Science 2024-10-18 Sunwoong Yang , Ricardo Vinuesa , Namwoo Kang

While deep learning has shown tremendous success in a wide range of domains, it remains a grand challenge to incorporate physical principles in a systematic manner to the design, training, and inference of such models. In this paper, we aim…

Computational Physics · Physics 2020-06-16 Rui Wang , Karthik Kashinath , Mustafa Mustafa , Adrian Albert , Rose Yu

Short-term demand forecasting models commonly combine convolutional and recurrent layers to extract complex spatiotemporal patterns in data. Long-term histories are also used to consider periodicity and seasonality patterns as time series…

Machine Learning · Computer Science 2019-10-15 Doyup Lee , Suehun Jung , Yeongjae Cheon , Dongil Kim , Seungil You

Learning continuous-time dynamics on complex networks is crucial for understanding, predicting and controlling complex systems in science and engineering. However, this task is very challenging due to the combinatorial complexities in the…

Social and Information Networks · Computer Science 2020-06-19 Chengxi Zang , Fei Wang

Accurately learning the temporal behavior of dynamical systems requires models with well-chosen learning biases. Recent innovations embed the Hamiltonian and Lagrangian formalisms into neural networks and demonstrate a significant…

Machine Learning · Computer Science 2021-10-04 Shaan Desai , Marios Mattheakis , David Sondak , Pavlos Protopapas , Stephen Roberts

This paper presents a method to simulate the thermal behavior of 3D systems using a graph neural network. The method discussed achieves a significant speed-up with respect to a traditional finite-element simulation. The graph neural network…

Computational Engineering, Finance, and Science · Computer Science 2022-09-29 Helios Sanchis-Alepuz , Monika Stipsitz

Graph representation learning aims to encode all nodes of a graph into low-dimensional vectors that will serve as input of many compute vision tasks. However, most existing algorithms ignore the existence of inherent data distribution and…

Machine Learning · Computer Science 2020-08-04 Shuai Zheng , Zhenfeng Zhu , Xingxing Zhang , Zhizhe Liu , Jian Cheng , Yao Zhao

In this work, we introduce Dissipative SymODEN, a deep learning architecture which can infer the dynamics of a physical system with dissipation from observed state trajectories. To improve prediction accuracy while reducing network size,…

Machine Learning · Computer Science 2020-05-01 Yaofeng Desmond Zhong , Biswadip Dey , Amit Chakraborty

Embedding static graphs in low-dimensional vector spaces plays a key role in network analytics and inference, supporting applications like node classification, link prediction, and graph visualization. However, many real-world networks…

Machine Learning · Computer Science 2021-07-23 Claudio D. T. Barros , Matheus R. F. Mendonça , Alex B. Vieira , Artur Ziviani

Weather Forecasting is an attractive challengeable task due to its influence on human life and complexity in atmospheric motion. Supported by massive historical observed time series data, the task is suitable for data-driven approaches,…

Machine Learning · Computer Science 2022-09-20 Minbo Ma , Peng Xie , Fei Teng , Tianrui Li , Bin Wang , Shenggong Ji , Junbo Zhang

Dynamic graphs capture evolving interactions between entities, such as in social networks, online learning platforms, and crowdsourcing projects. For dynamic graph modeling, dynamic graph neural networks (DGNNs) have emerged as a mainstream…

Machine Learning · Computer Science 2025-03-04 Xingtong Yu , Zhenghao Liu , Xinming Zhang , Yuan Fang

We develop a general approach to distill symbolic representations of a learned deep model by introducing strong inductive biases. We focus on Graph Neural Networks (GNNs). The technique works as follows: we first encourage sparse latent…

Machine Learning · Computer Science 2020-11-19 Miles Cranmer , Alvaro Sanchez-Gonzalez , Peter Battaglia , Rui Xu , Kyle Cranmer , David Spergel , Shirley Ho

Methods that learn representations of nodes in a graph play a critical role in network analysis since they enable many downstream learning tasks. We propose Graph2Gauss - an approach that can efficiently learn versatile node embeddings on…

Machine Learning · Statistics 2019-04-02 Aleksandar Bojchevski , Stephan Günnemann

We introduce GlassMLP, a machine learning framework using physics-inspired structural input to predict the long-time dynamics in deeply supercooled liquids. We apply this deep neural network to atomistic models in 2D and 3D. Its performance…

Soft Condensed Matter · Physics 2023-09-29 Gerhard Jung , Giulio Biroli , Ludovic Berthier

Spatiotemporal graph neural networks have shown to be effective in time series forecasting applications, achieving better performance than standard univariate predictors in several settings. These architectures take advantage of a graph…

Machine Learning · Computer Science 2023-11-13 Andrea Cini , Ivan Marisca , Daniele Zambon , Cesare Alippi