English
Related papers

Related papers: Efficient Training of Physics-enhanced Neural ODEs…

200 papers

In this paper, we propose a novel Physics-Informed Neural Network (PINN) framework based on the Cord\`{e}s condition for solving both linear and fully nonlinear partial differential equations (PDEs) in non-divergence form, together with…

Numerical Analysis · Mathematics 2026-04-29 Bingcheng Hu , Lixiang Jin , Zhaoxiang Li

Recent years have seen a growing interest in understanding acceleration methods through the lens of ordinary differential equations (ODEs). Despite the theoretical advancements, translating the rapid convergence observed in continuous-time…

Optimization and Control · Mathematics 2024-06-05 Zhonglin Xie , Wotao Yin , Zaiwen Wen

Solving partial differential equations (PDEs) numerically often requires huge computing time, energy cost, and hardware resources in practical applications. This has limited their applications in many scenarios (e.g., autonomous systems,…

Machine Learning · Computer Science 2024-01-05 Yequan Zhao , Xian Xiao , Xinling Yu , Ziyue Liu , Zhixiong Chen , Geza Kurczveil , Raymond G. Beausoleil , Zheng Zhang

Physics-informed neural networks (PINNs) have emerged as a prominent approach for solving partial differential equations (PDEs) by minimizing a combined loss function that incorporates both boundary loss and PDE residual loss. Despite their…

Machine Learning · Computer Science 2025-01-16 Youngsik Hwang , Dong-Young Lim

We propose a data-driven framework for learning reduced-order moment dynamics from PDE-governed systems using Neural ODEs. In contrast to derivative-based methods like SINDy, which necessitate densely sampled data and are sensitive to…

Pattern Formation and Solitons · Physics 2025-06-06 Shaoxuan Chen , Su Yang , Panayotis G. Kevrekidis , Wei Zhu

Statistical regression models whose mean functions are represented by ordinary differential equations (ODEs) can be used to describe phenomenons dynamical in nature, which are abundant in areas such as biology, climatology and genetics. The…

Methodology · Statistics 2017-05-15 Kyoungjae Lee , Jaeyong Lee , Sarat C. Dass

We introduce economical versions of standard implicit ODE solvers that are specifically tailored for the efficient and accurate simulation of neural networks. These reformulations allow to achieve a significant increase in the efficiency of…

Numerical Analysis · Mathematics 2025-06-12 Luca Bonaventura , Soledad Fernández-García , Macarena Gómez-Mármol

We present a method for learning dynamics of complex physical processes described by time-dependent nonlinear partial differential equations (PDEs). Our particular interest lies in extrapolating solutions in time beyond the range of…

Machine Learning · Computer Science 2020-12-07 Jungeun Kim , Kookjin Lee , Dongeun Lee , Sheo Yon Jin , Noseong Park

Stiff ordinary differential equations (ODEs) are common in many science and engineering fields, but standard neural ODE approaches struggle to accurately learn these stiff systems, posing a significant barrier to widespread adoption of…

Numerical Analysis · Mathematics 2024-12-03 Colby Fronk , Linda Petzold

Industrial design evaluation often relies on high-fidelity simulations of governing partial differential equations (PDEs). While accurate, these simulations are computationally expensive, making dense exploration of design spaces…

Machine Learning · Computer Science 2025-10-01 Zhizhou Zhang , Youjia Wu , Kaixuan Zhang , Yanjia Wang

We introduce a provably stable variant of neural ordinary differential equations (neural ODEs) whose trajectories evolve on an energy functional parametrised by a neural network. Stable neural flows provide an implicit guarantee on…

Machine Learning · Computer Science 2020-03-19 Stefano Massaroli , Michael Poli , Michelangelo Bin , Jinkyoo Park , Atsushi Yamashita , Hajime Asama

Viewing optimization methods as numerical integrators for ordinary differential equations (ODEs) provides a thought-provoking modern framework for studying accelerated first-order optimizers. In this literature, acceleration is often…

Optimization and Control · Mathematics 2021-02-24 Peiyuan Zhang , Antonio Orvieto , Hadi Daneshmand , Thomas Hofmann , Roy Smith

We show that the error achievable using physics-informed neural networks for solving systems of differential equations can be substantially reduced when these networks are trained using meta-learned optimization methods rather than to using…

Machine Learning · Computer Science 2023-03-15 Alex Bihlo

Computing the ground state of interacting quantum matter is a long-standing challenge, especially for complex two-dimensional systems. Recent developments have highlighted the potential of neural quantum states to solve the quantum…

Disordered Systems and Neural Networks · Physics 2025-07-03 Ao Chen , Markus Heyl

Neural networks, especially the recent proposed neural operator models, are increasingly being used to find the solution operator of differential equations. Compared to traditional numerical solvers, they are much faster and more efficient…

Machine Learning · Computer Science 2022-12-09 Ye Li , Yiwen Pang , Bin Shan

Modeling biological dynamical systems is challenging due to the interdependence of different system components, some of which are not fully understood. To fill existing gaps in our ability to mechanistically model physiological systems, we…

A class of neural networks that gained particular interest in the last years are neural ordinary differential equations (neural ODEs). We study input-output relations of neural ODEs using dynamical systems theory and prove several results…

Dynamical Systems · Mathematics 2023-09-29 Christian Kuehn , Sara-Viola Kuntz

Training networks consisting of biophysically accurate neuron models could allow for new insights into how brain circuits can organize and solve tasks. We begin by analyzing the extent to which the central algorithm for neural network…

Neurons and Cognition · Quantitative Biology 2023-11-22 James Hazelden , Yuhan Helena Liu , Eli Shlizerman , Eric Shea-Brown

Physics-informed neural networks (PINNs) are revolutionizing science and engineering practice by bringing together the power of deep learning to bear on scientific computation. In forward modeling problems, PINNs are meshless partial…

Machine Learning · Computer Science 2023-11-28 Yicheng Wang , Xiaotian Han , Chia-Yuan Chang , Daochen Zha , Ulisses Braga-Neto , Xia Hu

In solving partial differential equations (PDEs), machine learning utilizing physical laws has received considerable attention owing to advantages such as mesh-free solutions, unsupervised learning, and feasibility for solving…

Machine Learning · Computer Science 2026-03-25 Tetsuro Tsuchino , Motoki Shiga