中文
相关论文

相关论文: Efficient Training of Physics-enhanced Neural ODEs…

200 篇论文

In this paper, we propose a novel Physics-Informed Neural Network (PINN) framework based on the Cord\`{e}s condition for solving both linear and fully nonlinear partial differential equations (PDEs) in non-divergence form, together with…

数值分析 · 数学 2026-04-29 Bingcheng Hu , Lixiang Jin , Zhaoxiang Li

Recent years have seen a growing interest in understanding acceleration methods through the lens of ordinary differential equations (ODEs). Despite the theoretical advancements, translating the rapid convergence observed in continuous-time…

最优化与控制 · 数学 2024-06-05 Zhonglin Xie , Wotao Yin , Zaiwen Wen

Solving partial differential equations (PDEs) numerically often requires huge computing time, energy cost, and hardware resources in practical applications. This has limited their applications in many scenarios (e.g., autonomous systems,…

机器学习 · 计算机科学 2024-01-05 Yequan Zhao , Xian Xiao , Xinling Yu , Ziyue Liu , Zhixiong Chen , Geza Kurczveil , Raymond G. Beausoleil , Zheng Zhang

Physics-informed neural networks (PINNs) have emerged as a prominent approach for solving partial differential equations (PDEs) by minimizing a combined loss function that incorporates both boundary loss and PDE residual loss. Despite their…

机器学习 · 计算机科学 2025-01-16 Youngsik Hwang , Dong-Young Lim

We propose a data-driven framework for learning reduced-order moment dynamics from PDE-governed systems using Neural ODEs. In contrast to derivative-based methods like SINDy, which necessitate densely sampled data and are sensitive to…

斑图形成与孤子 · 物理学 2025-06-06 Shaoxuan Chen , Su Yang , Panayotis G. Kevrekidis , Wei Zhu

Statistical regression models whose mean functions are represented by ordinary differential equations (ODEs) can be used to describe phenomenons dynamical in nature, which are abundant in areas such as biology, climatology and genetics. The…

统计方法学 · 统计学 2017-05-15 Kyoungjae Lee , Jaeyong Lee , Sarat C. Dass

We introduce economical versions of standard implicit ODE solvers that are specifically tailored for the efficient and accurate simulation of neural networks. These reformulations allow to achieve a significant increase in the efficiency of…

We present a method for learning dynamics of complex physical processes described by time-dependent nonlinear partial differential equations (PDEs). Our particular interest lies in extrapolating solutions in time beyond the range of…

机器学习 · 计算机科学 2020-12-07 Jungeun Kim , Kookjin Lee , Dongeun Lee , Sheo Yon Jin , Noseong Park

Stiff ordinary differential equations (ODEs) are common in many science and engineering fields, but standard neural ODE approaches struggle to accurately learn these stiff systems, posing a significant barrier to widespread adoption of…

数值分析 · 数学 2024-12-03 Colby Fronk , Linda Petzold

Industrial design evaluation often relies on high-fidelity simulations of governing partial differential equations (PDEs). While accurate, these simulations are computationally expensive, making dense exploration of design spaces…

机器学习 · 计算机科学 2025-10-01 Zhizhou Zhang , Youjia Wu , Kaixuan Zhang , Yanjia Wang

We introduce a provably stable variant of neural ordinary differential equations (neural ODEs) whose trajectories evolve on an energy functional parametrised by a neural network. Stable neural flows provide an implicit guarantee on…

机器学习 · 计算机科学 2020-03-19 Stefano Massaroli , Michael Poli , Michelangelo Bin , Jinkyoo Park , Atsushi Yamashita , Hajime Asama

Viewing optimization methods as numerical integrators for ordinary differential equations (ODEs) provides a thought-provoking modern framework for studying accelerated first-order optimizers. In this literature, acceleration is often…

最优化与控制 · 数学 2021-02-24 Peiyuan Zhang , Antonio Orvieto , Hadi Daneshmand , Thomas Hofmann , Roy Smith

We show that the error achievable using physics-informed neural networks for solving systems of differential equations can be substantially reduced when these networks are trained using meta-learned optimization methods rather than to using…

机器学习 · 计算机科学 2023-03-15 Alex Bihlo

Computing the ground state of interacting quantum matter is a long-standing challenge, especially for complex two-dimensional systems. Recent developments have highlighted the potential of neural quantum states to solve the quantum…

无序系统与神经网络 · 物理学 2025-07-03 Ao Chen , Markus Heyl

Neural networks, especially the recent proposed neural operator models, are increasingly being used to find the solution operator of differential equations. Compared to traditional numerical solvers, they are much faster and more efficient…

机器学习 · 计算机科学 2022-12-09 Ye Li , Yiwen Pang , Bin Shan

Modeling biological dynamical systems is challenging due to the interdependence of different system components, some of which are not fully understood. To fill existing gaps in our ability to mechanistically model physiological systems, we…

A class of neural networks that gained particular interest in the last years are neural ordinary differential equations (neural ODEs). We study input-output relations of neural ODEs using dynamical systems theory and prove several results…

动力系统 · 数学 2023-09-29 Christian Kuehn , Sara-Viola Kuntz

Training networks consisting of biophysically accurate neuron models could allow for new insights into how brain circuits can organize and solve tasks. We begin by analyzing the extent to which the central algorithm for neural network…

神经元与认知 · 定量生物学 2023-11-22 James Hazelden , Yuhan Helena Liu , Eli Shlizerman , Eric Shea-Brown

Physics-informed neural networks (PINNs) are revolutionizing science and engineering practice by bringing together the power of deep learning to bear on scientific computation. In forward modeling problems, PINNs are meshless partial…

机器学习 · 计算机科学 2023-11-28 Yicheng Wang , Xiaotian Han , Chia-Yuan Chang , Daochen Zha , Ulisses Braga-Neto , Xia Hu

In solving partial differential equations (PDEs), machine learning utilizing physical laws has received considerable attention owing to advantages such as mesh-free solutions, unsupervised learning, and feasibility for solving…

机器学习 · 计算机科学 2026-03-25 Tetsuro Tsuchino , Motoki Shiga