中文
相关论文

相关论文: Training Neural ODEs Using Fully Discretized Simul…

200 篇论文

Differential equations are widely used to describe complex dynamical systems with evolving parameters in nature and engineering. Effectively learning a family of maps from the parameter function to the system dynamics is of great…

机器学习 · 计算机科学 2025-03-12 Xin Li , Chengli Zhao , Xue Zhang , Xiaojun Duan

Neural networks have shown great potential in accelerating the solution of partial differential equations (PDEs). Recently, there has been a growing interest in introducing physics constraints into training neural PDE solvers to reduce the…

机器学习 · 计算机科学 2023-05-30 Xinquan Huang , Wenlei Shi , Qi Meng , Yue Wang , Xiaotian Gao , Jia Zhang , Tie-Yan Liu

A wide range of modern science and engineering applications are formulated as optimization problems with a system of partial differential equations (PDEs) as constraints. These PDE-constrained optimization problems are typically solved in a…

人工智能 · 计算机科学 2021-04-28 Yuyu Zhang , Heng Chi , Binghong Chen , Tsz Ling Elaine Tang , Lucia Mirabella , Le Song , Glaucio H. Paulino

Neural Ordinary Differential Equations (Neural ODEs) are the continuous analog of Residual Neural Networks (ResNets). We investigate whether the discrete dynamics defined by a ResNet are close to the continuous one of a Neural ODE. We first…

机器学习 · 计算机科学 2022-09-16 Michael E. Sander , Pierre Ablin , Gabriel Peyré

Purpose: To develop a neural ordinary differential equation (ODE) model for visualizing deep neural network (DNN) behavior during multi-parametric MRI (mp-MRI) based glioma segmentation as a method to enhance deep learning explainability.…

定量方法 · 定量生物学 2022-03-25 Zhenyu Yang , Zongsheng Hu , Hangjie Ji , Kyle Lafata , Scott Floyd , Fang-Fang Yin , Chunhao Wang

We propose a framework for training neural networks that are coupled with partial differential equations (PDEs) in a parallel computing environment. Unlike most distributed computing frameworks for deep neural networks, our focus is to…

分布式、并行与集群计算 · 计算机科学 2020-11-25 Kailai Xu , Weiqiang Zhu , Eric Darve

Controlling continuous-time dynamical systems is generally a two step process: first, identify or model the system dynamics with differential equations, then, minimize the control objectives to achieve optimal control function and optimal…

人工智能 · 计算机科学 2024-04-23 Cheng Chi

The present project aims to use machine learning, specifically neural networks (NN), to learn the trajectories of a set of coupled ordinary differential equations (ODEs) and decrease compute times for obtaining ODE solutions by using this…

机器学习 · 计算机科学 2020-09-18 Camila Faccini de Lima , Juliano Ferrari Gianlupi , John Metzcar , Juliette Zerick

Solving partial differential equations (PDEs) with machine learning typically requires training a new neural network for every new equation. This optimization is slow. We introduce MetaColloc. It is an optimization-free and data-free…

机器学习 · 计算机科学 2026-05-13 Zichuan Yang

The connection of Taylor maps and polynomial neural networks (PNN) to solve ordinary differential equations (ODEs) numerically is considered. Having the system of ODEs, it is possible to calculate weights of PNN that simulates the dynamics…

神经与进化计算 · 计算机科学 2020-08-11 Andrei Ivanov , Anna Golovkina , Uwe Iben

Latent ODE models provide flexible descriptions of dynamic systems, but they can struggle with extrapolation and predicting complicated non-linear dynamics. The latent ODE approach implicitly relies on encoders to identify unknown system…

机器学习 · 计算机科学 2024-10-14 Matt L. Sampson , Peter Melchior

The neural Ordinary Differential Equation (ODE) model has shown success in learning complex continuous-time processes from observations on discrete time stamps. In this work, we consider the modeling and forecasting of time series data that…

机器学习 · 统计学 2023-06-05 Yixuan Tan , Liyan Xie , Xiuyuan Cheng

Deep neural operators can learn nonlinear mappings between infinite-dimensional function spaces via deep neural networks. As promising surrogate solvers of partial differential equations (PDEs) for real-time prediction, deep neural…

机器学习 · 计算机科学 2023-05-17 Min Zhu , Handi Zhang , Anran Jiao , George Em Karniadakis , Lu Lu

Differential equations are frequently used in engineering domains, such as modeling and control of industrial systems, where safety and performance guarantees are of paramount importance. Traditional physics-based modeling approaches…

系统与控制 · 电气工程与系统科学 2020-11-30 Aaron Tuor , Jan Drgona , Draguna Vrabie

Neural networks have the ability to serve as universal function approximators, but they are not interpretable and don't generalize well outside of their training region. Both of these issues are problematic when trying to apply standard…

机器学习 · 计算机科学 2023-08-21 Colby Fronk , Linda Petzold

Solving constrained nonlinear optimization problems (CNLPs) is a longstanding problem that arises in various fields, e.g., economics, computer science, and engineering. We propose optimization-informed neural networks (OINN), a deep…

最优化与控制 · 数学 2023-06-27 Dawen Wu , Abdel Lisser

This paper proposes a novel inverse kinematics (IK) solver of articulated robotic systems for path planning. IK is a traditional but essential problem for robot manipulation. Recently, data-driven methods have been proposed to quickly solve…

机器人学 · 计算机科学 2022-09-02 Suhan Park , Mathew Schwartz , Jaeheung Park

Sequential-in-time methods solve a sequence of training problems to fit nonlinear parametrizations such as neural networks to approximate solution trajectories of partial differential equations over time. This work shows that…

数值分析 · 数学 2024-04-02 Huan Zhang , Yifan Chen , Eric Vanden-Eijnden , Benjamin Peherstorfer

In many scientific and engineering (e.g., physical, biochemical, medical) practices, data generated through expensive experiments or large-scale simulations, are often sparse and noisy. Physics-informed neural network (PINN) incorporates…

机器学习 · 计算机科学 2025-10-21 Kai-liang Lu

A concept of using Neural Ordinary Differential Equations(NODE) for Transfer Learning has been introduced. In this paper we use the EfficientNets to explore transfer learning on CIFAR-10 dataset. We use NODE for fine-tuning our model. Using…

机器学习 · 计算机科学 2020-01-22 Rajath S , Sumukh Aithal K , Natarajan Subramanyam