中文
相关论文

相关论文: Experimental study of Neural ODE training with ada…

200 篇论文

End-to-end learning of dynamical systems with black-box models, such as neural ordinary differential equations (ODEs), provides a flexible framework for learning dynamics from data without prescribing a mathematical model for the dynamics.…

机器学习 · 统计学 2022-06-20 Paidamoyo Chapfuwa , Sherri Rose , Lawrence Carin , Edward Meeds , Ricardo Henao

A key appeal of the recently proposed Neural Ordinary Differential Equation (ODE) framework is that it seems to provide a continuous-time extension of discrete residual neural networks. As we show herein, though, trained Neural ODE models…

机器学习 · 计算机科学 2023-09-12 Katharina Ott , Prateek Katiyar , Philipp Hennig , Michael Tiemann

Implicit layer deep learning techniques, like Neural Differential Equations, have become an important modeling framework due to their ability to adapt to new problems automatically. Training a neural differential equation is effectively a…

机器学习 · 计算机科学 2023-06-05 Avik Pal , Alan Edelman , Chris Rackauckas

Most machine learning methods are used as a black box for modelling. We may try to extract some knowledge from physics-based training methods, such as neural ODE (ordinary differential equation). Neural ODE has advantages like a possibly…

机器学习 · 计算机科学 2022-06-08 Yakov Golovanev , Alexander Hvatov

We introduce a new family of deep neural network models. Instead of specifying a discrete sequence of hidden layers, we parameterize the derivative of the hidden state using a neural network. The output of the network is computed using a…

机器学习 · 计算机科学 2019-12-17 Ricky T. Q. Chen , Yulia Rubanova , Jesse Bettencourt , David Duvenaud

Since the advent of the ``Neural Ordinary Differential Equation (Neural ODE)'' paper, learning ODEs with deep learning has been applied to system identification, time-series forecasting, and related areas. Exploiting the diffeomorphic…

机器学习 · 统计学 2025-08-27 Yuji Okamoto , Tomoya Takeuchi , Yusuke Sakemi

Democratization of machine learning requires architectures that automatically adapt to new problems. Neural Differential Equations (NDEs) have emerged as a popular modeling framework by removing the need for ML practitioners to choose the…

机器学习 · 计算机科学 2022-02-08 Avik Pal , Yingbo Ma , Viral Shah , Christopher Rackauckas

Training neural ODEs on large datasets has not been tractable due to the necessity of allowing the adaptive numerical ODE solver to refine its step size to very small values. In practice this leads to dynamics equivalent to many hundreds or…

机器学习 · 统计学 2020-06-24 Chris Finlay , Jörn-Henrik Jacobsen , Levon Nurbekyan , Adam M Oberman

Most ordinary differential equation (ODE) models used to describe biological or physical systems must be solved approximately using numerical methods. Perniciously, even those solvers which seem sufficiently accurate for the forward…

Neural Ordinary Differential Equations (ODEs) represent a significant advancement at the intersection of machine learning and dynamical systems, offering a continuous-time analog to discrete neural networks. Despite their promise, deploying…

数值分析 · 数学 2025-06-18 Matteo Caldana , Jan S. Hesthaven

Continuous deep learning architectures have recently re-emerged as Neural Ordinary Differential Equations (Neural ODEs). This infinite-depth approach theoretically bridges the gap between deep learning and dynamical systems, offering a…

机器学习 · 计算机科学 2021-01-12 Stefano Massaroli , Michael Poli , Jinkyoo Park , Atsushi Yamashita , Hajime Asama

A conventional approach to train neural ordinary differential equations (ODEs) is to fix an ODE solver and then learn the neural network's weights to optimize a target loss function. However, such an approach is tailored for a specific…

机器学习 · 计算机科学 2021-03-16 Julia Gusak , Alexandr Katrutsa , Talgat Daulbaev , Andrzej Cichocki , Ivan Oseledets

Ordinary Differential Equations (ODEs) are widely used in physics, chemistry, and biology to model dynamic systems, including reaction kinetics, population dynamics, and biological processes. In this work, we integrate GPU-accelerated ODE…

机器学习 · 计算机科学 2024-12-02 Rakshit Kr. Singh , Aaron Rock Menezes , Rida Irfan , Bharath Ramsundar

Ordinary differential equations (ODEs) provide a powerful framework for modeling dynamic systems arising in a wide range of scientific domains. However, most existing ODE methods focus on a single system, and do not adequately address the…

统计方法学 · 统计学 2026-04-08 Shuoxun Xu , Zijian Guo , Brooke R. Staveland , Robert T. Knight , Lexin Li

Artificial neural networks, widely recognised for their role in machine learning, are now transforming the study of ordinary differential equations (ODEs), bridging data-driven modelling with classical dynamical systems and enabling the…

最优化与控制 · 数学 2025-04-15 Dario Izzo , Sebastien Origer , Giacomo Acciarini , Francesco Biscani

Continuous deep learning models, referred to as Neural Ordinary Differential Equations (Neural ODEs), have received considerable attention over the last several years. Despite their burgeoning impact, there is a lack of formal analysis…

机器学习 · 计算机科学 2022-07-15 Diego Manzanas Lopez , Patrick Musau , Nathaniel Hamilton , Taylor T. Johnson

Neural Ordinary Differential Equations (ODE) are a promising approach to learn dynamic models from time-series data in science and engineering applications. This work aims at learning Neural ODE for stiff systems, which are usually raised…

数值分析 · 数学 2021-10-04 Suyong Kim , Weiqi Ji , Sili Deng , Yingbo Ma , Christopher Rackauckas

We focus on learning unknown dynamics from data using ODE-nets templated on implicit numerical initial value problem solvers. First, we perform Inverse Modified error analysis of the ODE-nets using unrolled implicit schemes for ease of…

数值分析 · 数学 2023-04-11 Aiqing Zhu , Tom Bertalan , Beibei Zhu , Yifa Tang , Ioannis G. Kevrekidis

Using vanilla NeuralODEs to model large and/or complex systems often fails due two reasons: Stability and convergence. NeuralODEs are capable of describing stable as well as instable dynamic systems. Selecting an appropriate numerical…

机器学习 · 计算机科学 2023-02-23 Tobias Thummerer , Lars Mikelsons

Reinforcement learning-based quadruped robots excel across various terrains but still lack the ability to swim in water due to the complex underwater environment. This paper presents the development and evaluation of a data-driven…

机器人学 · 计算机科学 2024-10-02 Cong Wang , Aoming Liang , Fei Han , Xinyu Zeng , Zhibin Li , Dixia Fan , Jens Kober
‹ 上一页 1 2 3 10 下一页 ›