中文
相关论文

相关论文: Augmented Neural ODEs

200 篇论文

Neural differential equations are a promising new member in the neural network family. They show the potential of differential equations for time series data analysis. In this paper, the strength of the ordinary differential equation (ODE)…

机器学习 · 计算机科学 2020-05-21 Mansura Habiba , Barak A. Pearlmutter

Fractional Differential Equations (FDEs) are essential tools for modelling complex systems in science and engineering. They extend the traditional concepts of differentiation and integration to non-integer orders, enabling a more precise…

机器学习 · 计算机科学 2025-03-27 C. Coelho , M. Fernanda P. Costa , L. L. Ferrás

We introduce a new family of deep neural network models. Instead of specifying a discrete sequence of hidden layers, we parameterize the derivative of the hidden state using a neural network. The output of the network is computed using a…

机器学习 · 计算机科学 2019-12-17 Ricky T. Q. Chen , Yulia Rubanova , Jesse Bettencourt , David Duvenaud

The idea of neural Ordinary Differential Equations (ODE) is to approximate the derivative of a function (data model) instead of the function itself. In residual networks, instead of having a discrete sequence of hidden layers, the…

计算机视觉与模式识别 · 计算机科学 2022-09-20 Seyedalireza Khoshsirat , Chandra Kambhamettu

Model reduction for fluid flow simulation continues to be of great interest across a number of scientific and engineering fields. Here, we explore the use of Neural Ordinary Differential Equations, a recently introduced family of…

机器学习 · 计算机科学 2021-04-30 Sourav Dutta , Peter Rivera-Casillas , Matthew W. Farthing

The existing Neural ODE formulation relies on an explicit knowledge of the termination time. We extend Neural ODEs to implicitly defined termination criteria modeled by neural event functions, which can be chained together and…

机器学习 · 计算机科学 2021-10-28 Ricky T. Q. Chen , Brandon Amos , Maximilian Nickel

Neural Ordinary Differential Equations model dynamical systems with ODEs learned by neural networks. However, ODEs are fundamentally inadequate to model systems with long-range dependencies or discontinuities, which are common in…

机器学习 · 计算机科学 2022-06-15 Samuel Holt , Zhaozhi Qian , Mihaela van der Schaar

Classical neural ODEs trained with explicit methods are intrinsically limited by stability, crippling their efficiency and robustness for stiff learning problems that are common in graph learning and scientific machine learning. We present…

机器学习 · 计算机科学 2024-12-17 Hong Zhang , Ying Liu , Romit Maulik

We introduce a provably stable variant of neural ordinary differential equations (neural ODEs) whose trajectories evolve on an energy functional parametrised by a neural network. Stable neural flows provide an implicit guarantee on…

机器学习 · 计算机科学 2020-03-19 Stefano Massaroli , Michael Poli , Michelangelo Bin , Jinkyoo Park , Atsushi Yamashita , Hajime Asama

Recent research in deep learning has shown that neural networks can learn differential equations governing dynamical systems. In this paper, we adapt this concept to Virtual Analog (VA) modeling to learn the ordinary differential equations…

音频与语音处理 · 电气工程与系统科学 2022-08-09 Jan Wilczek , Alec Wright , Vesa Välimäki , Emanuël Habets

Neural Ordinary Differential Equations (NODEs), a framework of continuous-depth neural networks, have been widely applied, showing exceptional efficacy in coping with representative datasets. Recently, an augmented framework has been…

机器学习 · 计算机科学 2023-04-12 Qunxi Zhu , Yao Guo , Wei Lin

Neural ordinary differential equations describe how values change in time. This is the reason why they gained importance in modeling sequential data, especially when the observations are made at irregular intervals. In this paper we propose…

机器学习 · 计算机科学 2021-10-26 Marin Biloš , Johanna Sommer , Syama Sundar Rangapuram , Tim Januschowski , Stephan Günnemann

Increasing the layer number of on-chip photonic neural networks (PNNs) is essential to improve its model performance. However, the successively cascading of network hidden layers results in larger integrated photonic chip areas. To address…

机器学习 · 计算机科学 2023-02-08 Yun Zhao , Hang Chen , Min Lin , Haiou Zhang , Tao Yan , Xing Lin , Ruqi Huang , Qionghai Dai

Neural ordinary differential equations (ODEs) have been attracting increasing attention in various research domains recently. There have been some works studying optimization issues and approximation capabilities of neural ODEs, but their…

机器学习 · 计算机科学 2022-03-04 Hanshu Yan , Jiawei Du , Vincent Y. F. Tan , Jiashi Feng

Neural Ordinary Differential Equations (NODEs), a framework of continuous-depth neural networks, have been widely applied, showing exceptional efficacy in coping with some representative datasets. Recently, an augmented framework has been…

机器学习 · 计算机科学 2021-02-23 Qunxi Zhu , Yao Guo , Wei Lin

Neural Ordinary Differential Equations (N-ODEs) are a powerful building block for learning systems, which extend residual networks to a continuous-time dynamical system. We propose a Bayesian version of N-ODEs that enables well-calibrated…

机器学习 · 计算机科学 2020-02-19 Andreas Look , Melih Kandemir

Artificial neural networks, widely recognised for their role in machine learning, are now transforming the study of ordinary differential equations (ODEs), bridging data-driven modelling with classical dynamical systems and enabling the…

最优化与控制 · 数学 2025-04-15 Dario Izzo , Sebastien Origer , Giacomo Acciarini , Francesco Biscani

Neural Ordinary Differential Equations (NODEs) have proven to be a powerful modeling tool for approximating (interpolation) and forecasting (extrapolation) irregularly sampled time series data. However, their performance degrades…

机器学习 · 计算机科学 2020-04-29 Hammad A. Ayyubi , Yi Yao , Ajay Divakaran

A key appeal of the recently proposed Neural Ordinary Differential Equation (ODE) framework is that it seems to provide a continuous-time extension of discrete residual neural networks. As we show herein, though, trained Neural ODE models…

机器学习 · 计算机科学 2023-09-12 Katharina Ott , Prateek Katiyar , Philipp Hennig , Michael Tiemann

Normalizing flows are a powerful technique for obtaining reparameterizable samples from complex multimodal distributions. Unfortunately current approaches fall short when the underlying space has a non trivial topology, and are only…

机器学习 · 统计学 2020-06-12 Luca Falorsi , Patrick Forré