中文
相关论文

相关论文: Augmented Neural ODEs

200 篇论文

Recently, Neural Ordinary Differential Equations has emerged as a powerful framework for modeling physical simulations without explicitly defining the ODEs governing the system, but instead learning them via machine learning. However, the…

Neural ordinary differential equations (NODEs) is an invertible neural network architecture promising for its free-form Jacobian and the availability of a tractable Jacobian determinant estimator. Recently, the representation power of NODEs…

机器学习 · 计算机科学 2020-12-07 Takeshi Teshima , Koichi Tojo , Masahiro Ikeda , Isao Ishikawa , Kenta Oono

Variational Autoencoders (VAEs) are a powerful framework for learning latent representations of reduced dimensionality, while Neural ODEs excel in learning transient system dynamics. This work combines the strengths of both to generate fast…

机器学习 · 计算机科学 2025-02-27 Julius Aka , Johannes Brunnemann , Jörg Eiden , Arne Speerforck , Lars Mikelsons

The conjoining of dynamical systems and deep learning has become a topic of great interest. In particular, neural differential equations (NDEs) demonstrate that neural networks and differential equation are two sides of the same coin.…

机器学习 · 计算机科学 2022-02-08 Patrick Kidger

Learning how complex dynamical systems evolve over time is a key challenge in system identification. For safety critical systems, it is often crucial that the learned model is guaranteed to converge to some equilibrium point. To this end,…

机器学习 · 计算机科学 2021-12-13 Andreas Schlaginhaufen , Philippe Wenk , Andreas Krause , Florian Dörfler

Understanding how the dynamics in biological and artificial neural networks implement the computations required for a task is a salient open question in machine learning and neuroscience. In particular, computations requiring complex memory…

机器学习 · 计算机科学 2023-07-14 Timothy Doyeon Kim , Tankut Can , Kamesh Krishnamurthy

Continuous-depth neural networks, such as Neural ODEs, have refashioned the understanding of residual neural networks in terms of non-linear vector-valued optimal control problems. The common solution is to use the adjoint sensitivity…

机器学习 · 计算机科学 2022-02-16 Andrew Corbett , Dmitry Kangin

Continuous-depth neural networks, such as the Neural Ordinary Differential Equations (ODEs), have aroused a great deal of interest from the communities of machine learning and data science in recent years, which bridge the connection…

机器学习 · 计算机科学 2022-01-05 Qunxi Zhu , Yifei Shen , Dongsheng Li , Wei Lin

Neural ordinary differential equations (NODEs) are an effective approach for data-driven modeling of dynamical systems arising from simulations and experiments. One of the major shortcomings of NODEs, especially when coupled with explicit…

数值分析 · 数学 2025-12-30 Allen Alvarez Loya , Daniel A. Serino , J. W. Burby , Qi Tang

Neural Ordinary Differential Equations (NODEs) use a neural network to model the instantaneous rate of change in the state of a system. However, despite their apparent suitability for dynamics-governed time-series, NODEs present a few…

机器学习 · 计算机科学 2021-08-18 Alexander Norcliffe , Cristian Bodnar , Ben Day , Jacob Moss , Pietro Liò

Stochastic regularization of neural networks (e.g. dropout) is a wide-spread technique in deep learning that allows for better generalization. Despite its success, continuous-time models, such as neural ordinary differential equation (ODE),…

机器学习 · 计算机科学 2020-06-29 Viktor Oganesyan , Alexandra Volokhova , Dmitry Vetrov

Neural Ordinary Differential Equations (Neural ODEs) represent continuous-time dynamics with neural networks, offering advancements for modeling and control tasks. However, training Neural ODEs requires solving differential equations at…

机器学习 · 计算机科学 2025-02-24 Mariia Shapovalova , Calvin Tsay

In numerous robotics and mechanical engineering applications, among others, data is often constrained on smooth manifolds due to the presence of rotational degrees of freedom. Common datadriven and learning-based methods such as neural…

最优化与控制 · 数学 2023-05-16 Karthik Elamvazhuthi , Xuechen Zhang , Samet Oymak , Fabio Pasqualetti

Partial differential equations (PDEs) serve as the cornerstone of mathematical physics. In recent years, Physics-Informed Neural Networks (PINNs) have significantly reduced the dependence on large datasets by embedding physical laws…

机器学习 · 计算机科学 2025-06-09 Wenxuan Huo , Qiang He , Gang Zhu , Weifeng Huang

Partial Differential Equations (PDEs) are central to science and engineering. Since solving them is computationally expensive, a lot of effort has been put into approximating their solution operator via both traditional and recently…

机器学习 · 计算机科学 2025-02-14 Alessandro Longhi , Danny Lathouwers , Zoltán Perkó

We study the problem of learning neural network models for Ordinary Differential Equations (ODEs) with parametric uncertainties. Such neural network models capture the solution to the ODE over a given set of parameters, initial conditions,…

机器学习 · 计算机科学 2025-07-31 Chandra Kanth Nagesh , Sriram Sankaranarayanan , Ramneet Kaur , Tuhin Sahai , Susmit Jha

Neural Ordinary Differential Equations (NODEs) are a novel neural architecture, built around initial value problems with learned dynamics which are solved during inference. Thought to be inherently more robust against adversarial…

机器学习 · 计算机科学 2023-03-10 Mustafa Zeqiri , Mark Niklas Müller , Marc Fischer , Martin Vechev

Neural ordinary differential equations (neural ODEs) are a popular type of deep learning model that operate with continuous-depth architectures. To assess how well such models perform on unseen data, it is crucial to understand their…

机器学习 · 计算机科学 2025-08-27 Madhusudan Verma , Manoj Kumar

Operator learning has emerged as a promising paradigm for developing efficient surrogate models to solve partial differential equations (PDEs). However, existing approaches often overlook the domain knowledge inherent in the underlying PDEs…

机器学习 · 计算机科学 2025-10-20 Ziqian Li , Kang Liu , Yongcun Song , Hangrui Yue , Enrique Zuazua

A recent paradigm views deep neural networks as discretizations of certain controlled ordinary differential equations, sometimes called neural ordinary differential equations. We make use of this perspective to link expressiveness of deep…

最优化与控制 · 数学 2020-07-20 Christa Cuchiero , Martin Larsson , Josef Teichmann