中文
相关论文

相关论文: Uncertainty and Structure in Neural Ordinary Diffe…

200 篇论文

Continuous deep learning models, referred to as Neural Ordinary Differential Equations (Neural ODEs), have received considerable attention over the last several years. Despite their burgeoning impact, there is a lack of formal analysis…

机器学习 · 计算机科学 2022-07-15 Diego Manzanas Lopez , Patrick Musau , Nathaniel Hamilton , Taylor T. Johnson

Neural Ordinary Differential Equations (ODE) are a promising approach to learn dynamic models from time-series data in science and engineering applications. This work aims at learning Neural ODE for stiff systems, which are usually raised…

数值分析 · 数学 2021-10-04 Suyong Kim , Weiqi Ji , Sili Deng , Yingbo Ma , Christopher Rackauckas

Ordinary differential equations (ODEs) can provide mechanistic models of temporally local changes of processes, where parameters are often informed by external knowledge. While ODEs are popular in systems modeling, they are less established…

统计方法学 · 统计学 2025-07-10 Maren Hackenberg , Astrid Pechmann , Clemens Kreutz , Janbernd Kirschner , Harald Binder

Neural ordinary differential equations (ODEs) have attracted much attention as continuous-time counterparts of deep residual neural networks (NNs), and numerous extensions for recurrent NNs have been proposed. Since the 1980s, ODEs have…

机器学习 · 计算机科学 2022-10-17 Kazuki Irie , Francesco Faccio , Jürgen Schmidhuber

Ordinary and partial differential equations (ODEs/PDEs) play a paramount role in analyzing and simulating complex dynamic processes across all corners of science and engineering. In recent years machine learning tools are aspiring to…

机器学习 · 计算机科学 2021-06-11 Sifan Wang , Paris Perdikaris

Neural Ordinary Differential Equations (NODEs) have proven to be a powerful modeling tool for approximating (interpolation) and forecasting (extrapolation) irregularly sampled time series data. However, their performance degrades…

机器学习 · 计算机科学 2020-04-29 Hammad A. Ayyubi , Yi Yao , Ajay Divakaran

Neural differential equations are a promising new member in the neural network family. They show the potential of differential equations for time series data analysis. In this paper, the strength of the ordinary differential equation (ODE)…

机器学习 · 计算机科学 2020-05-21 Mansura Habiba , Barak A. Pearlmutter

To better understand and improve the behavior of neural networks, a recent line of works bridged the connection between ordinary differential equations (ODEs) and deep neural networks (DNNs). The connections are made in two folds: (1) View…

机器学习 · 计算机科学 2019-11-05 Xinshi Chen

Many problems in science and engineering can be represented by a set of partial differential equations (PDEs) through mathematical modeling. Mechanism-based computation following PDEs has long been an essential paradigm for studying topics…

机器学习 · 计算机科学 2022-11-21 Shudong Huang , Wentao Feng , Chenwei Tang , Jiancheng Lv

Dynamic astrophysical phenomena are predominantly described by differential equations, yet our understanding of these systems is constrained by our incomplete grasp of non-linear physics and scarcity of comprehensive datasets. As such,…

星系天体物理 · 物理学 2023-11-29 Dustin D. Nguyen , Yuan-Sen Ting , Todd A. Thompson , Sebastian Lopez , Laura A. Lopez

Ordinary differential equations (ODEs), via their induced flow maps, provide a powerful framework to parameterize invertible transformations for the purpose of representing complex probability distributions. While such models have achieved…

统计理论 · 数学 2023-09-06 Youssef Marzouk , Zhi Ren , Sven Wang , Jakob Zech

Differential equations in general and neural ODEs in particular are an essential technique in continuous-time system identification. While many deterministic learning algorithms have been designed based on numerical integration via the…

机器学习 · 计算机科学 2021-10-18 Lenart Treven , Philippe Wenk , Florian Dörfler , Andreas Krause

Neural operators are a type of deep architecture that learns to solve (i.e. learns the nonlinear solution operator of) partial differential equations (PDEs). The current state of the art for these models does not provide explicit…

机器学习 · 计算机科学 2022-08-03 Emilia Magnani , Nicholas Krämer , Runa Eschenhagen , Lorenzo Rosasco , Philipp Hennig

Neural Ordinary Differential Equations (N-ODEs) are a powerful building block for learning systems, which extend residual networks to a continuous-time dynamical system. We propose a Bayesian version of N-ODEs that enables well-calibrated…

机器学习 · 计算机科学 2020-02-19 Andreas Look , Melih Kandemir

The conjoining of dynamical systems and deep learning has become a topic of great interest. In particular, neural differential equations (NDEs) demonstrate that neural networks and differential equation are two sides of the same coin.…

机器学习 · 计算机科学 2022-02-08 Patrick Kidger

When learning dynamical systems from data, embedding physical structure can constrain the solution space and improve generalization, but many physics-informed models assume access to the full system state. This limits their use in partially…

机器学习 · 计算机科学 2026-05-25 Sunniva Meltzer , Sølve Eidnes , Alexander Johannes Stasik

Learning how complex dynamical systems evolve over time is a key challenge in system identification. For safety critical systems, it is often crucial that the learned model is guaranteed to converge to some equilibrium point. To this end,…

机器学习 · 计算机科学 2021-12-13 Andreas Schlaginhaufen , Philippe Wenk , Andreas Krause , Florian Dörfler

Neural ordinary differential equations (Neural ODEs) are an effective framework for learning dynamical systems from irregularly sampled time series data. These models provide a continuous-time latent representation of the underlying…

机器学习 · 计算机科学 2023-03-06 Edward De Brouwer , Rahul G. Krishnan

Embedding nonlinear dynamical systems into artificial neural networks is a powerful new formalism for machine learning. By parameterizing ordinary differential equations (ODEs) as neural network layers, these Neural ODEs are…

机器学习 · 计算机科学 2024-10-28 Mikko Lehtimäki , Lassi Paunonen , Marja-Leena Linne

Numerical simulation of ordinary differential equations (ODEs) can be challenging when the system exhibits high accelerations and rapidly changing dynamics. Under these conditions the ODE solver often needs to take very small time steps in…

数值分析 · 数学 2026-05-11 Andrew Tagg , Andrew Frandsen , Andrew Ning