中文
相关论文

相关论文: Latent Time Neural Ordinary Differential Equations

200 篇论文

Irregularly sampled time series with missing values are often observed in multiple real-world applications such as healthcare, climate and astronomy. They pose a significant challenge to standard deep learning models that operate only on…

We introduce a new family of deep neural network models. Instead of specifying a discrete sequence of hidden layers, we parameterize the derivative of the hidden state using a neural network. The output of the network is computed using a…

机器学习 · 计算机科学 2019-12-17 Ricky T. Q. Chen , Yulia Rubanova , Jesse Bettencourt , David Duvenaud

Recently, Neural Ordinary Differential Equations has emerged as a powerful framework for modeling physical simulations without explicitly defining the ODEs governing the system, but instead learning them via machine learning. However, the…

Neural networks inspired by differential equations have proliferated for the past several years. Neural ordinary differential equations (NODEs) and neural controlled differential equations (NCDEs) are two representative examples of them. In…

机器学习 · 计算机科学 2021-11-17 Sheo Yon Jhin , Heejoo Shin , Seoyoung Hong , Solhee Park , Noseong Park

We explore in detail a method to solve ordinary differential equations using feedforward neural networks. We prove a specific loss function, which does not require knowledge of the exact solution, to be a suitable standard metric to…

计算物理 · 物理学 2020-06-02 Liam L. H. Lau , Denis Werth

Variational Autoencoders (VAEs) are a powerful framework for learning latent representations of reduced dimensionality, while Neural ODEs excel in learning transient system dynamics. This work combines the strengths of both to generate fast…

机器学习 · 计算机科学 2025-02-27 Julius Aka , Johannes Brunnemann , Jörg Eiden , Arne Speerforck , Lars Mikelsons

Neural Ordinary Differential Equations (ODEs) represent a significant advancement at the intersection of machine learning and dynamical systems, offering a continuous-time analog to discrete neural networks. Despite their promise, deploying…

数值分析 · 数学 2025-06-18 Matteo Caldana , Jan S. Hesthaven

We propose a method for training ordinary differential equations by using a control-theoretic Lyapunov condition for stability. Our approach, called LyaNet, is based on a novel Lyapunov loss formulation that encourages the inference…

机器学习 · 计算机科学 2022-02-08 Ivan Dario Jimenez Rodriguez , Aaron D. Ames , Yisong Yue

Stability evaluation of black-box grid-tied inverters is vital for grid reliability, yet identification techniques are both data-hungry and blocked by proprietary internals. {To solve this, this letter proposes a latent-feature-informed…

系统与控制 · 电气工程与系统科学 2026-01-13 Jialin Zheng , Zhong Liu , Xiaonan Lu

Neural ordinary differential equations (ODEs) have attracted much attention as continuous-time counterparts of deep residual neural networks (NNs), and numerous extensions for recurrent NNs have been proposed. Since the 1980s, ODEs have…

机器学习 · 计算机科学 2022-10-17 Kazuki Irie , Francesco Faccio , Jürgen Schmidhuber

Continuous deep learning models, referred to as Neural Ordinary Differential Equations (Neural ODEs), have received considerable attention over the last several years. Despite their burgeoning impact, there is a lack of formal analysis…

机器学习 · 计算机科学 2022-07-15 Diego Manzanas Lopez , Patrick Musau , Nathaniel Hamilton , Taylor T. Johnson

Differential equations are frequently used in engineering domains, such as modeling and control of industrial systems, where safety and performance guarantees are of paramount importance. Traditional physics-based modeling approaches…

系统与控制 · 电气工程与系统科学 2020-11-30 Aaron Tuor , Jan Drgona , Draguna Vrabie

Graph neural Ordinary Differential Equations (ODE) combine neural ODE with the message passing mechanism of Graph Neural Networks (GNN), providing a continuous-time modeling method for graph representation learning. However, in dynamic…

机器学习 · 计算机科学 2026-04-29 Xiaoyi Wang , Zhiqiang Wang , Jianqing Liang , Xingwang Zhao , Chuangyin Dang , Zhen Jin , Jiye Liang

A concept of using Neural Ordinary Differential Equations(NODE) for Transfer Learning has been introduced. In this paper we use the EfficientNets to explore transfer learning on CIFAR-10 dataset. We use NODE for fine-tuning our model. Using…

机器学习 · 计算机科学 2020-01-22 Rajath S , Sumukh Aithal K , Natarajan Subramanyam

We consider the problem of parameter estimation using weakly supervised datasets, where a training sample consists of the input and a partially specified annotation, which we refer to as the output. The missing information in the annotation…

机器学习 · 计算机科学 2012-06-22 M. Pawan Kumar , Ben Packer , Daphne Koller

Neural ordinary differential equations (NODE) have garnered significant attention for their design of continuous-depth neural networks and the ability to learn data/feature dynamics. However, for high-dimensional systems, estimating…

机器学习 · 计算机科学 2025-10-07 Muhao Guo , Haoran Li , Yang Weng

Rapidly developing machine learning methods has stimulated research interest in computationally reconstructing differential equations (DEs) from observational data which may provide additional insight into underlying causative mechanisms.…

机器学习 · 计算机科学 2026-05-12 Mingtao Xia , Xiangting Li , Qijing Shen , Tom Chou

Ordinary differential equations (ODEs) provide a powerful framework for modeling dynamic systems arising in a wide range of scientific domains. However, most existing ODE methods focus on a single system, and do not adequately address the…

统计方法学 · 统计学 2026-04-08 Shuoxun Xu , Zijian Guo , Brooke R. Staveland , Robert T. Knight , Lexin Li

Neural ordinary differential equations (Neural ODEs) is a class of machine learning models that approximate the time derivative of hidden states using a neural network. They are powerful tools for modeling continuous-time dynamical systems,…

机器学习 · 统计学 2024-07-16 Wenbo Hao

The neural Ordinary Differential Equation (ODE) model has shown success in learning complex continuous-time processes from observations on discrete time stamps. In this work, we consider the modeling and forecasting of time series data that…

机器学习 · 统计学 2023-06-05 Yixuan Tan , Liyan Xie , Xiuyuan Cheng