English
Related papers

Related papers: Towards Foundation Inference Models that Learn ODE…

200 papers

Cross-domain few-shot segmentation (CD-FSS) aims to segment unseen categories with very limited samples while alleviating the negative effects of domain shift between the source and target domains. At present, existing CD-FSS studies…

Computer Vision and Pattern Recognition · Computer Science 2026-05-15 Huan Ni , Qingshan Liu , Xiaonan Niu , Danfeng Hong , Lingli Zhao , Haiyan Guan

Despite the rapid advancements in Artificial Intelligence (AI), Stochastic Differential Equations (SDEs) remain the gold-standard formalism for modeling systems under uncertainty. However, applying SDEs in practice is fraught with…

Machine Learning · Computer Science 2026-04-06 Stefan Hackmann

Neural ordinary differential equations (NODE) have been recently proposed as a promising approach for nonlinear system identification tasks. In this work, we systematically compare their predictive performance with current state-of-the-art…

Machine Learning · Computer Science 2022-03-16 Aowabin Rahman , Ján Drgoňa , Aaron Tuor , Jan Strube

Neural differential equations are a promising new member in the neural network family. They show the potential of differential equations for time series data analysis. In this paper, the strength of the ordinary differential equation (ODE)…

Machine Learning · Computer Science 2020-05-21 Mansura Habiba , Barak A. Pearlmutter

Time series with non-uniform intervals occur in many applications, and are difficult to model using standard recurrent neural networks (RNNs). We generalize RNNs to have continuous-time hidden dynamics defined by ordinary differential…

Machine Learning · Computer Science 2019-07-10 Yulia Rubanova , Ricky T. Q. Chen , David Duvenaud

Probabilistic forecasting of irregularly sampled time series is crucial in domains such as healthcare and finance, yet it remains a formidable challenge. Existing Neural Controlled Differential Equation (Neural CDE) approaches, while…

Machine Learning · Computer Science 2026-02-13 Ilya Kuleshov , Alexander Marusov , Alexey Zaytsev

A concept of using Neural Ordinary Differential Equations(NODE) for Transfer Learning has been introduced. In this paper we use the EfficientNets to explore transfer learning on CIFAR-10 dataset. We use NODE for fine-tuning our model. Using…

Machine Learning · Computer Science 2020-01-22 Rajath S , Sumukh Aithal K , Natarajan Subramanyam

Motivated by the recent success of time-series foundation models for zero-shot forecasting, we present a methodology for $\textit{in-context fine-tuning}$ of a time-series foundation model. In particular, we design a pretrained foundation…

Machine Learning · Computer Science 2024-11-01 Abhimanyu Das , Matthew Faw , Rajat Sen , Yichen Zhou

Diffusion models have recently emerged as a potent tool in generative modeling. However, their inherent iterative nature often results in sluggish image generation due to the requirement for multiple model evaluations. Recent progress has…

Machine Learning · Computer Science 2024-11-14 Joshua Tian Jin Tee , Kang Zhang , Hee Suk Yoon , Dhananjaya Nagaraja Gowda , Chanwoo Kim , Chang D. Yoo

Neural Ordinary Differential Equations (Neural ODEs) construct the continuous dynamics of hidden units using ordinary differential equations specified by a neural network, demonstrating promising results on many tasks. However, Neural ODEs…

Computer Vision and Pattern Recognition · Computer Science 2024-01-11 Haoyu Chu , Shikui Wei , Qiming Lu , Yao Zhao

Forecasting time series and time-dependent data is a common problem in many applications. One typical example is solving ordinary differential equation (ODE) systems $\dot{x}=F(x)$. Oftentimes the right hand side function $F(x)$ is not…

Computational Physics · Physics 2019-10-14 Artem Chashchin , Mikhail Botchev , Ivan Oseledets , George Ovchinnikov

Score-based diffusion models learn to reverse a stochastic differential equation that maps data to noise. However, for complex tasks, numerical error can compound and result in highly unnatural samples. Previous work mitigates this drift…

Machine Learning · Statistics 2023-06-12 Aaron Lou , Stefano Ermon

We propose a new method to ensure neural ordinary differential equations (ODEs) satisfy output specifications by using invariance set propagation. Our approach uses a class of control barrier functions to transform output specifications…

Machine Learning · Computer Science 2023-06-01 Wei Xiao , Tsun-Hsuan Wang , Ramin Hasani , Mathias Lechner , Yutong Ban , Chuang Gan , Daniela Rus

Constructing a robust model that can effectively generalize to test samples under distribution shifts remains a significant challenge in the field of medical imaging. The foundational models for vision and language, pre-trained on extensive…

Neural ODEs (NODEs) are continuous-time neural networks (NNs) that can process data without the limitation of time intervals. They have advantages in learning and understanding the evolution of complex real dynamics. Many previous works…

Machine Learning · Computer Science 2024-11-05 Wenjie Mei , Dongzhe Zheng , Shihua Li

Data-driven modeling of constrained multibody dynamics remains challenged by (i) the training cost of Neural ODEs, which typically require backpropagation through an ODE solver, and (ii) error accumulation in rollout predictions. We…

Machine Learning · Computer Science 2026-03-23 Hongyu Wang , Jingquan Wang , Dan Negrut

The MRI-derived brain network serves as a pivotal instrument in elucidating both the structural and functional aspects of the brain, encompassing the ramifications of diseases and developmental processes. However, prevailing methodologies,…

Machine Learning · Computer Science 2024-05-24 Haoteng Tang , Guodong Liu , Siyuan Dai , Kai Ye , Kun Zhao , Wenlu Wang , Carl Yang , Lifang He , Alex Leow , Paul Thompson , Heng Huang , Liang Zhan

We present a novel approach that redefines the traditional interpretation of explicit and implicit discretization methods for solving a general class of advection-diffusion equations (ADEs) featuring nonlinear advection, diffusion…

Analysis of PDEs · Mathematics 2025-06-10 Amin Jafarimoghaddam , Manuel Soler , Irene Ortiz

We introduce a differentiable framework for zero-shot adaptive control over parametric families of nonlinear dynamical systems. Our approach integrates a function encoder-based neural ODE (FE-NODE) for modeling system dynamics with a…

Systems and Control · Electrical Eng. & Systems 2026-04-16 Hassan Iqbal , Xingjian Li , Tyler Ingebrand , Adam Thorpe , Krishna Kumar , Ufuk Topcu , Ján Drgoňa

We present a framework that leverages the Discrete Empirical Interpolation Method (DEIM) for interpretable deep learning and dynamical system analysis. Although DEIM efficiently approximates nonlinear terms in projection-based reduced-order…

Machine Learning · Computer Science 2026-04-03 Hojin Kim , Romit Maulik