English
Related papers

Related papers: Explainable Tensorized Neural Ordinary Differentia…

200 papers

Neural ordinary differential equations (neural ODE) are powerful continuous-time machine learning models for depicting the behavior of complex dynamical systems, but their verification remains challenging due to limited reachability…

Systems and Control · Electrical Eng. & Systems 2026-03-09 Abdelrahman Sayed Sayed , Pierre-Jean Meyer , Mohamed Ghazel

Lasso problems arise in many areas, including signal processing, machine learning, and control, and are closely connected to sparse coding mechanisms observed in neuroscience. A continuous-time ordinary differential equation (ODE)…

Optimization and Control · Mathematics 2026-04-03 Liang Wu , Yunhong Che , Wallace Gian Yion Tan , Efstathios Iliakis , Richard D. Braatz , Ján Drgoňa

In data-driven modeling of spatiotemporal phenomena careful consideration often needs to be made in capturing the dynamics of the high wavenumbers. This problem becomes especially challenging when the system of interest exhibits shocks or…

Machine Learning · Computer Science 2022-12-28 Alec J. Linot , Joshua W. Burby , Qi Tang , Prasanna Balaprakash , Michael D. Graham , Romit Maulik

Neural ODEs (NODEs) are continuous-time neural networks (NNs) that can process data without the limitation of time intervals. They have advantages in learning and understanding the evolution of complex real dynamics. Many previous works…

Machine Learning · Computer Science 2024-11-05 Wenjie Mei , Dongzhe Zheng , Shihua Li

Since the advent of the ``Neural Ordinary Differential Equation (Neural ODE)'' paper, learning ODEs with deep learning has been applied to system identification, time-series forecasting, and related areas. Exploiting the diffeomorphic…

Machine Learning · Statistics 2025-08-27 Yuji Okamoto , Tomoya Takeuchi , Yusuke Sakemi

Spurred by tremendous success in pattern matching and prediction tasks, researchers increasingly resort to machine learning to aid original scientific discovery. Given large amounts of observational data about a system, can we uncover the…

Machine Learning · Computer Science 2025-01-31 Hananeh Aliee , Fabian J. Theis , Niki Kilbertus

Neural ordinary differential equations describe how values change in time. This is the reason why they gained importance in modeling sequential data, especially when the observations are made at irregular intervals. In this paper we propose…

Machine Learning · Computer Science 2021-10-26 Marin Biloš , Johanna Sommer , Syama Sundar Rangapuram , Tim Januschowski , Stephan Günnemann

Forecasting time series and time-dependent data is a common problem in many applications. One typical example is solving ordinary differential equation (ODE) systems $\dot{x}=F(x)$. Oftentimes the right hand side function $F(x)$ is not…

Computational Physics · Physics 2019-10-14 Artem Chashchin , Mikhail Botchev , Ivan Oseledets , George Ovchinnikov

Revealing the continuous dynamics on the networks is essential for understanding, predicting, and even controlling complex systems, but it is hard to learn and model the continuous network dynamics because of complex and unknown governing…

Machine Learning · Computer Science 2022-11-22 Bo Liang , Lin Wang , Xiaofan Wang

Modeling neural population dynamics is crucial for foundational neuroscientific research and various clinical applications. Conventional latent variable methods typically model continuous brain dynamics through discretizing time with…

In this paper, we propose and analyze ETD-Multistep-Pad\'{e} (ETD-MS-Pad\'{e}) and ETD Implicit Multistep-Pad\'{e} (ETD-IMS-Pad\'{e}) for semilinear parabolic delay differential equations with smooth solutions. In our previous work [15], we…

Numerical Analysis · Mathematics 2025-07-02 Haishen Dai , Huan Lei

There has been a significant focus on modelling emotion ambiguity in recent years, with advancements made in representing emotions as distributions to capture ambiguity. However, there has been comparatively less effort devoted to the…

Artificial Intelligence · Computer Science 2024-08-01 Jingyao Wu , Ting Dang , Vidhyasaharan Sethu , Eliathamby Ambikairajah

Early-exit neural networks (EENNs) enable adaptive and efficient inference by providing predictions at multiple stages during the forward pass. In safety-critical applications, these predictions are meaningful only when accompanied by…

Machine Learning · Computer Science 2024-06-04 Metod Jazbec , Patrick Forré , Stephan Mandt , Dan Zhang , Eric Nalisnick

Stochastic differential equations (SDEs) are used to describe a wide variety of complex stochastic dynamical systems. Learning the hidden physics within SDEs is crucial for unraveling fundamental understanding of these systems' stochastic…

Machine Learning · Computer Science 2022-07-26 Jared O'Leary , Joel A. Paulson , Ali Mesbah

In this paper, we propose to model the video dynamics by learning the trajectory of independently inverted latent codes from GANs. The entire sequence is seen as discrete-time observations of a continuous trajectory of the initial latent…

Computer Vision and Pattern Recognition · Computer Science 2023-04-25 Weihao Xia , Yujiu Yang , Jing-Hao Xue

Test time adaptation (TTA) has emerged as a promising solution to adapt pre-trained models to new, unseen data distributions using unlabeled target domain data. However, most TTA methods are designed for independent data, often overlooking…

Machine Learning · Computer Science 2026-01-21 Ting Dang , Soumyajit Chatterjee , Hong Jia , Yu Wu , Flora Salim , Fahim Kawsar

Training Neural Ordinary Differential Equations (ODEs) is often computationally expensive. Indeed, computing the forward pass of such models involves solving an ODE which can become arbitrarily complex during training. Recent works have…

Machine Learning · Computer Science 2020-11-03 Arnab Ghosh , Harkirat Singh Behl , Emilien Dupont , Philip H. S. Torr , Vinay Namboodiri

Traditional deep neural networks (NNs) have significantly contributed to the state-of-the-art performance in the task of classification under various application domains. However, NNs have not considered inherent uncertainty in data…

Machine Learning · Computer Science 2021-05-05 Yibo Hu , Yuzhe Ou , Xujiang Zhao , Jin-Hee Cho , Feng Chen

Recurrent Neural Networks (RNNs) can learn to predict Signal Temporal Logic (STL) verdicts online from partial trajectories, but deploying them as runtime monitors in safety-critical systems demands more than predictive accuracy. Standard…

Machine Learning · Computer Science 2026-05-26 Sai Sandeep Damera , Ryan Matheu , Aniruddh G. Puranic , John S. Baras , Calin Belta

We derive and solve an ``Equation of Motion'' (EoM) for deep neural networks (DNNs), a differential equation that precisely describes the discrete learning dynamics of DNNs. Differential equations are continuous but have played a prominent…

Machine Learning · Computer Science 2023-02-28 Taiki Miyagawa