English
Related papers

Related papers: Efficient Neural Controlled Differential Equations…

200 papers

Neural Stochastic Differential Equations (NSDEs) model the drift and diffusion functions of a stochastic process as neural networks. While NSDEs are known to make accurate predictions, their uncertainty quantification properties have been…

Machine Learning · Computer Science 2022-09-13 Andreas Look , Melih Kandemir , Barbara Rakitsch , Jan Peters

Solving partial differential equations (PDEs) by numerical methods meet computational cost challenge for getting the accurate solution since fine grids and small time steps are required. Machine learning can accelerate this process, but…

Numerical Analysis · Mathematics 2025-01-28 Qi Wang , Yuan Mi , Haoyun Wang , Yi Zhang , Ruizhi Chengze , Hongsheng Liu , Ji-Rong Wen , Hao Sun

In this paper, we present a Model Predictive Control (MPC) framework based on path velocity decomposition paradigm for autonomous driving. The optimization underlying the MPC has a two layer structure wherein first, an appropriate path is…

Robotics · Computer Science 2018-03-09 Mithun Babu , Yash Oza , Arun Kumar Singh , K. Madhava Krishna , Shanti Medasani

(Partial) differential equations (PDEs) are fundamental tools for describing natural phenomena, making their solution crucial in science and engineering. While traditional methods, such as the finite element method, provide reliable…

Machine Learning · Computer Science 2025-03-11 Viggo Moro , Luiz F. O. Chamon

Deep sequence models have achieved notable success in time-series analysis, such as interpolation and forecasting. Recent advances move beyond discrete-time architectures like Recurrent Neural Networks (RNNs) toward continuous-time…

Machine Learning · Computer Science 2025-08-05 Haoran Li , Muhao Guo , Yang Weng , Hanghang Tong

Neural CDEs provide a natural way to process the temporal evolution of irregular time series. The number of function evaluations (NFE) is these systems' natural analog of depth (the number of layers in traditional neural networks). It is…

Machine Learning · Computer Science 2026-01-27 Ilya Kuleshov , Evgenia Romanenkova , Vladislav Zhuzhel , Galina Boeva , Evgeni Vorsin , Alexey Zaytsev

We introduce a novel approach to video modeling that leverages controlled differential equations (CDEs) to address key challenges in video tasks, notably video interpolation and mask propagation. We apply CDEs at varying resolutions leading…

Computer Vision and Pattern Recognition · Computer Science 2023-11-10 Johnathan Chiu , Samuel Duffield , Max Hunter-Gordon , Kaelan Donatella , Max Aifer , Andi Gu

As a crucial technique for developing a smart city, traffic forecasting has become a popular research focus in academic and industrial communities for decades. This task is highly challenging due to complex and dynamic spatial-temporal…

Machine Learning · Computer Science 2024-01-29 Jiajia Wu , Ling Chen

This paper presents a novel deep learning-based approach named RealDiffFusionNet incorporating Neural Controlled Differential Equations (Neural CDE) - time series models that are robust in handling irregularly sampled data - and multi-head…

Machine Learning · Computer Science 2025-01-07 Aashish Cheruvu , Nathaniel Rigoni

Partial differential equations (PDEs) play a crucial role in studying a vast number of problems in science and engineering. Numerically solving nonlinear and/or high-dimensional PDEs is often a challenging task. Inspired by the traditional…

Numerical Analysis · Mathematics 2022-01-11 Yihao Hu , Tong Zhao , Shixin Xu , Zhiliang Xu , Lizhen Lin

Neural ordinary differential equations are an attractive option for modelling temporal dynamics. However, a fundamental issue is that the solution to an ordinary differential equation is determined by its initial condition, and there is no…

Machine Learning · Computer Science 2020-11-06 Patrick Kidger , James Morrill , James Foster , Terry Lyons

Nonlinear model predictive control (NMPC) is a popular strategy for solving motion planning problems, including obstacle avoidance constraints, in autonomous driving applications. Non-smooth obstacle shapes, such as rectangles, introduce…

Systems and Control · Electrical Eng. & Systems 2024-03-05 Rudolf Reiter , Katrin Baumgärtner , Rien Quirynen , Moritz Diehl

Numerical simulation is dominant in solving partial difference equations (PDEs), but balancing fine-grained grids with low computational costs is challenging. Recently, solving PDEs with neural networks (NNs) has gained interest, yet…

Computational Physics · Physics 2023-12-13 Wei Suo , Weiwei Zhang

We propose a PDE-based accelerated gradient algorithm for optimal feedback controls of McKean-Vlasov dynamics that involve mean-field interactions both in the state and action. The method exploits a forward-backward splitting approach and…

Optimization and Control · Mathematics 2024-05-03 Christoph Reisinger , Wolfgang Stockinger , Yufei Zhang

Neural Ordinary Differential Equations (NODEs) have proven to be a powerful modeling tool for approximating (interpolation) and forecasting (extrapolation) irregularly sampled time series data. However, their performance degrades…

Machine Learning · Computer Science 2020-04-29 Hammad A. Ayyubi , Yi Yao , Ajay Divakaran

We propose a new approach to learning the subgrid-scale model when simulating partial differential equations (PDEs) solved by the method of lines and their representation in chaotic ordinary differential equations, based on neural ordinary…

Numerical Analysis · Mathematics 2023-04-14 Shinhoo Kang , Emil M. Constantinescu

Stochastic differential equations (SDEs) and stochastic partial differential equations (SPDEs) are fundamental for modeling stochastic dynamics across the natural sciences and modern machine learning. Learning their solution operators with…

Machine Learning · Computer Science 2026-01-30 Dai Shi , Lequan Lin , Andi Han , Luke Thompson , José Miguel Hernández-Lobato , Zhiyong Wang , Junbin Gao

Inspired by the ubiquitous use of differential equations to model continuous dynamics across diverse scientific and engineering domains, we propose a novel and intuitive approach to continuous sequence modeling. Our method interprets…

Machine Learning · Computer Science 2025-02-03 Macheng Shen , Chen Cheng

Scientific Machine Learning (SciML) is concerned with the development of learned emulators of physical systems governed by partial differential equations (PDE). In application domains such as weather forecasting, molecular dynamics, and…

Machine Learning · Computer Science 2023-07-24 Makoto Takamoto , Francesco Alesiani , Mathias Niepert

Continuous-depth neural networks, such as the Neural Ordinary Differential Equations (ODEs), have aroused a great deal of interest from the communities of machine learning and data science in recent years, which bridge the connection…

Machine Learning · Computer Science 2022-01-05 Qunxi Zhu , Yifei Shen , Dongsheng Li , Wei Lin