English
Related papers

Related papers: Multiple shooting for training neural differential…

200 papers

Recent advances in deep learning makes solving parabolic partial differential equations (PDEs) in high dimensional spaces possible via forward-backward stochastic differential equation (FBSDE) formulations. The implementation of most…

Numerical Analysis · Mathematics 2025-06-19 Wenjun Xu , Wenzhong Zhang

This paper presents a novel shooting method for solving two-point boundary value problems for second order ordinary differential equations. The method works as follows: first, a guess for the initial condition is made and an integration of…

Numerical Analysis · Mathematics 2017-02-08 Stefan M. Filipov , Ivan D. Gospodinov , Istvan Farago

Neural networks, especially the recent proposed neural operator models, are increasingly being used to find the solution operator of differential equations. Compared to traditional numerical solvers, they are much faster and more efficient…

Machine Learning · Computer Science 2022-12-09 Ye Li , Yiwen Pang , Bin Shan

While trade-offs between modeling effort and model accuracy remain a major concern with system identification, resorting to data-driven methods often leads to a complete disregard for physical plausibility. To address this issue, we propose…

Systems and Control · Electrical Eng. & Systems 2022-08-23 Oliver Schön , Ricarda-Samantha Götte , Julia Timmermann

Differential equations parameterized by neural networks become expensive to solve numerically as training progresses. We propose a remedy that encourages learned dynamics to be easier to solve. Specifically, we introduce a differentiable…

Machine Learning · Computer Science 2020-10-26 Jacob Kelly , Jesse Bettencourt , Matthew James Johnson , David Duvenaud

Differential equations are used in a wide variety of disciplines, describing the complex behavior of the physical world. Analytic solutions to these equations are often difficult to solve for, limiting our current ability to solve complex…

Machine Learning · Computer Science 2022-08-09 Ethan Mills , Alexey Pozdnyakov

Currently, there are no learning-free or neural techniques for real-time recalibration of infrared multi-camera systems. In this paper, we address the challenge of real-time, highly-accurate calibration of multi-camera infrared systems, a…

Computer Vision and Pattern Recognition · Computer Science 2024-10-21 Benyamin Mehmandar , Reza Talakoob , Charalambos Poullis

Neural Posterior Estimation methods for simulation-based inference can be ill-suited for dealing with posterior distributions obtained by conditioning on multiple observations, as they tend to require a large number of simulator calls to…

Machine Learning · Computer Science 2023-07-11 Tomas Geffner , George Papamakarios , Andriy Mnih

The determination of a differential equation underlying a measured time series is a frequently arising task in nonlinear time series analysis. In the validation of a proposed model one often faces the dilemma that it is hard to decide…

Chaotic Dynamics · Physics 2009-10-31 J. Timmer , H. Rust , W. Horbelt , H. U. Voss

By developing new efficient techniques and using an appropriate fixed point theorem, we derive several new sufficient conditions for the pseudo almost periodic solutions with double measure for some system of differential equations with…

Analysis of PDEs · Mathematics 2020-03-11 Mohsen Miraoui , Dušan D. Repovš

The existing Neural ODE formulation relies on an explicit knowledge of the termination time. We extend Neural ODEs to implicitly defined termination criteria modeled by neural event functions, which can be chained together and…

Machine Learning · Computer Science 2021-10-28 Ricky T. Q. Chen , Brandon Amos , Maximilian Nickel

Continuous-depth neural networks can be viewed as deep limits of discrete neural networks whose dynamics resemble a discretization of an ordinary differential equation (ODE). Although important steps have been taken to realize the…

Neural and Evolutionary Computing · Computer Science 2020-12-09 François-Xavier Vialard , Roland Kwitt , Susan Wei , Marc Niethammer

International comparisons of hierarchical time series data sets based on survey data, such as annual country-level estimates of school enrollment rates, can suffer from large amounts of missing data due to differing coverage of surveys…

Methodology · Statistics 2025-03-31 Daphne H. Liu , Adrian E. Raftery

We are concerned with the numerical solution of a class integro-differential equations, known as Neural Field Equations, which describe the large-scale dynamics of spatially structured networks of neurons. These equations have many…

Numerical Analysis · Mathematics 2015-09-01 Pedro M. Lima , Evelyn Buckwar

This paper presents a novel parallel-in-time algorithm able to compute time-periodic solutions of problems where the period is not given. Exploiting the idea of the multiple shooting method, the proposed approach calculates the initial…

Numerical Analysis · Mathematics 2020-07-08 Iryna Kulchytska-Ruchka , Sebastian Schöps

In this paper, we consider the linear programming (LP) formulation for deep reinforcement learning. The number of the constraints depends on the size of state and action spaces, which makes the problem intractable in large or continuous…

Optimization and Control · Mathematics 2021-05-21 Yongfeng Li , Mingming Zhao , Weijie Chen , Zaiwen Wen

We introduce a novel continual learning method based on multifidelity deep neural networks. This method learns the correlation between the output of previously trained models and the desired output of the model on the current training…

Numerical Analysis · Mathematics 2024-07-01 Amanda Howard , Yucheng Fu , Panos Stinis

Neuronal models based on the Hodgkin-Huxley equation form a fundamental framework in the field of computational neuroscience. While the neuronal state is often modeled deterministically, experimental recordings show stochastic fluctuations,…

Neurons and Cognition · Quantitative Biology 2018-10-26 Pavol Bauer , Stefan Engblom , Sanja Mikulovic , Aleksandar Senek

This paper presents a novel deep learning framework for solving multiple optimal stopping problems in high dimensions. While deep learning has recently shown promise for single stopping problems, the multiple exercise case involves complex…

Optimization and Control · Mathematics 2025-12-30 Mathieu Laurière , Mehdi Talbi

This article focuses on making discrete-time Adaptive Iterative Learning Control (ILC) more effective using multiple estimation models. Existing strategies use the tracking error to adjust the parametric estimates. Our strategy uses the…

Systems and Control · Electrical Eng. & Systems 2024-06-14 Ram Padmanabhan , Rajini Makam , Koshy George