English
Related papers

Related papers: An Error Analysis Framework for Neural Network Mod…

200 papers

The ability to accurately approximate trajectories of dynamical systems enables their analysis, prediction, and control. Neural network (NN)-based approximations have attracted significant interest due to fast evaluation with good accuracy…

Computational Physics · Physics 2024-01-11 Jochen Stiasny , Spyros Chatzivasileiadis

Learning accurate dynamics models is necessary for optimal, compliant control of robotic systems. Current approaches to white-box modeling using analytic parameterizations, or black-box modeling using neural networks, can suffer from high…

Robotics · Computer Science 2019-03-05 Jayesh K. Gupta , Kunal Menda , Zachary Manchester , Mykel J. Kochenderfer

The development of data-informed predictive models for dynamical systems is of widespread interest in many disciplines. We present a unifying framework for blending mechanistic and machine-learning approaches to identify dynamical systems…

Dynamical Systems · Mathematics 2022-08-18 Matthew E. Levine , Andrew M. Stuart

Training nonlinear parametrizations such as deep neural networks to numerically approximate solutions of partial differential equations is often based on minimizing a loss that includes the residual, which is analytically available in…

Numerical Analysis · Mathematics 2023-06-28 Yuxiao Wen , Eric Vanden-Eijnden , Benjamin Peherstorfer

Dynamic systems have a fundamental relevance in the description of physical phenomena. The search for more accurate and faster numerical integration methods for the resolution of such systems is, therefore, an important topic of research.…

Computational Physics · Physics 2025-10-10 J. Avellar , L. G. S. Duarte , L. A. C. P. da Mota , L. O. Pereira

ML models have errors when used for predictions. The errors are unknown but can be quantified by model uncertainty. When multiple ML models are trained using the same training points, their model uncertainties may be statistically…

Machine Learning · Statistics 2025-09-23 Xiaoping Du

Differential equations are important tools to portray dynamic problems, and are widely used in finance, engineering and biology. Here, multiple dynamic differential models were built innovatively, and discretized with the Runge-Kutta…

Optimization and Control · Mathematics 2023-12-05 Jun Wanga , Xianglei Li , Xianghu Lia

$L^2$ norm error estimates of semi- and full discretisations, using bulk--surface finite elements and Runge--Kutta methods, of wave equations with dynamic boundary conditions are studied. The analysis resides on an abstract formulation and…

Numerical Analysis · Mathematics 2019-06-28 David Hipp , Balázs Kovács

Physics-based and first-principles models pervade the engineering and physical sciences, allowing for the ability to model the dynamics of complex systems with a prescribed accuracy. The approximations used in deriving governing equations…

Machine Learning · Statistics 2023-11-03 Megan R. Ebers , Katherine M. Steele , J. Nathan Kutz

Dynamical systems see widespread use in natural sciences like physics, biology, chemistry, as well as engineering disciplines such as circuit analysis, computational fluid dynamics, and control. For simple systems, the differential…

As a result of the application of a technique of multistep processes stochastic models construction the range of models, implemented as a self-consistent differential equations, was obtained. These are partial differential equations (master…

Computational Physics · Physics 2016-06-22 M. N. Gevorkyan , T. R. Velieva , A. V. Korolkova , D. S. Kulyabov , L. A. Sevastyanov

A significant advance in accelerating neural network training has been the development of normalization methods, permitting the training of deep models both faster and with better accuracy. These advances come with practical challenges: for…

Machine Learning · Computer Science 2019-03-05 Jasmine Collins , Johannes Balle , Jonathon Shlens

Accurate models are essential for design, performance prediction, control, and diagnostics in complex engineering systems. Physics-based models excel during the design phase but often become outdated during system deployment due to changing…

Machine Learning · Computer Science 2025-01-22 Zihan Liu , Prashant N. Kambali , C. Nataraj

This paper develops a framework for the error analysis in nonparametric model fitting of fractional stochastic differential equations based on discrete observations. We identify and quantify the main error sources -- time discretization,…

Probability · Mathematics 2026-05-07 Mahdi Dehshiri , Kerlyns Martinez , Lauri Viitasaari

Differential equations in general and neural ODEs in particular are an essential technique in continuous-time system identification. While many deterministic learning algorithms have been designed based on numerical integration via the…

Machine Learning · Computer Science 2021-10-18 Lenart Treven , Philippe Wenk , Florian Dörfler , Andreas Krause

Neural differential equations have recently emerged as a flexible data-driven/hybrid approach to model time-series data. This work experimentally demonstrates that if the data contains oscillations, then standard fitting of a neural…

Machine Learning · Computer Science 2021-12-20 Evren Mert Turan , Johannes Jäschke

In order to solve continuous-time optimal control problems, direct methods transcribe the infinite-dimensional problem to a nonlinear program (NLP) using numerical integration methods. In cases where the integration error can be manipulated…

Optimization and Control · Mathematics 2025-03-18 Jakob Harzer , Jochem De Schutter , Moritz Diehl

For real-life nonlinear systems, the exact form of nonlinearity is often not known and the known governing equations are often based on certain assumptions and approximations. Such representation introduced model-form error into the system.…

Machine Learning · Statistics 2022-04-20 Shailesh Garg , Souvik Chakraborty , Budhaditya Hazra

In this work, we introduce a machine/deep learning methodology to solve parametric integrals. Besides classical machine learning approaches, we consider a differential learning framework that incorporates derivative information during…

Machine Learning · Computer Science 2025-12-15 Álvaro Leitao , Jonatan Ráfales

Even though deep neural networks have shown tremendous success in countless applications, explaining model behaviour or predictions is an open research problem. In this paper, we address this issue by employing a simple yet effective method…

Computer Vision and Pattern Recognition · Computer Science 2023-01-12 Ryan Benkert , Oluwaseun Joseph Aribido , Ghassan AlRegib