English
Related papers

Related papers: Nonlinear system identification employing automati…

200 papers

We present a novel approach to system identification (SI) using deep learning techniques. Focusing on parametric system identification (PSI), we use a supervised learning approach for estimating the parameters of discrete and…

Systems and Control · Electrical Eng. & Systems 2023-06-21 Connor James Stephens , Emmanuel Blazquez

The empirical success of machine learning models with many more parameters than measurements has generated an interest in the theory of overparameterisation, i.e., underdetermined models. This paradigm has recently been studied in domains…

Differentiable programming, enabled by automatic differentiation (AD), provides a robust framework for gradient-based optimization in computational plasma physics. While optimization is often only used towards design, we demonstrate that it…

Plasma Physics · Physics 2026-03-13 A. S. Joglekar , A. G. R. Thomas , A. L. Milder , K. G. Miller , J. P. Palastro , D. H. Froula

Automatic differentiation, also known as backpropagation, AD, autodiff, or algorithmic differentiation, is a popular technique for computing derivatives of computer programs accurately and efficiently. Sometimes, however, the derivatives…

Numerical Analysis · Mathematics 2023-05-15 Jan Hückelheim , Harshitha Menon , William Moses , Bruce Christianson , Paul Hovland , Laurent Hascoët

Computing more than one eigenvalue for (large sparse) one-parameter polynomial and general nonlinear eigenproblems, as well as for multiparameter linear and nonlinear eigenproblems, is a much harder task than for standard eigenvalue…

Numerical Analysis · Mathematics 2021-10-19 Michiel E. Hochstenbach , Bor Plestenjak

This paper proposes a probabilistic Bayesian formulation for system identification (ID) and estimation of nonseparable Hamiltonian systems using stochastic dynamic models. Nonseparable Hamiltonian systems arise in models from diverse…

Dynamical Systems · Mathematics 2022-09-19 Harsh Sharma , Nicholas Galioto , Alex A. Gorodetsky , Boris Kramer

When considering an unconstrained minimization problem, a standard approach is to solve the optimality system with a Newton method possibly preconditioned by, e.g., nonlinear elimination. In this contribution, we argue that nonlinear…

Numerical Analysis · Mathematics 2024-09-04 Gabriele Ciaremalla , Tommaso Vanzan

We investigate the automatic differentiation of hybrid models, viz. models that may contain delays, logical tests and discontinuities or loops. We consider differentiation with respect to parameters, initial conditions or the time. We…

Systems and Control · Computer Science 2017-06-13 John Masse , Clara Masse , François Ollivier

The Automatic Amortized Resource Analysis (AARA) derives program-execution cost bounds using types. To do so, AARA often makes use of cost-free types, which are critical for the composition of types and cost bounds. However, inferring…

Programming Languages · Computer Science 2025-09-30 David M Kahn , Jan Hoffmann , Thomas Reps , Jessie Grosen

We propose an improved method for estimating partial differential equations and delay partial differential equations from data, using Bayesian optimization and the Bayesian information criterion to automatically find suitable…

Computational Physics · Physics 2026-02-23 Oliver Mai , Tim W. Kroll , Uwe Thiele , Oliver Kamps

We extend the index-aware model-order reduction method to systems of nonlinear differential-algebraic equations with a special nonlinear term f(Ex), where E is a singular matrix. Such nonlinear differential-algebraic equations arise, for…

Numerical Analysis · Mathematics 2020-02-25 Nicodemus Banagaaya , Giuseppe Ali , Sara Grundel , Peter Benner

The Derivative-free nonlinear Kalman Filter is proposed for state estimation and fault diagnosis in distributed parameter systems and particularly in dynamical systems described by partial differential equations of the nonlinear wave type.…

Systems and Control · Computer Science 2013-11-05 Gerasimos G. Rigatos

A sequential quadratic optimization algorithm is proposed for solving smooth nonlinear equality constrained optimization problems in which the objective function is defined by an expectation of a stochastic function. The algorithmic…

Optimization and Control · Mathematics 2023-03-17 Albert S. Berahas , Frank E. Curtis , Michael J. O'Neill , Daniel P. Robinson

In this article a new algorithm for the design of stationary input sequences for system identification is presented. The stationary input signal is generated by optimizing an approximation of a scalar function of the information matrix,…

Optimization and Control · Mathematics 2013-10-18 Patricio E. Valenzuela , Cristian R. Rojas , Håkan Hjalmarsson

We provide a rounding error analysis of a mixed-precision preconditioned Jacobi algorithm, which uses low precision to compute the preconditioner, applies it at high precision (amounting to two matrix-matrix multiplications) and solves the…

Numerical Analysis · Mathematics 2025-12-02 Nicholas J. Higham , Françoise Tisseur , Marcus Webb , Zhengbo Zhou

In this paper, we analyze the finite sample complexity of stochastic system identification using modern tools from machine learning and statistics. An unknown discrete-time linear system evolves over time under Gaussian noise without…

Machine Learning · Computer Science 2019-03-22 Anastasios Tsiamis , George J. Pappas

This paper describes valuation-based systems for representing and solving discrete optimization problems. In valuation-based systems, we represent information in an optimization problem using variables, sample spaces of variables, a set of…

Artificial Intelligence · Computer Science 2013-04-05 Prakash P. Shenoy , Glenn Shafer

In this paper, a dual estimation methodology is developed for both time-varying parameters and states of a nonlinear stochastic system based on the Particle Filtering (PF) scheme. Our developed methodology is based on a concurrent…

Systems and Control · Computer Science 2016-06-29 Najmeh Daroogheh , Nader Meskin , Khashayar Khorasani

Kalman filtering has been traditionally applied in three application areas of estimation, state estimation, parameter estimation (a.k.a. model updating), and dual estimation. However, Kalman filter is often not sufficient when experimenting…

Systems and Control · Electrical Eng. & Systems 2019-11-11 Johnny Condori , Amin Maghareh , Shirley Dyke

A subalgebraic approximation algorithm is proposed to estimate from a set of time series the parameters of the observer representation of a discrete-time polynomial system without inputs which can generate an approximation of the observed…

Optimization and Control · Mathematics 2015-07-09 Jana Němcová , Mihály Petreczky , Jan H. van Schuppen