English
Related papers

Related papers: Picard Iteration for Parameter Estimation in Nonli…

200 papers

We consider the problem of asymptotic reconstruction of the state and parameter values in systems of ordinary differential equations. A solution to this problem is proposed for a class of systems of which the unknowns are allowed to be…

Optimization and Control · Mathematics 2015-03-13 Ivan Y. Tyukin , Erik Steur , Henk Nijmeijer , Cees van Leeuwen

Projection-based reduced order models are effective at approximating parameter-dependent differential equations that are parametrically separable. When parametric separability is not satisfied, which occurs in both linear and nonlinear…

Numerical Analysis · Mathematics 2021-10-22 Peter Sentz , Kristian Beckwith , Eric C. Cyr , Luke N. Olson , Ravi Patel

Implicit sampling is a weighted sampling method that is used in data assimilation, where one sequentially updates estimates of the state of a stochastic model based on a stream of noisy or incomplete data. Here we describe how to use…

Numerical Analysis · Mathematics 2016-01-20 Matthias Morzfeld , Xuemin Tu , Jon Wilkening , Alexandre J. Chorin

Latent variable models are powerful tools for modeling complex phenomena involving in particular partially observed data, unobserved variables or underlying complex unknown structures. Inference is often difficult due to the latent…

Statistics Theory · Mathematics 2023-06-23 Charlotte Baey , Maud Delattre , Estelle Kuhn , Jean-Benoist Leger , Sarah Lemler

We study the problem of optimizing nonlinear objective functions over matroids presented by oracles or explicitly. Such functions can be interpreted as the balancing of multi-criteria optimization. We provide a combinatorial polynomial time…

Combinatorics · Mathematics 2008-07-24 Yael Berstein , Jon Lee , Hugo Maruri-Aguilar , Shmuel Onn , Eva Riccomagno , Robert Weismantel , Henry Wynn

We present a new approach for estimating parameters in rational ODE models from given (measured) time series data. In typical existing approaches, an initial guess for the parameter values is made from a given search interval. Then, in a…

Mathematical Software · Computer Science 2023-12-19 Oren Bassik , Yosef Berman , Soo Go , Hoon Hong , Ilia Ilmer , Alexey Ovchinnikov , Chris Rackauckas , Pedro Soto , Chee Yap

Ordinary Differential Equations are a simple but powerful framework for modeling complex systems. Parameter estimation from times series can be done by Nonlinear Least Squares (or other classical approaches), but this can give…

Methodology · Statistics 2014-10-29 Quentin Clairon , Nicolas Brunel

We propose to use deep learning to estimate parameters in statistical models when standard likelihood estimation methods are computationally infeasible. We show how to estimate parameters from max-stable processes, where inference is…

Methodology · Statistics 2021-08-02 Amanda Lenzi , Julie Bessac , Johann Rudi , Michael L. Stein

Nonlinear optimization methods are typically iterative and make use of gradient information to determine a direction of improvement and function information to effectively check for progress. When this information is corrupted by noise,…

Optimization and Control · Mathematics 2025-10-21 Albert S. Berahas , Michael J. O'Neill , Clément W. Royer

This paper presents a new parameter estimation algorithm for the adaptive control of a class of time-varying plants. The main feature of this algorithm is a matrix of time-varying learning rates, which enables parameter estimation error…

Optimization and Control · Mathematics 2021-11-18 Joseph E. Gaudio , Anuradha M. Annaswamy , Eugene Lavretsky , Michael A. Bolender

We apply the iterative nonlinear programming method, previously proposed in our earlier work, to optimize Schur test functions and thereby provide refined upper bounds for the norms of integral operators. As an illustration, we derive such…

Optimization and Control · Mathematics 2025-10-08 Mikhail Anikushin , Andrey Romanov

This paper studies sparse covariance operator estimation for nonstationary processes with sharply varying marginal variance and small correlation lengthscale. We introduce a covariance operator estimator that adaptively thresholds the…

Statistics Theory · Mathematics 2025-06-23 Omar Al-Ghattas , Daniel Sanz-Alonso

The article considers the problem of identifying the variable frequency of a sinusoidal signal. To obtain a regression model of the signal, an iterative differentiation of the original analytical expression is performed, and the swapping…

Systems and Control · Electrical Eng. & Systems 2021-09-21 S. I. Nizovtsev , S. V. Shavetov , A. A. Pyrkin

This paper discusses the solution of nonlinear integral equations with noisy integral kernels as they appear in nonparametric instrumental regression. We propose a regularized Newton-type iteration and establish convergence and convergence…

Numerical Analysis · Mathematics 2015-04-01 Fabian Dunker , Jean-Pierre Florens , Thorsten Hohage , Jan Johannes , Enno Mammen

Nonlinear dynamical systems are ubiquitous in nature and they are hard to forecast. Not only they may be sensitive to small perturbations in their initial conditions, but they are often composed of processes acting at multiple scales.…

Chaotic Dynamics · Physics 2025-10-06 Chenyu Dong , Davide Faranda , Adriano Gualandi , Valerio Lucarini , Gianmarco Mengaldo

This paper introduces an iterative algorithm for training nonparametric additive models that enjoys favorable memory storage and computational requirements. The algorithm can be viewed as the functional counterpart of stochastic gradient…

Machine Learning · Statistics 2026-01-01 Xin Chen , Jason M. Klusowski

A novel approach to the problem of partial state estimation of nonlinear systems is proposed. The main idea is to translate the state estimation problem into one of estimation of constant, unknown parameters related to the systems initial…

Systems and Control · Computer Science 2016-04-08 Ortega Romeo , Bobtsov Alexey , Pyrkin Anton , Aranovskiy Stanislav

Variance parameter estimation in linear mixed models is a challenge for many classical nonlinear optimization algorithms due to the positive-definiteness constraint of the random effects covariance matrix. We take a completely novel view on…

Machine Learning · Statistics 2022-12-20 Lena Sembach , Jan Pablo Burgard , Volker H. Schulz

Ordinary differential equations are widely-used in the field of systems biology and chemical engineering to model chemical reaction networks. Numerous techniques have been developed to estimate parameters like rate constants, initial…

Molecular Networks · Quantitative Biology 2012-07-06 Daniel Kaschek , Jens Timmer

Nonlinear optimisation techniques are commonly employed to minimise complex cost functions, with their effectiveness determined largely by the structure of the underlying error landscape. These methods require initial parameter values, and…

Signal Processing · Electrical Eng. & Systems 2026-03-19 Tilo Strutz