English
Related papers

Related papers: Finite Sample Analysis of Stochastic System Identi…

200 papers

This work deals with the stability analysis of nonlinear sampled-data systems under nonuniform sampling. It establishes novel relationships between the stability property of the exact discrete-time model for a given sequence of (aperiodic)…

Systems and Control · Electrical Eng. & Systems 2022-09-28 Alexis J. Vallarella , Hernan Haimovich

The paper is devoted to synthesis of recurrent algorithms for detection of stochastic signals given in state space. The structure of the algorithms synthesized is shown to be close to that of the Kalman filter. Analysis of one of the…

We use statistical learning methods to construct an adaptive state estimator for nonlinear stochastic systems. Optimal state estimation, in the form of a Kalman filter, requires knowledge of the system's process and measurement uncertainty.…

Machine Learning · Statistics 2014-11-05 Michael Busch , Jeff Moehlis

Stochastic approximation (SA) is an iterative algorithm for finding the fixed point of an operator using noisy samples and widely used in optimization and Reinforcement Learning (RL). The noise in RL exhibits a Markovian structure, and in…

Machine Learning · Computer Science 2025-05-13 Shaan Ul Haque , Sajad Khodadadian , Siva Theja Maguluri

Recovering dynamical equations from observed noisy data is the central challenge of system identification. We develop a statistical mechanics approach to analyze sparse equation discovery algorithms, which typically balance data fit and…

Statistical Mechanics · Physics 2025-09-16 Andrei A. Klishin , Joseph Bakarji , J. Nathan Kutz , Krithika Manohar

We derive a reduced-order state estimator for discrete-time infinite dimensional linear systems with finite dimensional Gaussian input and output noise. This state estimator is the optimal one-step estimate that takes values in a fixed…

Optimization and Control · Mathematics 2014-10-08 Atte Aalto

Identifying a linear system model from data has wide applications in control theory. The existing work on finite sample analysis for linear system identification typically uses data from a single system trajectory under i.i.d random inputs,…

Systems and Control · Electrical Eng. & Systems 2023-09-19 Lei Xin , George Chiu , Shreyas Sundaram

We present a new strategy for filtering high-dimensional multiscale systems characterized by high-order non-Gaussian statistics using observations from leading-order moments. A closed stochastic-statistical modeling framework suitable for…

Mathematical Physics · Physics 2024-07-09 Di Qi , Jian-Guo Liu

In this paper, we focus on activating only a few sensors, among many available, to estimate the state of a stochastic process of interest. This problem is important in applications such as target tracking and simultaneous localization and…

Systems and Control · Computer Science 2016-09-28 Vasileios Tzoumas , Nikolay A. Atanasov , Ali Jadbabaie , George J. Pappas

In this paper, we propose a new model reduction technique for linear stochastic systems that builds upon knowledge filtering and utilizes optimal Kalman filtering techniques. This new technique will reduce the dimension of the noise…

Systems and Control · Electrical Eng. & Systems 2023-09-18 Maico Hendrikus Wilhelmus Engelaar , Licio Romao , Yulong Gao , Mircea Lazar , Alessandro Abate , Sofie Haesaert

In this work, an adaptive predictive control scheme for linear systems with unknown parameters and bounded additive disturbances is proposed. In contrast to related adaptive control approaches that robustly consider the parametric…

Systems and Control · Electrical Eng. & Systems 2025-03-03 Johannes Teutsch , Christopher Narr , Sebastian Kerz , Dirk Wollherr , Marion Leibold

This paper considers approximate smoothing for discretely observed non-linear stochastic differential equations. The problem is tackled by developing methods for linearising stochastic differential equations with respect to an arbitrary…

Methodology · Statistics 2019-01-21 Filip Tronarp , Simo Särkkä

We analyze the statistical performance of identification of stochastic dynamical systems with non-linear measurement sensors. This includes stochastic Wiener systems, with linear dynamics, process noise and measured by a non-linear sensor…

Optimization and Control · Mathematics 2018-05-24 Bo Wahlberg , Lennart Ljung

We consider the problem of adaptive stabilization for discrete-time, multi-dimensional linear systems with bounded control input constraints and unbounded stochastic disturbances, where the parameters of the true system are unknown. To…

Systems and Control · Electrical Eng. & Systems 2023-04-04 Seth Siriya , Jingge Zhu , Dragan Nešić , Ye Pu

In this work, we consider a sensor selection drawn at random by a sampling with replacement policy for a linear time-invariant dynamical system subject to process and measurement noise. We employ the Kalman filter to estimate the state of…

Systems and Control · Electrical Eng. & Systems 2023-03-15 Christopher I. Calle , Shaunak D. Bopardikar

As saturated output observations are ubiquitous in practice, identifying stochastic systems with such nonlinear observations is a fundamental problem across various fields. This paper investigates the asymptotically efficient identification…

Machine Learning · Computer Science 2025-04-07 Lantian Zhang , Lei Guo

We consider the dynamic linear regression problem, where the predictor vector may vary with time. This problem can be modeled as a linear dynamical system, with non-constant observation operator, where the parameters that need to be learned…

Machine Learning · Computer Science 2022-10-13 Mark Kozdoba , Edward Moroshko , Shie Mannor , Koby Crammer

This paper tackles the challenge of parameter calibration in stochastic models, particularly in scenarios where the likelihood function is unavailable in an analytical form. We introduce a gradient-based simulated parameter estimation…

Machine Learning · Statistics 2025-03-25 Zehao Li , Yijie Peng

This paper introduces new techniques for using convex optimization to fit input-output data to a class of stable nonlinear dynamical models. We present an algorithm that guarantees consistent estimates of models in this class when a small…

Optimization and Control · Mathematics 2013-03-19 Mark M. Tobenkin , Ian R. Manchester , Alexandre Megretski

In this paper, we present an optimal filter for linear time-varying continuous-time stochastic systems that simultaneously estimates the states and unknown inputs in an unbiased minimum-variance sense. We first show that the unknown inputs…

Optimization and Control · Mathematics 2016-11-17 Sze Zheng Yong , Minghui Zhu , Emilio Frazzoli