English
Related papers

Related papers: Markov Parameter Identification via Chebyshev Appr…

200 papers

We propose a multi input multi output(MIMO) system identification framework by interpreting the MIMO system in terms of a multirate synthesis filter bank. The proposed methodology is discussed in two steps: in the first step the MIMO system…

Information Theory · Computer Science 2015-05-27 Binish Fatimah , Shiv Dutt Joshi

System identification is of special interest in science and engineering. This article is concerned with a system identification problem arising in stochastic dynamic systems, where the aim is to estimate the parameters of a system along…

Methodology · Statistics 2022-01-27 Christos Merkatas , Simo Särkkä

Hidden Markov models have successfully been applied as models of discrete time series in many fields. Often, when applied in practice, the parameters of these models have to be estimated. The currently predominating identification methods,…

Machine Learning · Statistics 2015-07-24 Robert Mattila , Cristian R. Rojas , Bo Wahlberg

This paper presents a Bayesian method for identification of jump Markov linear system parameters. A primary motivation is to provide accurate quantification of parameter uncertainty without relying on asymptotic in data-length arguments. To…

Methodology · Statistics 2021-02-11 Mark P. Balenzuela , Adrian G. Wills , Christopher Renton , Brett Ninness

We study stochastic approximation procedures for approximately solving a $d$-dimensional linear fixed point equation based on observing a trajectory of length $n$ from an ergodic Markov chain. We first exhibit a non-asymptotic bound of the…

Optimization and Control · Mathematics 2024-05-14 Wenlong Mou , Ashwin Pananjady , Martin J. Wainwright , Peter L. Bartlett

The estimation of signal parameters using quantized data is a recurrent problem in electrical engineering. As an example, this includes the estimation of a noisy constant value and of the parameters of a sinewave, that is, its amplitude,…

Signal Processing · Electrical Eng. & Systems 2018-04-30 Antonio Moschitta , Johan Schoukens , Paolo Carbone

We present for the first time an asymptotic convergence analysis of two time-scale stochastic approximation driven by "controlled" Markov noise. In particular, the faster and slower recursions have non-additive controlled Markov noise…

Machine Learning · Computer Science 2020-12-03 Prasenjit Karmakar

Motivated by reduction of computational complexity, this work develops sign-error adaptive filtering algorithms for estimating time-varying system parameters. Different from the previous work on sign-error algorithms, the parameters are…

Optimization and Control · Mathematics 2016-11-17 Araz Hashemi , G. Yin , Le Yi Wang

This paper addresses the problem of identifying linear systems from noisy input-output trajectories. We introduce Thresholded Ho-Kalman, an algorithm that leverages a rank-adaptive procedure to estimate a Hankel-like matrix associated with…

Systems and Control · Electrical Eng. & Systems 2025-10-10 Frédéric Zheng , Yassir Jedra , Alexandre Proutière

This paper proposes a new methodology in linear time-periodic (LTP) system identification. In contrast to previous methods that totally separate dynamics at different tag times for identification, the method focuses on imposing appropriate…

Systems and Control · Electrical Eng. & Systems 2021-11-10 Mingzhou Yin , Andrea Iannelli , Mohammad Khosravi , Anilkumar Parsi , Roy S. Smith

We consider the problem of estimating the state transition matrix of a linear time-invariant (LTI) system, given access to multiple independent trajectories sampled from the system. Several recent papers have conducted a non-asymptotic…

Systems and Control · Electrical Eng. & Systems 2025-05-29 Vinay Kanakeri , Aritra Mitra

We present an efficient finite difference method for the computation of parameter sensitivities that is applicable to a wide class of continuous time Markov chain models. The estimator for the method is constructed by coupling the perturbed…

Numerical Analysis · Mathematics 2012-05-14 David F. Anderson

This paper presents a novel approach for the identification of linear time-periodic (LTP) systems in continuous time. This method is based on harmonic modeling and consists in converting any LTP system into an equivalent LTI system with…

Systems and Control · Electrical Eng. & Systems 2024-04-18 Flora Vernerey , Pierre Riedinger , Andrea Iannelli , Jamal Daafouz

The law of the iterated logarithm (LIL) for the time-homogeneous Markov process with a unique invariant measure characterizes the almost sure maximum possible fluctuation of time averages around the ergodic limit. Whether a numerical…

Numerical Analysis · Mathematics 2025-11-10 Chuchu Chen , Xinyu Chen , Jialin Hong

Markov parameters play a key role in system identification. There exists many algorithms where these parameters are estimated using least-squares in a first, pre-processing, step, including subspace identification and multi-step…

Systems and Control · Electrical Eng. & Systems 2024-05-08 Jiabao He , Cristian R. Rojas , Håkan Hjalmarsson

We study a decentralized variant of stochastic approximation, a data-driven approach for finding the root of an operator under noisy measurements. A network of agents, each with its own operator and data observations, cooperatively find the…

Machine Learning · Computer Science 2022-06-17 Sihan Zeng , Thinh T. Doan , Justin Romberg

We study stochastic approximation algorithms with Markovian noise and constant step-size $\alpha$. We develop a method based on infinitesimal generator comparisons to study the bias of the algorithm, which is the expected difference between…

Machine Learning · Statistics 2024-10-28 Sebastian Allmeier , Nicolas Gast

In this paper, we provide a unified analysis of temporal difference learning algorithms with linear function approximators by exploiting their connections to Markov jump linear systems (MJLS). We tailor the MJLS theory developed in the…

Machine Learning · Computer Science 2019-11-06 Bin Hu , Usman Ahmed Syed

This report addresses the maximum likelihood identification of models for offset-free model predictive control, where linear time-invariant models are augmented with (fictitious) uncontrollable integrating modes, called integrating…

Systems and Control · Electrical Eng. & Systems 2025-09-15 Steven J. Kuntz , James B. Rawlings

Many learning algorithms can be represented as Markov processes, and understanding their generalization error is a central topic in learning theory. For specific continuous-time noisy algorithms, a prominent analysis technique relies on…

Machine Learning · Statistics 2026-03-06 Benjamin Dupuis , Maxime Haddouche , George Deligiannidis , Umut Simsekli