English
Related papers

Related papers: Asymptotically efficient adaptive identification u…

200 papers

A framework for adaptive and non-adaptive statistical compressive sensing is developed, where a statistical model replaces the standard sparsity model of classical compressive sensing. We propose within this framework optimal task-specific…

Computer Vision and Pattern Recognition · Computer Science 2015-06-03 Julio M. Duarte-Carvajalino , Guoshen Yu , Lawrence Carin , Guillermo Sapiro

We study the problem of fitting parametrized curves to noisy data. Under certain assumptions (known as Cartesian and radial functional models), we derive asymptotic expressions for the bias and the covariance matrix of the parameter…

Computer Vision and Pattern Recognition · Computer Science 2007-05-23 N. Chernov , C. Lesort

System identification is of special interest in science and engineering. This article is concerned with a system identification problem arising in stochastic dynamic systems, where the aim is to estimate the parameters of a system along…

Methodology · Statistics 2022-01-27 Christos Merkatas , Simo Särkkä

Nonlinear friction has long been, and continues to be, one of the major challenges for precision motion control systems. A linear asymptotic observer of the motion state variables with nonlinear friction uses a dedicated state-space…

Systems and Control · Electrical Eng. & Systems 2025-12-22 Michael Ruderman

In this paper, we consider controlling a class of single-input-single-output (SISO) commensurate fractional-order nonlinear systems with parametric uncertainty and external disturbance. Based on backstepping approach, an adaptive controller…

Systems and Control · Electrical Eng. & Systems 2020-05-15 Xinyao Li , Changyun Wen , Ying Zou

We investigate the problem of jointly testing multiple hypotheses and estimating a random parameter of the underlying distribution in a sequential setup. The aim is to jointly infer the true hypothesis and the true parameter while using on…

Signal Processing · Electrical Eng. & Systems 2024-02-02 Dominik Reinhard , Michael Fauß , Abdelhak M. Zoubir

We propose a novel flexible-step model predictive control algorithm for unknown linear time-invariant discrete-time systems. The goal is to asymptotically stabilize the system without relying on a pre-collected dataset that describes its…

Optimization and Control · Mathematics 2025-10-02 Markus Pietschner , Christian Ebenbauer , Bahman Gharesifard , Raik Suttner

In this paper we find asymptotic distribution for some unreliable networks. Using Markov Additive Structure and Adan, Foley, McDonald method, we find the exact asymptotic for the stationary distribution. With the help of MA structure and…

Probability · Mathematics 2011-02-24 Pawel Lorek

Motivated by the widespread use of temporal-difference (TD-) and Q-learning algorithms in reinforcement learning, this paper studies a class of biased stochastic approximation (SA) procedures under a mild "ergodic-like" assumption on the…

Machine Learning · Statistics 2020-09-02 Gang Wang , Bingcong Li , Georgios B. Giannakis

A rich literature exists on constructing non-parametric estimators with optimal asymptotic properties. In addition to asymptotic guarantees, it is often of interest to design estimators with desirable finite-sample properties; such as…

Methodology · Statistics 2025-05-14 Herbert P. Susmann , Yiting Li , Mara A. McAdams-DeMarco , Wenbo Wu , Iván Díaz

Motivated by applications in large-scale and multi-agent reinforcement learning, we study the non-asymptotic performance of stochastic approximation (SA) schemes with delayed updates under Markovian sampling. While the effect of delays has…

We deduce the asymptotic error distribution of the Euler method for the nonlinear filtering problem with continuous-time observations. Previous works by several authors have shown that the error structure of the method is characterized by…

Probability · Mathematics 2018-09-10 Teppei Ogihara , Hideyuki Tanaka

Stochastic approximation (SA) and stochastic gradient descent (SGD) algorithms are work-horses for modern machine learning algorithms. Their constant stepsize variants are preferred in practice due to fast convergence behavior. However,…

Machine Learning · Computer Science 2021-11-12 Zaiwei Chen , Shancong Mou , Siva Theja Maguluri

We study the existence, strong consistency and asymptotic normality of estimators obtained from estimating functions, that are p-dimensional martingale transforms. The problem is motivated by the analysis of evolutionary clustered data,…

Statistics Theory · Mathematics 2020-12-01 Laura Dumitrescu , Ioana Schiopu-Kratina

It is well understood that dynamic instability is among the primary drivers of forecast uncertainty in chaotic, physical systems. Data assimilation techniques have been designed to exploit this phenomena, reducing the effective dimension of…

Optimization and Control · Mathematics 2018-07-27 Colin Grudzien , Alberto Carrassi , Marc Bocquet

This paper is concerned with a partially observed hybrid optimal control problem, where continuous dynamics and discrete events coexist and in particular, the continuous dynamics can be observed while the discrete events, described by a…

Optimization and Control · Mathematics 2023-03-14 Siyu Lv , Jie Xiong , Wen Xu

This work proposes a new method for simultaneous probabilistic identification and control of an observable, fully-actuated mechanical system. Identification is achieved by conditioning stochastic process priors on observations of…

Machine Learning · Computer Science 2014-04-02 Jan-Peter Calliess , Antonis Papachristodoulou , Stephen J. Roberts

We address the problem of sequentially selecting and observing processes from a given set to find the anomalies among them. The decision-maker observes one process at a time and obtains a noisy binary indicator of whether or not the…

Machine Learning · Computer Science 2021-05-14 Geethu Joseph , M. Cenk Gursoy , Pramod K. Varshney

A Markov-switching observation-driven model is a stochastic process $((S_t,Y_t))_{t \in \mathbb{Z}}$ where $(S_t)_{t \in \mathbb{Z}}$ is an unobserved Markov chain on a finite set and $(Y_t)_{t \in \mathbb{Z}}$ is an observed stochastic…

Econometrics · Economics 2025-12-30 Frederik Krabbe

This paper considers the problem of linear time-invariant (LTI) system identification using input/output data. Recent work has provided non-asymptotic results on partially observed LTI system identification using a single trajectory but is…

Optimization and Control · Mathematics 2021-11-23 Yang Zheng , Na Li