English
Related papers

Related papers: Persistent Excitation is Unnecessary for On-line E…

200 papers

This paper proposes a new family of algorithms for the online optimisation of composite objectives. The algorithms can be interpreted as the combination of the exponentiated gradient and $p$-norm algorithm. Combined with algorithmic ideas…

Optimization and Control · Mathematics 2022-08-09 Weijia Shao , Fikret Sivrikaya , Sahin Albayrak

This paper presents adaptive observers for online state and parameter estimation of a class of nonlinear systems motivated by biophysical models of neuronal circuits. We first present a linear-in-the-parameters design that solves a…

Systems and Control · Electrical Eng. & Systems 2024-02-19 Thiago B. Burghi , Rodolphe Sepulchre

We study online prediction for marginally stable, partially observed linear dynamical systems under nonstochastic disturbances. Our objective is to minimize the cumulative squared prediction loss and compete with the best-in-hindsight…

Machine Learning · Computer Science 2026-05-07 Chih-Fan Pai , Yang Zheng

Time-varying systems are a challenge in many scientific and engineering areas. Usually, estimation of time-varying parameters or signals must be performed online, which calls for the development of responsive online algorithms. In this…

Optimization and Control · Mathematics 2018-09-10 Sophie M. Fosson

In this paper, we consider the problem of estimating parameters in a linear regression model. We propose a sequential learning procedure to determine the sample size for achieving a given small estimation risk, under the widely used…

Methodology · Statistics 2023-11-07 Jun Hu , Yan Zhuang , Shunan Zhao

We propose a new partial-observability model for online learning problems where the learner, besides its own loss, also observes some noisy feedback about the other actions, depending on the underlying structure of the problem. We represent…

Machine Learning · Computer Science 2026-04-16 Tomáš Kocák , Gergely Neu , Michal Valko

In this paper, we study the problem of parameter estimation in a sensor network, where the measurements and updates of some sensors might be arbitrarily manipulated by adversaries. Despite the presence of such misbehaviors, normally…

Systems and Control · Electrical Eng. & Systems 2023-06-06 Jiaqi Yan , Kuo Li , Hideaki Ishii

When data is collected in an adaptive manner, even simple methods like ordinary least squares can exhibit non-normal asymptotic behavior. As an undesirable consequence, hypothesis tests and confidence intervals based on asymptotic normality…

Statistics Theory · Mathematics 2023-03-23 Koulik Khamaru , Yash Deshpande , Tor Lattimore , Lester Mackey , Martin J. Wainwright

We propose to use deep learning to estimate parameters in statistical models when standard likelihood estimation methods are computationally infeasible. We show how to estimate parameters from max-stable processes, where inference is…

Methodology · Statistics 2021-08-02 Amanda Lenzi , Julie Bessac , Johann Rudi , Michael L. Stein

We study the dynamics of an online algorithm for learning a sparse leading eigenvector from samples generated from a spiked covariance model. This algorithm combines the classical Oja's method for online PCA with an element-wise…

Information Theory · Computer Science 2016-09-09 Chuang Wang , Yue M. Lu

We resolve the fundamental problem of online decoding with general $n^{th}$ order ergodic Markov chain models. Specifically, we provide deterministic and randomized algorithms whose performance is close to that of the optimal offline…

Machine Learning · Computer Science 2019-05-31 Vikas K. Garg , Tamar Pichkhadze

In this brief note we recall the little-known fact that, for linear regression equations (LRE) with intervally excited (IE) regressors, standard Least Square (LS) parameter estimators ensure finite convergence time (FCT) of the estimated…

Systems and Control · Electrical Eng. & Systems 2025-06-11 Romeo Ortega , Jose Guadalupe Romero , Stanislav Aranovskiy , Gang Tao

This paper considers a variant of the classical online learning problem with expert predictions. Our model's differences and challenges are due to lacking any direct feedback on the loss each expert incurs at each time step $t$. We propose…

Machine Learning · Computer Science 2020-01-07 Yang Liu , David P. Helmbold

We propose a technique for the design and analysis of adaptation algorithms in dynamical systems. The technique applies both to systems with conventional Lyapunov-stable target dynamics and to ones of which the desired dynamics around the…

Optimization and Control · Mathematics 2007-05-23 Tyukin Ivan , Danil Prokhorov , Cees van Leeuwen

We propose a new efficient online algorithm to learn the parameters governing the purchasing behavior of a utility maximizing buyer, who responds to prices, in a repeated interaction setting. The key feature of our algorithm is that it can…

Machine Learning · Statistics 2018-03-07 Debjyoti Saharoy , Theja Tulabandhula

When large amounts of data continuously arrive in streams, online updating is an effective way to reduce storage and computational burden. The key idea of online updating is that the previous estimators are sequentially updated only using…

Methodology · Statistics 2022-10-12 Tianzhen Wang , Haixiang Zhang , Liuquan Sun

The standard way to estimate the parameters $\Theta_\text{SEIR}$ (e.g., the transmission rate $\beta$) of an SEIR model is to use grid search, where simulations are performed on each set of parameters, and the parameter set leading to the…

Machine Learning · Statistics 2021-06-01 Chun Fan , Yuxian Meng , Xiaofei Sun , Fei Wu , Tianwei Zhang , Jiwei Li

In this paper, we propose an online convex optimization approach with two different levels of adaptivity. On a higher level, our approach is agnostic to the unknown types and curvatures of the online functions, while at a lower level, it…

Machine Learning · Computer Science 2024-04-17 Yu-Hu Yan , Peng Zhao , Zhi-Hua Zhou

The paper investigates the problem of estimating the state of a time-varying system with a linear measurement model; in particular, the paper considers the case where the number of measurements available can be smaller than the number of…

Systems and Control · Electrical Eng. & Systems 2021-04-07 Guido Cavraro , Emiliano Dall'Anese , Joshua Comden , Andrey Bernstein

For the general parametric regression models with covariates contaminated with normal measurement errors, this paper proposes an accelerated version of the classical simulation extrapolation algorithm to estimate the unknown parameters in…

Methodology · Statistics 2021-07-13 Kanwal Ayub , Weixing Song