English
Related papers

Related papers: Finite Time Analysis of Vector Autoregressive Mode…

200 papers

In this paper, we study nonparametric models allowing for locally stationary regressors and a regression function that changes smoothly over time. These models are a natural extension of time series models with time-varying coefficients. We…

Statistics Theory · Mathematics 2013-02-19 Michael Vogt

A fundamental problem in machine learning is understanding the effect of early stopping on the parameters obtained and the generalization capabilities of the model. Even for linear models, the effect is not fully understood for arbitrary…

Machine Learning · Computer Science 2024-06-10 Rishi Sonthalia , Jackie Lok , Elizaveta Rebrova

Causal inference in multivariate time series is challenging due to the fact that the sampling rate may not be as fast as the timescale of the causal interactions. In this context, we can view our observed series as a subsampled version of…

Methodology · Statistics 2017-04-11 Alex Tank , Emily B. Fox , Ali Shojaie

Minimum variance controllers have been employed in a wide-range of industrial applications. A key challenge experienced by many adaptive controllers is their poor empirical performance in the initial stages of learning. In this paper, we…

Systems and Control · Electrical Eng. & Systems 2023-05-29 Rahul Singh , Akshay Mete , Avik Kar , P. R. Kumar

We consider learning methods based on the regularization of a convex empirical risk by a squared Hilbertian norm, a setting that includes linear predictors and non-linear predictors through positive-definite kernels. In order to go beyond…

Machine Learning · Computer Science 2019-06-19 Ulysse Marteau-Ferey , Dmitrii Ostrovskii , Francis Bach , Alessandro Rudi

We design receding horizon control strategies for stochastic discrete-time linear systems with additive (possibly) unbounded disturbances, while obeying hard bounds on the control inputs. We pose the problem of selecting an appropriate…

Optimization and Control · Mathematics 2011-07-07 Debasish Chatterjee , Peter Hokayem , John Lygeros

This paper develops a new approach to the estimation of the degree of boundedness or stability of multidimensional nonlinear systems with time-dependent nonperiodic coefficients-an essential task in various engineering and natural science…

Dynamical Systems · Mathematics 2022-06-16 Mark A. Pinsky

Predicting the output of a dynamical system from streaming data is fundamental to real-time feedback control and decision-making. We first derive an autoregressive representation that relates future local outputs to asynchronous past…

Systems and Control · Electrical Eng. & Systems 2026-03-09 Jiachen Qian , Yang Zheng

In this paper we propose a framework to analyze iterative first-order optimization algorithms for time-varying convex optimization. We assume that the temporal variability is caused by a time-varying parameter entering the objective, which…

Optimization and Control · Mathematics 2026-03-05 Fabian Jakob , Andrea Iannelli

We consider a finite horizon linear discrete time varying system whose input is a random noise with an imprecisely known probability law. The statistical uncertainty is described by a nonnegative parameter a which constrains the anisotropy…

Systems and Control · Computer Science 2012-08-21 Eugene A. Maximov , Alexander P. Kurdyukov , Igor G. Vladimirov

We present a non-asymptotic lower bound on the eigenspectrum of the design matrix generated by any linear bandit algorithm with sub-linear regret when the action set has well-behaved curvature. Specifically, we show that the minimum…

Machine Learning · Computer Science 2023-01-10 Debangshu Banerjee , Avishek Ghosh , Sayak Ray Chowdhury , Aditya Gopalan

An adaptive controller with bounded l2-gain from disturbances to errors is derived for linear time-invariant systems with uncertain parameters restricted to a finite set. The gain bound refers to the closed loop system, including the…

Optimization and Control · Mathematics 2024-04-09 Anders Rantzer

Interval-valued linear regression has been investigated for some time. One of the critical issues is optimizing the balance between model flexibility and interpretability. This paper proposes a linear model for interval-valued data based on…

Methodology · Statistics 2015-06-12 Yan Sun , Dan Ralescu

The success of large-scale models in recent years has increased the importance of statistical models with numerous parameters. Several studies have analyzed over-parameterized linear models with high-dimensional data, which may not be…

Statistics Theory · Mathematics 2025-03-14 Shogo Nakakita , Masaaki Imaizumi

This paper proposes a parsimoniously time varying parameter vector autoregressive model (with exogenous variables, VARX) and studies the properties of the Lasso and adaptive Lasso as estimators of this model. The parameters of the model are…

Statistics Theory · Mathematics 2014-11-21 Laurent Callot , Johannes Tang Kristensen

This paper presents a technique to drive the state of a constrained nonlinear system to a specified target state in finite time, when the system suffers a partial loss in control authority. Our technique builds on a recent method to control…

Optimization and Control · Mathematics 2026-04-10 Ram Padmanabhan , Melkior Ornik

In this paper, we present the asymptotic properties of the moment estimator for autoregressive (AR for short) models subject to Markovian changes in regime under the assumption that the errors are uncorrelated but not necessarily…

Statistics Theory · Mathematics 2025-03-06 Yacouba Boubacar Mainassara , Landy Rabehasaina , Armel Bra

We consider a class of systems with time-varying parameters, which are written as linear regressions with bounded disturbances. The task is to estimate such parameters under the condition that the regressor is finitely exciting (FE).…

Systems and Control · Electrical Eng. & Systems 2021-11-24 Anton Glushchenko , Konstantin Lastochkin

Forecasting the evolution of complex systems is one of the grand challenges of modern data science. The fundamental difficulty lies in understanding the structure of the observed stochastic process. In this paper, we show that every…

Statistics Theory · Mathematics 2020-01-01 Xiucai Ding , Zhou Zhou

This contribution proposes a recursive set-membership method for the ellipsoidal state characterization for discrete-time linear time-varying models with additive unknown disturbances vectors, bounded by possibly degenerate zonotopes and…

Systems and Control · Electrical Eng. & Systems 2023-09-15 Yasmina Becis-Aubry