English
Related papers

Related papers: Time-varying first-order autoregressive processes …

200 papers

We consider a stable but nearly unstable autoregressive process of any order. The bridge between stability and instability is expressed by a time-varying companion matrix $A_{n}$ with spectral radius $\rho(A_{n}) < 1$ satisfying…

Statistics Theory · Mathematics 2019-10-17 Frédéric Proïa

We consider regression scenarios where it is natural to impose an order constraint on the coefficients. We propose an order-constrained version of L1-regularized regression for this problem, and show how to solve it efficiently using the…

Applications · Statistics 2017-06-01 Xiaotong Suo , Robert Tibshirani

We introduce a recursive algorithm of conveniently general form for estimating the coefficient of a moving average model of order one and obtain convergence results for both correct and misspecified MA(1) models. The algorithm encompasses…

Statistics Theory · Mathematics 2007-06-13 James L. Cantor , David F. Findley

Time-varying optimization problems are central to many engineering applications, where performance metrics and system constraints evolve dynamically with time. Several algorithms have been proposed to address these problems; a common…

Optimization and Control · Mathematics 2025-10-28 Gianluca Bianchin , Bryan Van Scoy

We provide a novel computer-assisted technique for systematically analyzing first-order methods for optimization. In contrast with previous works, the approach is particularly suited for handling sublinear convergence rates and stochastic…

Optimization and Control · Mathematics 2021-12-22 Adrien Taylor , Francis Bach

In this paper we consider high dimension models based on dependent observations defined through autoregressive processes. For such models we develop an adaptive efficient estimation method via the robust sequential model selection…

Statistics Theory · Mathematics 2021-04-19 Ouerdia Arkoun , Jean-Yves Brua , Serguei Pergamenshchikov

Understanding the time-varying structure of complex temporal systems is one of the main challenges of modern time series analysis. In this paper, we show that every uniformly-positive-definite-in-covariance and sufficiently short-range…

Statistics Theory · Mathematics 2023-04-25 Xiucai Ding , Zhou Zhou

In this paper, we study a smoothness regularization method for a varying coefficient model based on sparse and irregularly sampled functional data which is contaminated with some measurement errors. We estimate the one-dimensional…

Methodology · Statistics 2017-11-28 Behdad Mostafaiy

This paper is about vector autoregressive-moving average (VARMA) models with time-dependent coefficients to represent non-stationary time series. Contrarily to other papers in the univariate case, the coefficients depend on time but not on…

Statistics Theory · Mathematics 2015-06-05 Abdelkamel Alj , Christophe Ley , Guy Mélard

In this paper, we present the asymptotic properties of the moment estimator for autoregressive (AR for short) models subject to Markovian changes in regime under the assumption that the errors are uncorrelated but not necessarily…

Statistics Theory · Mathematics 2025-03-06 Yacouba Boubacar Mainassara , Landy Rabehasaina , Armel Bra

Conditional inference on arbitrary subsets of variables is a core problem in probabilistic inference with important applications such as masked language modeling and image inpainting. In recent years, the family of Any-Order Autoregressive…

Machine Learning · Computer Science 2022-10-25 Andy Shih , Dorsa Sadigh , Stefano Ermon

Hierarchical models with gamma hyperpriors provide a flexible, sparse-promoting framework to bridge $L^1$ and $L^2$ regularizations in Bayesian formulations to inverse problems. Despite the Bayesian motivation for these models, existing…

Methodology · Statistics 2021-11-30 Shiv Agrawal , Hwanwoo Kim , Daniel Sanz-Alonso , Alexander Strang

There has been considerable advance in understanding the properties of sparse regularization procedures in high-dimensional models. In time series context, it is mostly restricted to Gaussian autoregressions or mixing sequences. We study…

Statistics Theory · Mathematics 2021-06-15 Ricardo P. Masini , Marcelo C. Medeiros , Eduardo F. Mendes

Autoregressive models (ARMs) have become the workhorse for sequence generation tasks, since many problems can be modeled as next-token prediction. While there appears to be a natural ordering for text (i.e., left-to-right), for many data…

Machine Learning · Computer Science 2025-07-15 Zhe Wang , Jiaxin Shi , Nicolas Heess , Arthur Gretton , Michalis K. Titsias

We present a variant of accelerated gradient descent algorithms, adapted from Nesterov's optimal first-order methods, for weakly-quasi-convex and weakly-quasi-strongly-convex functions. We show that by tweaking the so-called estimate…

Optimization and Control · Mathematics 2020-06-16 Jingjing Bu , Mehran Mesbahi

We characterize recurrence and transience of nonnegative multivariate autoregressive processes of order one with random contractive coefficient matrix, of subcritical multitype Galton-Watson branching processes in random environment with…

Probability · Mathematics 2016-10-18 Martin P. W. Zerner

In this paper, we introduce some adaptive methods for solving variational inequalities with relatively strongly monotone operators. Firstly, we focus on the modification of the recently proposed, in smooth case [1], adaptive numerical…

Optimization and Control · Mathematics 2022-11-01 A. A. Titov , S. S. Ablaev , M. S. Alkousa , F. S. Stonyakin , A. V. Gasnikov

We discuss joint temporal and contemporaneous aggregation of $N$ independent copies of random-coefficient AR(1) process driven by i.i.d. innovations in the domain of normal attraction of an $\alpha$-stable distribution, $0< \alpha \le 2$,…

Statistics Theory · Mathematics 2020-05-01 Vytautė Pilipauskaitė , Viktor Skorniakov , Donatas Surgailis

Irregularly sampled time series data arise naturally in many application domains including biology, ecology, climate science, astronomy, and health. Such data represent fundamental challenges to many classical models from machine learning…

Machine Learning · Computer Science 2021-01-07 Satya Narayan Shukla , Benjamin M. Marlin

In this article, we study the asymptotic behaviour of the residual autocorrelations for periodic vector autoregressive time series models (PVAR henceforth) with uncorrelated but dependent innovations (i.e., weak PVAR). We then deduce the…

Statistics Theory · Mathematics 2024-10-01 Yacouba Boubacar Mainassara , Eugen Ursu