English
Related papers

Related papers: A Finite-Sample Deviation Bound for Stable Autoreg…

200 papers

We consider finite dimensional rough differential equations driven by centered Gaussian processes. Combining Malliavin calculus, rough paths techniques and interpolation inequalities, we establish upper bounds on the density of the…

Probability · Mathematics 2020-06-18 Benjamin Gess , Cheng Ouyang , Samy Tindel

The topics dicussed in this paper take their origin inthe estimation of the Gram matrix of a random vector from a sample made of n independent copies. They comprise the estimation of the covariance matrix and the study of least squares…

Statistics Theory · Mathematics 2016-03-17 Olivier Catoni

The asymptotic analysis of covariance parameter estimation of Gaussian processes has been subject to intensive investigation. However, this asymptotic analysis is very scarce for non-Gaussian processes. In this paper, we study a class of…

Statistics Theory · Mathematics 2019-11-27 François Bachoc , José Bétancourt , Reinhard Furrer , Thierry Klein

We study stochastic approximation procedures for approximately solving a $d$-dimensional linear fixed point equation based on observing a trajectory of length $n$ from an ergodic Markov chain. We first exhibit a non-asymptotic bound of the…

Optimization and Control · Mathematics 2024-05-14 Wenlong Mou , Ashwin Pananjady , Martin J. Wainwright , Peter L. Bartlett

We establish the asymptotic theory of least absolute deviation estimators for AR(1) processes with autoregressive parameter satisfying $n(\rho_n-1)\to\gamma$ for some fixed $\gamma$ as $n\to\infty$, which is parallel to the results of…

Statistics Theory · Mathematics 2023-01-09 Nannan Ma , Hailin Sang , Guangyu Yang

We provide non-asymptotic, relative deviation bounds for the eigenvalues of empirical covariance and Gram matrices in general settings. Unlike typical uniform bounds, which may fail to capture the behavior of smaller eigenvalues, our…

Probability · Mathematics 2025-05-28 Daniel Barzilai , Ohad Shamir

This paper is devoted to the problem of determining the concentration bounds that are achievable in non-parametric regression. We consider the setting where features are supported on a bounded subset of $\mathbb{R}^d$, the regression…

Statistics Theory · Mathematics 2024-12-02 Anna Ben-Hamou , Arnaud Guyader

This paper establishes sharp dimension-free concentration and expectation bounds for the deviation of a sample cross-covariance matrix from its mean. For sub-Gaussian random vectors, we prove a high-probability operator-norm bound governed…

Probability · Mathematics 2026-05-19 Jiaheng Chen , Daniel Sanz-Alonso

This paper considers nonparametric estimation and inference in first-order autoregressive (AR(1)) models with deterministically time-varying parameters. A key feature of the proposed approach is to allow for time-varying stationarity in…

Econometrics · Economics 2024-11-04 Donald W. K. Andrews , Ming Li

We derive generalization error bounds for stationary univariate autoregressive (AR) models. We show that imposing stationarity is enough to control the Gaussian complexity without further regularization. This lets us use structural risk…

Machine Learning · Statistics 2011-06-06 Daniel J. McDonald , Cosma Rohilla Shalizi , Mark Schervish

Lower bounds for persistence probabilities of stationary Gaussian processes in discrete time are obtained under various conditions on the spectral measure of the process. Examples are given to show that the persistence probability can decay…

Probability · Mathematics 2016-02-02 Krishna M. , Manjunath Krishnapur

This paper considers approximate smoothing for discretely observed non-linear stochastic differential equations. The problem is tackled by developing methods for linearising stochastic differential equations with respect to an arbitrary…

Methodology · Statistics 2019-01-21 Filip Tronarp , Simo Särkkä

In this paper, we establish non-asymptotic bounds for accuracy of normal approximation for linear two-timescale stochastic approximation (TTSA) algorithms driven by martingale difference or Markov noise. Focusing on both the last iterate…

Machine Learning · Statistics 2025-12-10 Bogdan Butyrin , Artemy Rubtsov , Alexey Naumov , Vladimir Ulyanov , Sergey Samsonov

In this paper, we develop {finite-time horizon} causal filters using the nonanticipative rate distortion theory. We apply the {developed} theory to {design optimal filters for} time-varying multidimensional Gauss-Markov processes, subject…

Information Theory · Computer Science 2017-02-13 Photios A. Stavrou , Themistoklis Charalambous , Charalambos D. Charalambous , Sergey Loyka

We propose a lower bound on the log marginal likelihood of Gaussian process regression models that can be computed without matrix factorisation of the full kernel matrix. We show that approximate maximum likelihood learning of model…

Machine Learning · Statistics 2021-02-17 Artem Artemev , David R. Burt , Mark van der Wilk

Stochastic approximation (SA) is a method for finding the root of an operator perturbed by noise. There is a rich literature establishing the asymptotic normality of rescaled SA iterates under fairly mild conditions. However, these…

Machine Learning · Statistics 2026-02-17 Shaan Ul Haque , Zedong Wang , Zixuan Zhang , Siva Theja Maguluri

We derive a finite-sample probabilistic bound on the parameter estimation error of a system identification algorithm for Linear Switched Systems. The algorithm estimates Markov parameters from a single trajectory and applies a variant of…

Machine Learning · Computer Science 2025-05-19 Daniel Racz , Mihaly Petreczky , Balint Daroczy

We consider the problem of `discrete-time persistence', which deals with the zero-crossings of a continuous stochastic process, X(T), measured at discrete times, T = n(\Delta T). For a Gaussian Stationary Process the persistence (no…

Statistical Mechanics · Physics 2009-11-07 George C. M. A. Ehrhardt , Alan J. Bray , Satya N. Majumdar

The paper presents a systematic theory for asymptotic inference of autocovariances of stationary processes. We consider nonparametric tests for serial correlations based on the maximum (or ${\cal L}^\infty$) and the quadratic (or ${\cal…

Statistics Theory · Mathematics 2015-03-19 Han Xiao , Wei Biao Wu

We consider covariance parameter estimation for a Gaussian process under inequality constraints (boundedness, monotonicity or convexity) in fixed-domain asymptotics. We address the estimation of the variance parameter and the estimation of…

Statistics Theory · Mathematics 2021-11-04 François Bachoc , Agnès Lagnoux , Andrés F. López-Lopera