English
Related papers

Related papers: Sparse High-Dimensional Vector Autoregressive Boot…

200 papers

In this paper we develop non-asymptotic Gaussian approximation results for the sampling distribution of suprema of empirical processes when the indexing function class $\mathcal{F}_n$ varies with the sample size $n$ and may not be Donsker.…

Statistics Theory · Mathematics 2023-09-06 Alexander Giessing

In this paper, we establish Berry-Esseen-type bounds for federated linear stochastic approximation (LSA). Our results provide the first federated Gaussian approximations for LSA that explicitly capture communication-computation trade-offs…

Machine Learning · Statistics 2026-05-20 Ilya Levin , Maksim Shuklin , Eric Moulines , Paul Mangold , Sergey Samsonov

The bootstrap variance estimate is widely used in semiparametric inferences. However, its theoretical validity is a well known open problem. In this paper, we provide a {\em first} theoretical study on the bootstrap moment estimates in…

Statistics Theory · Mathematics 2014-09-23 Guang Cheng

The non-linear autoregressive (NLAR) model plays an important role in modeling and predicting time series. One-step ahead prediction is straightforward using the NLAR model, but the multi-step ahead prediction is cumbersome. For instance,…

Methodology · Statistics 2023-06-08 Kejin Wu , Dimitris N. Politis

For time series with long-range temporal dependence, inference for covariance and precision matrices is non-trivial. We propose a Berry-Esseen type Gaussian approximation result that gives a finite-sample bound for the Kolmogorov distance…

Statistics Theory · Mathematics 2026-04-20 Percy S. Zhai , Mladen Kolar , Wei Biao Wu

Learning vector autoregressive models from multivariate time series is conventionally approached through least squares or maximum likelihood estimation. These methods typically assume a fully connected model which provides no direct insight…

Computation · Statistics 2021-09-24 Kimmo Suotsalo , Yingying Xu , Jukka Corander , Johan Pensar

Assessing sampling uncertainty in extremum estimation can be challenging when the asymptotic variance is not analytically tractable. Bootstrap inference offers a feasible solution but can be computationally costly especially when the model…

Econometrics · Economics 2020-09-15 Jean-Jacques Forneron , Serena Ng

Inference and prediction under the sparsity assumption have been a hot research topic in recent years. However, in practice, the sparsity assumption is difficult to test, and more importantly can usually be violated. In this paper, to study…

Statistics Theory · Mathematics 2022-10-18 Yanmei Shi , Zhiruo Li , Qi Zhang

The Vector AutoRegressive (VAR) model is fundamental to the study of multivariate time series. Although VAR models are intensively investigated by many researchers, practitioners often show more interest in analyzing VARX models that…

Machine Learning · Statistics 2017-11-13 Ines Wilms , Sumanta Basu , Jacob Bien , David S. Matteson

Approximations to Gaussian processes based on inducing variables, combined with variational inference techniques, enable state-of-the-art sparse approaches to infer GPs at scale through mini batch-based learning. In this work, we address…

Machine Learning · Statistics 2021-07-21 Gia-Lac Tran , Dimitrios Milios , Pietro Michiardi , Maurizio Filippone

We propose a new method of estimation in high-dimensional linear regression model. It allows for very weak distributional assumptions including heteroscedasticity, and does not require the knowledge of the variance of random errors. The…

Statistics Theory · Mathematics 2013-04-16 Eric Gautier , Alexandre Tsybakov

We consider the problem of estimating the parameters of a multivariate Bernoulli process with auto-regressive feedback in the high-dimensional setting where the number of samples available is much less than the number of parameters. This…

Statistics Theory · Mathematics 2019-03-25 Parthe Pandit , Mojtaba Sahraee-Ardakan , Arash A. Amini , Sundeep Rangan , Alyson K. Fletcher

Advances in sensing technology have made it possible to collect large volumes of high-dimensional time-series data. In fields like genetics and neuroscience, key questions concern whether directed relationships between variables can be…

Methodology · Statistics 2026-05-08 Sarah E. Heaps , Ian H. Jermyn , Yujiang Wang , Darren J. Wilkinson

Although much progress has been made in the theory and application of bootstrap approximations for max statistics in high dimensions, the literature has largely been restricted to cases involving light-tailed data. To address this issue, we…

Methodology · Statistics 2025-12-24 Mingshuo Liu , Miles E. Lopes

We provide a novel -- and to the best of our knowledge, the first -- algorithm for high dimensional sparse regression with constant fraction of corruptions in explanatory and/or response variables. Our algorithm recovers the true sparse…

Machine Learning · Computer Science 2019-05-31 Liu Liu , Yanyao Shen , Tianyang Li , Constantine Caramanis

Many theoretical results for the lasso require the samples to be iid. Recent work has provided guarantees for the lasso assuming that the time series is generated by a sparse Vector Auto-Regressive (VAR) model with Gaussian innovations.…

Statistics Theory · Mathematics 2019-03-22 Kam Chung Wong , Zifan Li , Ambuj Tewari

In this paper, we consider testing the martingale difference hypothesis for high-dimensional time series. Our test is built on the sum of squares of the element-wise max-norm of the proposed matrix-valued nonlinear dependence measure at…

Econometrics · Economics 2023-11-15 Jinyuan Chang , Qing Jiang , Xiaofeng Shao

We show that the two-stage adaptive Lasso procedure (Zou, 2006) is consistent for high-dimensional model selection in linear and Gaussian graphical models. Our conditions for consistency cover more general situations than those accomplished…

Statistics Theory · Mathematics 2009-03-17 Shuheng Zhou , Sara van de Geer , Peter Bühlmann

We consider inference about coefficients on a small number of variables of interest in a linear panel data model with additive unobserved individual and time specific effects and a large number of additional time-varying confounding…

Methodology · Statistics 2017-09-29 Christian Hansen , Yuan Liao

We consider the estimation of the transition matrix in the high-dimensional time-varying vector autoregression (TV-VAR) models. Our model builds on a general class of locally stationary VAR processes that evolve smoothly in time. We propose…

Statistics Theory · Mathematics 2017-10-03 Xin Ding , Ziyi Qiu , Xiaohui Chen