English
Related papers

Related papers: High dimensional VAR with low rank transition

200 papers

This paper introduces a novel process for both factor and idiosyncratic volatility matrices whose eigenvalues follow the vector auto-regressive (VAR) model. We call it the factor and idiosyncratic VAR (FIVAR) model. The FIVAR model accounts…

Methodology · Statistics 2025-09-25 Minseok Shin , Donggyu Kim , Yazhen Wang , Jianqing Fan

We develop latent variable models for Bayesian learning based low-rank matrix completion and reconstruction from linear measurements. For under-determined systems, the developed methods are shown to reconstruct low-rank matrices when…

Machine Learning · Statistics 2015-01-26 Martin Sundin , Cristian R. Rojas , Magnus Jansson , Saikat Chatterjee

We extend the standard VAR to jointly model the dynamics of binary, censored and continuous variables, and develop an efficient estimation approach that scales well to high-dimensional settings. In an out-of-sample forecasting exercise, we…

Econometrics · Economics 2025-06-03 Joshua C. C. Chan , Michael Pfarrhofer

Many recent advances in machine learning are driven by a challenging trifecta: large data size $N$; high dimensions; and expensive algorithms. In this setting, cross-validation (CV) serves as an important tool for model assessment. Recent…

Machine Learning · Statistics 2022-11-03 William T. Stephenson , Madeleine Udell , Tamara Broderick

High-dimensional multivariate time series are challenging due to the dependent and high-dimensional nature of the data, but in many applications there is additional structure that can be exploited to reduce computing time along with…

Methodology · Statistics 2020-03-13 Michael Schweinberger , Sergii Babkin , Katherine Ensor

This paper studies the problem of estimating a large coefficient matrix in a multiple response linear regression model when the coefficient matrix could be both of low rank and sparse in the sense that most nonzero entries concentrate on a…

Methodology · Statistics 2016-03-18 Zhuang Ma , Zongming Ma , Tingni Sun

Time series of matrix-valued data are increasingly available in various areas including economics, finance, social science, among others. These data may shed light on the inter-dynamical relationships between two sets of attributes, for…

Methodology · Statistics 2026-04-22 Fei Wu , Kung-Sik Chan

The paper considers variable selection in linear regression models where the number of covariates is possibly much larger than the number of observations. High dimensionality of the data brings in many complications, such as (possibly…

Methodology · Statistics 2016-11-29 Haeran Cho , Piotr Fryzlewicz

In this document, some general results in approximation theory and matrix analysis with applications to sparse identification of time series models and nonlinear discrete-time dynamical systems are presented. The aforementioned theoretical…

Numerical Analysis · Mathematics 2021-08-04 Fredy Vides

We propose a nonconvex estimator for joint multivariate regression and precision matrix estimation in the high dimensional regime, under sparsity constraints. A gradient descent algorithm with hard thresholding is developed to solve the…

Machine Learning · Statistics 2016-06-03 Jinghui Chen , Quanquan Gu

Matrix-covariate is now frequently encountered in many biomedical researches. It is common to fit conventional statistical models by vectorizing matrix-covariate. This strategy, however, results in a large number of parameters, while the…

Applications · Statistics 2016-07-12 Hung Hung , Zhi-Yu Jou

We propose an algorithmic framework, that employs active subspace techniques, for scalable global optimization of functions with low effective dimension (also referred to as low-rank functions). This proposal replaces the original…

Optimization and Control · Mathematics 2024-02-01 Coralia Cartis , Xinzhu Liang , Estelle Massart , Adilet Otemissov

Integer-valued time series are widely present in many fields, such as finance, economics, disease transmission, and traffic flow. With data dimensions surging, the traditional multivariate generalized integer autoregressive (MGINAR) model…

Statistics Theory · Mathematics 2025-09-05 Kaiyan Cui , Tianyun Guo , Suping Wang

Low-rank approximations of data matrices are an important dimensionality reduction tool in machine learning and regression analysis. We consider the case of categorical variables, where it can be formulated as the problem of finding…

Machine Learning · Computer Science 2018-03-14 Reka Kovacs , Oktay Gunluk , Raphael Hauser

Time-varying parameter vector autoregression provides a flexible framework to capture structural changes within time series. However, when applied to high-dimensional data, this model encounters challenges of over-parametrization and…

Methodology · Statistics 2025-05-14 Yiyong Luo , Jim E. Griffin

The low-rank approximation is a complexity reduction technique to approximate a tensor or a matrix with a reduced rank, which has been applied to the simulation of high dimensional problems to reduce the memory required and computational…

Computational Physics · Physics 2020-08-26 Zhuogang Peng , Ryan McClarren , Martin Frank

Efficient training and inference algorithms, such as low-rank adaption and model pruning, have shown impressive performance for learning Transformer-based large foundation models. However, due to the technical challenges of the non-convex…

Machine Learning · Computer Science 2024-06-26 Hongkang Li , Meng Wang , Shuai Zhang , Sijia Liu , Pin-Yu Chen

We develop a new methodology for forecasting matrix-valued time series with historical matrix data and auxiliary vector time series data. We focus on a time series of matrices defined on a static 2-D spatial grid and an auxiliary time…

Methodology · Statistics 2025-09-25 Hu Sun , Zuofeng Shang , Yang Chen

Recent developments in engineering techniques for spatial data collection such as geographic information systems have resulted in an increasing need for methods to analyze large spatial data sets. These sorts of data sets can be found in…

Methodology · Statistics 2020-08-14 Toshihiro Hirano

Pseudospectral analysis is fundamental for quantifying the sensitivity and transient behavior of nonnormal matrices, yet its computational cost scales cubically with dimension, rendering it prohibitive for large-scale systems. While…

Numerical Analysis · Mathematics 2026-02-03 Vladimir R. Kostic , Dragana Lj. Cvetkovic , Ljiljana Cvetkovic