English

Partially Observed Dynamic Tensor Response Regression

Machine Learning 2021-05-17 v3 Machine Learning Statistics Theory Statistics Theory

Abstract

In modern data science, dynamic tensor data is prevailing in numerous applications. An important task is to characterize the relationship between such dynamic tensor and external covariates. However, the tensor data is often only partially observed, rendering many existing methods inapplicable. In this article, we develop a regression model with partially observed dynamic tensor as the response and external covariates as the predictor. We introduce the low-rank, sparsity and fusion structures on the regression coefficient tensor, and consider a loss function projected over the observed entries. We develop an efficient non-convex alternating updating algorithm, and derive the finite-sample error bound of the actual estimator from each step of our optimization algorithm. Unobserved entries in tensor response have imposed serious challenges. As a result, our proposal differs considerably in terms of estimation algorithm, regularity conditions, as well as theoretical properties, compared to the existing tensor completion or tensor response regression solutions. We illustrate the efficacy of our proposed method using simulations, and two real applications, a neuroimaging dementia study and a digital advertising study.

Keywords

Cite

@article{arxiv.2002.09735,
  title  = {Partially Observed Dynamic Tensor Response Regression},
  author = {Jie Zhou and Will Wei Sun and Jingfei Zhang and Lexin Li},
  journal= {arXiv preprint arXiv:2002.09735},
  year   = {2021}
}

Comments

Improved lower bound on observation probability (Assumptions 2,6); Improved sample complexity conditions (Assumptions 5,10); Improved final statistical error rate in Theorems 1-2; add a new initialization section; extend to sub-Gaussian error tensor