English
Related papers

Related papers: Rank Determination in Tensor Factor Model

200 papers

In this work, we describe advanced numerical tools for working with multivariate functions and for the analysis of large data sets. These tools will drastically reduce the required computing time and the storage cost, and, therefore, will…

Numerical Analysis · Mathematics 2018-07-04 Alexander Litvinenko , David Keyes , Venera Khoromskaia , Boris N. Khoromskij , Hermann G. Matthies

This paper makes a selective survey on the recent development of the factor model and its application on statistical learnings. We focus on the perspective of the low-rank structure of factor models, and particularly draws attentions to…

Econometrics · Economics 2020-09-23 Jianqing Fan , Kunpeng Li , Yuan Liao

High-dimensional matrix-variate time series data are becoming widely available in many scientific fields, such as economics, biology, and meteorology. To achieve significant dimension reduction while preserving the intrinsic matrix…

Methodology · Statistics 2022-10-20 Elynn Y. Chen , Ruey S. Tsay , Rong Chen

A tensor network is a type of decomposition used to express and approximate large arrays of data. A given data-set, quantum state or higher dimensional multi-linear map is factored and approximated by a composition of smaller multi-linear…

Quantum Physics · Physics 2022-07-08 Richik Sengupta , Soumik Adhikary , Ivan Oseledets , Jacob Biamonte

In autoregressive modeling for tensor-valued time series, Tucker decomposition, when applied to the coefficient tensor, provides a clear interpretation of supervised factor modeling but loses its efficiency rapidly with increasing tensor…

Methodology · Statistics 2025-06-03 Yuxi Cai , Lan Li , Yize Wang , Guodong Li

Designs for screening experiments usually include factors with two levels only. Adding a few four-level factors allows for the inclusion of multi-level categorical factors or quantitative factors with possible quadratic or third-order…

Methodology · Statistics 2023-05-11 Alexandre Bohyn , Eric D. Schoen , Peter Goos

We consider change-point latent factor models for high-dimensional time series, where a structural break may exist in the underlying factor structure. In particular, we propose consistent estimators for factor loading spaces before and…

Methodology · Statistics 2019-07-24 Xialu Liu , Ting Zhang

Factor analysis for high-dimensional data is a canonical problem in statistics and has a wide range of applications. However, there is currently no factor model tailored to effectively analyze high-dimensional count responses with…

Methodology · Statistics 2024-08-21 Wei Liu , Qingzhi Zhong

Vector autoregressions (VARs) are popular model for analyzing multivariate economic time series. However, VARs can be over-parameterized if the numbers of variables and lags are moderately large. Tensor VAR, a recent solution to…

Methodology · Statistics 2024-09-13 Yiyong Luo , Jim E. Griffin

Recently, fundamental conditions on the sampling patterns have been obtained for finite completability of low-rank matrices or tensors given the corresponding ranks. In this paper, we consider the scenario where the rank is not given and we…

Machine Learning · Computer Science 2017-11-03 Morteza Ashraphijuo , Xiaodong Wang , Vaneet Aggarwal

Tensor decomposition is a fundamental tool for analyzing multi-dimensional data by learning low-rank factors to represent high-order interactions. While recent works on temporal tensor decomposition have made significant progress by…

Machine Learning · Computer Science 2025-09-30 Panqi Chen , Lei Cheng , Jianlong Li , Weichang Li , Weiqing Liu , Jiang Bian , Shikai Fang

Due to the explosive growth of large-scale data sets, tensors have been a vital tool to analyze and process high-dimensional data. Different from the matrix case, tensor decomposition has been defined in various formats, which can be…

Optimization and Control · Mathematics 2023-12-27 Rachel Grotheer , Shuang Li , Anna Ma , Deanna Needell , Jing Qin

We propose a new model for multi-token prediction in transformers, aiming to enhance sampling efficiency without compromising accuracy. Motivated by recent work that predicts the probabilities of subsequent tokens using multiple heads, we…

Machine Learning · Computer Science 2025-02-11 Artem Basharin , Andrei Chertkov , Ivan Oseledets

We consider small factor analysis models with one or two factors. Fixing the number of factors, we prove a finiteness result about the covariance matrix parameter space when the size of the covariance matrix increases. According to this…

Statistics Theory · Mathematics 2009-08-13 Mathias Drton , Han Xiao

A novel tensor decomposition framework, termed Tensor Star (TS) decomposition, is proposed which represents a new type of tensor network decomposition based on tensor contractions. This is achieved by connecting the core tensors in a ring…

Image and Video Processing · Electrical Eng. & Systems 2024-09-10 Wuyang Zhou , Yu-Bang Zheng , Qibin Zhao , Danilo Mandic

Tensors are becoming increasingly common in data mining, and consequently, tensor factorizations are becoming more and more important tools for data miners. When the data is binary, it is natural to ask if we can factorize it into binary…

Data Structures and Algorithms · Computer Science 2013-10-21 Dóra Erdős , Pauli Miettinen

This work considers a computationally and statistically efficient parameter estimation method for a wide class of latent variable models---including Gaussian mixture models, hidden Markov models, and latent Dirichlet allocation---which…

Machine Learning · Computer Science 2014-11-17 Anima Anandkumar , Rong Ge , Daniel Hsu , Sham M. Kakade , Matus Telgarsky

Tensor decomposition is a mathematically supported technique for data compression. It consists of applying some kind of a Low Rank Decomposition technique on the tensors or matrices in order to reduce the redundancy of the data. However, it…

Machine Learning · Computer Science 2025-05-27 Habib Hajimolahoseini , Walid Ahmed , Austin Wen , Yang Liu

In many longitudinal settings, economic theory does not guide practitioners on the type of restrictions that must be imposed to solve the rotational indeterminacy of factor-augmented linear models. We study this problem and offer several…

Econometrics · Economics 2022-03-08 Matthew Harding , Carlos Lamarche , Chris Muris

The so-called block-term decomposition (BTD) tensor model, especially in its rank-$(L_r,L_r,1)$ version, has been recently receiving increasing attention due to its enhanced ability of representing systems and signals that are composed of…

Numerical Analysis · Mathematics 2021-06-30 Athanasios A. Rontogiannis , Eleftherios Kofidis , Paris V. Giampouras