English
Related papers

Related papers: Reduced-Rank Tensor-on-Tensor Regression and Tenso…

200 papers

We develop a new method to fit the multivariate response linear regression model that exploits a parametric link between the regression coefficient matrix and the error covariance matrix. Specifically, we assume that the correlations…

Methodology · Statistics 2021-12-09 Aaron J. Molstad , Guangwei Weng , Charles R. Doss , Adam J. Rothman

Deep neural networks (NNs) encounter scalability limitations when confronted with a vast array of neurons, thereby constraining their achievable network depth. To address this challenge, we propose an integration of tensor networks (TN)…

Disordered Systems and Neural Networks · Physics 2024-08-20 Saeed S. Jahromi , Roman Orus

Effective non-parametric density estimation is a key challenge in high-dimensional multivariate data analysis. In this paper,we propose a novel approach that builds upon tensor factorization tools. Any multivariate density can be…

Machine Learning · Statistics 2022-10-19 Magda Amiridi , Nikos Kargas , Nicholas D. Sidiropoulos

Randomization is a basis for the statistical inference of treatment effects without strong assumptions on the outcome-generating process. Appropriately using covariates further yields more precise estimators in randomized experiments. R. A.…

Statistics Theory · Mathematics 2020-01-03 Xinran Li , Peng Ding

In this paper, we construct a parameter estimation framework for robust low-rank tensor regression based on a truncation method and Huber loss, specifically focusing on models with random noise having only finite second-order moments.…

Statistics Theory · Mathematics 2025-12-05 Kangqiang Li , Bingqi Liu , Yang Yang , Li Wang

Tensor decomposition methods are popular tools for learning latent variables given only lower-order moments of the data. However, the standard assumption is that we have sufficient data to estimate these moments to high accuracy. In this…

Machine Learning · Statistics 2019-03-13 Omer Gottesman , Weiwei Pan , Finale Doshi-Velez

Tensor regression methods have been widely used to predict a scalar response from covariates in the form of a multiway array. In many applications, the regions of tensor covariates used for prediction are often spatially connected with…

Methodology · Statistics 2024-04-02 Shuoli Chen , Kejun He , Shiyuan He , Yang Ni , Raymond K. W. Wong

Multitask learning (MTL) can utilize the relatedness between multiple tasks for performance improvement. The advent of multimodal data allows tasks to be referenced by multiple indices. High-order tensors are capable of providing efficient…

Machine Learning · Computer Science 2023-08-23 Jiani Liu , Qinghua Tao , Ce Zhu , Yipeng Liu , Johan A. K. Suykens

High-dimensional tensor-valued data have recently gained attention from researchers in economics and finance. We consider the estimation and inference of high-dimensional tensor factor models, where each dimension of the tensor diverges.…

Methodology · Statistics 2025-09-30 Bin Chen , Yuefeng Han , Qiyang Yu

Tensor numerical methods, based on the rank-structured tensor representation of $d$-variate functions and operators, are designed to provide $O(dn)$ complexity of numerical calculations on $n^{\otimes d }$ grids contrary to $O(n^d)$ scaling…

Numerical Analysis · Mathematics 2022-02-01 Venera Khoromskaia , Boris N. Khoromskij

A Covariance-on-Covariance regression model is introduced in this manuscript. It is assumed that there exists (at least) a pair of linear projections on outcome covariance matrices and predictor covariance matrices such that a log-linear…

Methodology · Statistics 2022-12-21 Yi Zhao , Yize Zhao

Most currently used tensor regression models for high-dimensional data are based on Tucker decomposition, which has good properties but loses its efficiency in compressing tensors very quickly as the order of tensors increases, say greater…

Methodology · Statistics 2024-03-20 Yuefeng Si , Yingying Zhang , Yuxi Cai , Chunling Liu , Guodong Li

The standard linear and logistic regression models assume that the response variables are independent, but share the same linear relationship to their corresponding vectors of covariates. The assumption that the response variables are…

Machine Learning · Computer Science 2019-10-09 Constantinos Daskalakis , Nishanth Dikkala , Ioannis Panageas

We consider the problem of the estimation of a high-dimensional probability distribution from i.i.d. samples of the distribution using model classes of functions in tree-based tensor formats, a particular case of tensor networks associated…

Machine Learning · Statistics 2021-05-21 Erwan Grelier , Anthony Nouy , Régis Lebrun

Tensor decomposition methods are widely used for model compression and fast inference in convolutional neural networks (CNNs). Although many decompositions are conceivable, only CP decomposition and a few others have been applied in…

Machine Learning · Computer Science 2019-11-28 Kohei Hayashi , Taiki Yamaguchi , Yohei Sugawara , Shin-ichi Maeda

We consider (robust) inference in the context of a factor model for tensor-valued sequences. We study the consistency of the estimated common factors and loadings space when using estimators based on minimising quadratic loss functions.…

Methodology · Statistics 2023-08-29 Matteo Barigozzi , Yong He , Lingxiao Li , Lorenzo Trapani

We introduce a tensor-based model of shared representation for meta-learning from a diverse set of tasks. Prior works on learning linear representations for meta-learning assume that there is a common shared representation across different…

Machine Learning · Computer Science 2022-01-20 Samuel Deng , Yilin Guo , Daniel Hsu , Debmalya Mandal

To address the common problem of high dimensionality in tensor regressions, we introduce a generalized tensor random projection method that embeds high-dimensional tensor-valued covariates into low-dimensional subspaces with minimal loss of…

Methodology · Statistics 2025-10-03 Roberto Casarin , Radu Craiu , Qing Wang

Anisotropy in the mechanical response of materials with microstructure is common and yet is difficult to assess and model. To construct accurate response models given only stress-strain data, we employ classical representation theory, novel…

Materials Science · Physics 2022-09-07 Jan N. Fuhg , Nikolaos Bouklas , Reese E. Jones

We propose a new class of estimators of the multivariate response linear regression coefficient matrix that exploits the assumption that the response and predictors have a joint multivariate Normal distribution. This allows us to indirectly…

Methodology · Statistics 2015-07-17 Aaron J. Molstad , Adam J. Rothman