English
Related papers

Related papers: Modeling and Learning on High-Dimensional Matrix-V…

200 papers

Matrix factorization techniques have been widely used as a method for collaborative filtering for recommender systems. In recent times, different variants of deep learning algorithms have been explored in this setting to improve the task of…

Machine Learning · Computer Science 2019-03-26 Vaibhav Krishna , Tian Guo , Nino Antulov-Fantulin

Principal components analysis (PCA) is a well-known technique for approximating a tabular data set by a low rank matrix. Here, we extend the idea of PCA to handle arbitrary data sets consisting of numerical, Boolean, categorical, ordinal,…

Machine Learning · Statistics 2015-05-06 Madeleine Udell , Corinne Horn , Reza Zadeh , Stephen Boyd

Existing models for high-dimensional time series are overwhelmingly developed within the finite-order vector autoregressive (VAR) framework. However, the more flexible vector autoregressive moving averages (VARMA) have been much less…

Methodology · Statistics 2025-05-01 Feiqing Huang , Kexin Lu , Yao Zheng

This paper proposes a novel diffusion-index model for forecasting when predictors are high-dimensional matrix-valued time series. We apply an $\alpha$-PCA method to extract low-dimensional matrix factors and build a bilinear regression…

Econometrics · Economics 2025-08-07 Zhiren Ma , Qian Zhao , Riquan Zhang , Zhaoxing Gao

Precise representation of large-scale undirected network is the basis for understanding relations within a massive entity set. The undirected network representation task can be efficiently addressed by a symmetry non-negative latent factor…

Machine Learning · Computer Science 2022-03-09 Weiling Li , Xin Luo

This article is an extended version of previous work of the authors [40, 41] on low-rank matrix estimation in the presence of constraints on the factors into which the matrix is factorized. Low-rank matrix factorization is one of the basic…

Statistics Theory · Mathematics 2017-08-28 Thibault Lesieur , Florent Krzakala , Lenka Zdeborová

We study low-rank matrix regression in settings where matrix-valued predictors and scalar responses are observed across multiple individuals. Rather than assuming a fully homogeneous coefficient matrices across individuals, we accommodate…

Methodology · Statistics 2025-10-28 Di Wang , Xiaoyu Zhang , Guodong Li , Wenyang Zhang

We present a new distributed representation in deep neural nets wherein the information is represented in native form as a matrix. This differs from current neural architectures that rely on vector representations. We consider matrices as…

Machine Learning · Computer Science 2018-02-06 Kien Do , Truyen Tran , Svetha Venkatesh

An observed $K$-dimensional series $\left\{ y_{n}\right\} _{n=1}^{N}$ is expressed in terms of a lower $p$-dimensional latent series called factors $f_{n}$ and random noise $\varepsilon_{n}$. The equation, $y_{n}=Qf_{n}+\varepsilon_{n}$ is…

Computation · Statistics 2018-11-29 Immanuel Manohar

This paper proposes a hierarchical approximate-factor approach to analyzing high-dimensional, large-scale heterogeneous time series data using distributed computing. The new method employs a multiple-fold dimension reduction procedure using…

Methodology · Statistics 2022-04-20 Zhaoxing Gao , Ruey S. Tsay

A High-dimensional and sparse (HiDS) matrix is frequently encountered in a big data-related application like an e-commerce system or a social network services system. To perform highly accurate representation learning on it is of great…

Machine Learning · Computer Science 2022-04-19 Di Wu , Yi He , Xin Luo

High-dimensional tensor-valued data have recently gained attention from researchers in economics and finance. We consider the estimation and inference of high-dimensional tensor factor models, where each dimension of the tensor diverges.…

Methodology · Statistics 2025-09-30 Bin Chen , Yuefeng Han , Qiyang Yu

Factor models are widely applied to the analysis of multivariate data across disparate fields of research. However, modern scientific data are often incomplete, and estimating a factor model from partially observed data can be very…

Methodology · Statistics 2026-02-24 Giuseppe Vinci

We consider the problem of estimating high-dimensional covariance matrices of a particular structure, which is a summation of low rank and sparse matrices. This covariance structure has a wide range of applications including factor analysis…

Methodology · Statistics 2013-10-17 Lin Zhang , Abhra Sarkar , Bani K. Mallick

The reduced-rank vector autoregressive (VAR) model can be interpreted as a supervised factor model, where two factor modelings are simultaneously applied to response and predictor spaces. This article introduces a new model, called vector…

Methodology · Statistics 2023-06-16 Di Wang , Xiaoyu Zhang , Guodong Li , Ruey Tsay

Latent factor models that integrate data from multiple sources/studies or modalities have garnered considerable attention across various disciplines. However, existing methods predominantly focus either on multi-study integration or…

Methodology · Statistics 2025-07-15 Wei Liu , Qingzhi Zhong

Since many real-world data can be described from multiple views, multi-view learning has attracted considerable attention. Various methods have been proposed and successfully applied to multi-view learning, typically based on matrix…

Machine Learning · Computer Science 2020-12-03 Haonan Huang , Naiyao Liang , Wei Yan , Zuyuan Yang , Weijun Sun

In this paper, we propose a new Bayesian inference method for a high-dimensional sparse factor model that allows both the factor dimensionality and the sparse structure of the loading matrix to be inferred. The novelty is to introduce a…

Machine Learning · Statistics 2023-05-31 Ilsang Ohn , Lizhen Lin , Yongdai Kim

An efficient way to learn deep density models that have many layers of latent variables is to learn one layer at a time using a model that has only one layer of latent variables. After learning each layer, samples from the posterior…

Machine Learning · Computer Science 2012-06-22 Yichuan Tang , Ruslan Salakhutdinov , Geoffrey Hinton

Dimension reduction techniques are among the most essential analytical tools in the analysis of high-dimensional data. Generalized principal component analysis (PCA) is an extension to standard PCA that has been widely used to identify…