English
Related papers

Related papers: High-dimensional low-rank matrix regression with u…

200 papers

This paper is concerned with the development and analysis of an iterative solver for high-dimensional second-order elliptic problems based on subspace-based low-rank tensor formats. Both the subspaces giving rise to low-rank approximations…

Numerical Analysis · Mathematics 2014-07-21 Markus Bachmayr , Wolfgang Dahmen

Motivated by Tucker tensor decomposition, this paper imposes low-rank structures to the column and row spaces of coefficient matrices in a multivariate infinite-order vector autoregression (VAR), which leads to a supervised factor model…

Methodology · Statistics 2023-12-04 Feiqing Huang , Kexin Lu , Guodong Li

Low-rank matrix estimation is a fundamental problem in statistics and machine learning with applications across biomedical sciences, including genetics, medical imaging, drug discovery, and electronic health record data analysis. In the…

Methodology · Statistics 2025-08-20 Sean McGrath , Cenhao Zhu , Ryan O'Dea , Min Guo , Rui Duan

The paper addresses the problem of learning a regression model parameterized by a fixed-rank positive semidefinite matrix. The focus is on the nonlinear nature of the search space and on scalability to high-dimensional problems. The…

Machine Learning · Computer Science 2011-02-01 Gilles Meyer , Silvere Bonnabel , Rodolphe Sepulchre

We consider the problem of recovering elements of a low-dimensional model from linear measurements. From signal and image processing to inverse problems in data science, this question has been at the center of many applications. Lately,…

Signal Processing · Electrical Eng. & Systems 2025-05-15 Yann Traonmilin , Jean François Aujol , Antoine Guennec

We propose a new sparse regression method called the component lasso, based on a simple idea. The method uses the connected-components structure of the sample covariance matrix to split the problem into smaller ones. It then solves the…

Machine Learning · Statistics 2013-12-10 Nadine Hussami , Robert Tibshirani

Modern applications have made ubiquitous high-dimensional data, especially time-dependent data, with more and more complicated structures, and it also has become more frequent to encounter the scenario of hierarchical relationships among…

Methodology · Statistics 2026-04-06 Lan Li , Shibo Yu , Yingzhou Wang , Guodong Li

Low rank tensor representation underpins much of recent progress in tensor completion. In real applications, however, this approach is confronted with two challenging problems, namely (1) tensor rank determination; (2) handling real tensor…

Computer Vision and Pattern Recognition · Computer Science 2017-08-04 Lei Zhang , Wei Wei , Qinfeng Shi , Chunhua Shen , Anton van den Hengel , Yanning Zhang

This work presents a comprehensive understanding of the estimation of a planted low-rank signal from a general spiked tensor model near the computational threshold. Relying on standard tools from the theory of large random matrices, we…

Machine Learning · Statistics 2025-01-15 Hugo Lebeau , Florent Chatelain , Romain Couillet

We consider the problem of estimating high-dimensional covariance matrices of a particular structure, which is a summation of low rank and sparse matrices. This covariance structure has a wide range of applications including factor analysis…

Methodology · Statistics 2013-10-17 Lin Zhang , Abhra Sarkar , Bani K. Mallick

We consider a multivariate time series model which represents a high dimensional vector process as a sum of three terms: a linear regression of some observed regressors, a linear combination of some latent and serially correlated factors,…

Statistics Theory · Mathematics 2015-11-16 Jinyuan Chang , Bin Guo , Qiwei Yao

Sparse PCA is a widely used technique for high-dimensional data analysis. In this paper, we propose a new method called low-rank principal eigenmatrix analysis. Different from sparse PCA, the dominant eigenvectors are allowed to be dense…

Machine Learning · Statistics 2019-04-30 Krishna Balasubramanian , Elynn Y. Chen , Jianqing Fan , Xiang Wu

Low rank model arises from a wide range of applications, including machine learning, signal processing, computer algebra, computer vision, and imaging science. Low rank matrix recovery is about reconstructing a low rank matrix from…

Numerical Analysis · Mathematics 2018-09-12 Jian-Feng Cai , Ke Wei

Modeling of multidimensional signal using tensor is more convincing than representing it as a collection of matrices. The tensor based approaches can explore the abundant spatial and temporal structures of the mutlidimensional signal. The…

Signal Processing · Electrical Eng. & Systems 2019-12-10 Baburaj Madathil , Sameera V Mohd Sagheer , Abdu Rahiman , Anju Jose Tom , Baiju P S , Jobin Francis , Sudhish N. George

We develop latent variable models for Bayesian learning based low-rank matrix completion and reconstruction from linear measurements. For under-determined systems, the developed methods are shown to reconstruct low-rank matrices when…

Machine Learning · Statistics 2015-01-26 Martin Sundin , Cristian R. Rojas , Magnus Jansson , Saikat Chatterjee

We study a panel data model with general heterogeneous effects where slopes are allowed to vary across both individuals and over time. The key dimension reduction assumption we employ is that the heterogeneous slopes can be expressed as…

Statistics Theory · Mathematics 2019-09-05 Victor Chernozhukov , Christian Hansen , Yuan Liao , Yinchu Zhu

We consider robust low rank matrix estimation as a trace regression when outputs are contaminated by adversaries. The adversaries are allowed to add arbitrary values to arbitrary outputs. Such values can depend on any samples. We deal with…

Machine Learning · Statistics 2024-05-27 Takeyuki Sasai , Hironori Fujisawa

We propose new methods for multivariate linear regression when the regression coefficient matrix is sparse and the error covariance matrix is dense. We assume that the error covariance matrix has equicorrelation across the response…

Methodology · Statistics 2025-08-13 Daeyoung Ham , Bradley S. Price , Adam J. Rothman

Classical latent-score ranking models often fail to distinguish objects' intrinsic scores from contextual effects, which are typically nonlinear and can dominate the observed outcomes. To address this, we introduce a semiparametric ranking…

Methodology · Statistics 2026-04-22 Yuanhang Luo , Shuxing Fang , Ruijian Han , Yiming Xu

Learning systems often expand their ambient features or latent representations over time, embedding earlier representations into larger spaces with limited new latent structure. We study transfer learning for structured matrix estimation…

Machine Learning · Computer Science 2026-01-30 Jinhang Chai , Xuyuan Liu , Elynn Chen , Yujun Yan