English
Related papers

Related papers: Statistical and computational rates in high rank t…

200 papers

Spectral variations pose a common challenge in analyzing hyperspectral images (HSI). To address this, low-rank tensor representation has emerged as a robust strategy, leveraging inherent correlations within HSI data. However, the spatial…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Bo Han , Yuheng Jia , Hui Liu , Junhui Hou

Tensors are a natural way to express correlations among many physical variables, but storing tensors in a computer naively requires memory which scales exponentially in the rank of the tensor. This is not optimal, as the required memory is…

Computational Physics · Physics 2018-12-03 Adam S. Jermyn

In this paper, we consider the singular values and singular vectors of low rank perturbations of large rectangular random matrices, in the regime the matrix is "long": we allow the number of rows (columns) to grow polynomially in the number…

Probability · Mathematics 2021-10-22 Gérard Ben Arous , Daniel Zhengyu Huang , Jiaoyang Huang

Beyond their origin in modeling many-body quantum systems, tensor networks have emerged as a promising class of models for solving machine learning problems, notably in unsupervised generative learning. While possessing many desirable…

Machine Learning · Computer Science 2024-07-26 Alex Meiburg , Jing Chen , Jacob Miller , Raphaëlle Tihon , Guillaume Rabusseau , Alejandro Perdomo-Ortiz

As tensor-valued data become increasingly common in time series analysis, there is a growing need for flexible and interpretable models that can handle high-dimensional predictors and responses across multiple modes. We propose a unified…

Methodology · Statistics 2025-06-10 Shibo Li , Yao Zheng

Tensors, which provide a powerful and flexible model for representing multi-attribute data and multi-way interactions, play an indispensable role in modern data science across various fields in science and engineering. A fundamental task is…

Machine Learning · Computer Science 2022-06-23 Tian Tong , Cong Ma , Ashley Prater-Bennette , Erin Tripp , Yuejie Chi

Tensor networks are used to efficiently approximate states of strongly-correlated quantum many-body systems. More generally, tensor network approximations may allow to reduce the costs for operating on an order-$N$ tensor from exponential…

Strongly Correlated Electrons · Physics 2022-05-31 Hao Chen , Thomas Barthel

Tensor decomposition is a mathematically supported technique for data compression. It consists of applying some kind of a Low Rank Decomposition technique on the tensors or matrices in order to reduce the redundancy of the data. However, it…

Machine Learning · Computer Science 2025-05-27 Habib Hajimolahoseini , Walid Ahmed , Austin Wen , Yang Liu

This study aims to solve the over-reliance on the rank estimation strategy in the standard tensor factorization-based tensor recovery and the problem of a large computational cost in the standard t-SVD-based tensor recovery. To this end, we…

Machine Learning · Computer Science 2023-05-22 Jingjing Zheng , Wenzhe Wang , Xiaoqin Zhang , Xianta Jiang

This paper proposes a novel formulation of the tensor completion problem to impute missing entries of data represented by tensors. The formulation is introduced in terms of tensor train (TT) rank which can effectively capture global…

Numerical Analysis · Computer Science 2016-01-07 Ho N. Phien , Hoang D. Tuan , Johann A. Bengua , Minh N. Do

High-order clustering aims to classify objects in multiway datasets that are prevalent in various fields such as bioinformatics, recommendation systems, and social network analysis. Such data are often sparse and high-dimensional, posing…

Statistics Theory · Mathematics 2025-12-05 Ian Välimaa , Lasse Leskelä

Structured distributions, i.e. distributions over combinatorial spaces, are commonly used to learn latent probabilistic representations from observed data. However, scaling these models is bottlenecked by the high computational and memory…

Computation and Language · Computer Science 2022-01-11 Justin T. Chiu , Yuntian Deng , Alexander M. Rush

Conventional topology learning methods for dynamical networks become inapplicable to processes exhibiting low-rank characteristics. To address this, we propose the low rank dynamical network model which ensures identifiability. By employing…

Graphics · Computer Science 2025-11-11 Wenqi Cao , Aming Li

All neuroimaging modalities have their own strengths and limitations. A current trend is toward interdisciplinary approaches that use multiple imaging methods to overcome limitations of each method in isolation. At the same time…

Methodology · Statistics 2023-03-30 Pratim Guha Niyogi , Martin A. Lindquist , Tapabrata Maiti

We study the problem of learning latent variables in Gaussian graphical models. Existing methods for this problem assume that the precision matrix of the observed variables is the superposition of a sparse and a low-rank component. In this…

Machine Learning · Statistics 2017-07-12 Mohammadreza Soltani , Chinmay Hegde

Using a low-dimensional parametrization of signals is a generic and powerful way to enhance performance in signal processing and statistical inference. A very popular and widely explored type of dimensionality reduction is sparsity; another…

Statistics Theory · Mathematics 2020-04-02 Benjamin Aubin , Bruno Loureiro , Antoine Maillard , Florent Krzakala , Lenka Zdeborová

Data tensors of orders 2 and greater are now routinely being generated. These data collections are increasingly huge and growing. Many scientific and medical data tensors are tensor fields (e.g., images, videos, geographic data) in which…

Machine Learning · Computer Science 2024-03-12 Taemin Heo , Chandrajit Bajaj

For a given symmetric tensor, we aim at finding a new one whose symmetric rank is small and that is close to the given one. There exist linear relations among the entries of low rank symmetric tensors. Such linear relations can be expressed…

Numerical Analysis · Mathematics 2017-09-08 Jiawang Nie

There has been considerable recent interest in Bayesian modeling of high-dimensional networks via latent space approaches. When the number of nodes increases, estimation based on Markov Chain Monte Carlo can be extremely slow and show poor…

Computation · Statistics 2022-05-30 Emanuele Aliverti , Massimiliano Russo

Factor model is an appealing and effective analytic tool for high-dimensional time series, with a wide range of applications in economics, finance and statistics. This paper develops two criteria for the determination of the number of…

Methodology · Statistics 2022-05-09 Yuefeng Han , Rong Chen , Cun-Hui Zhang