English
Related papers

Related papers: RTSMS: Randomized Tucker with single-mode sketchin…

200 papers

We study low rank approximation of tensors, focusing on the tensor train and Tucker decompositions, as well as approximations with tree tensor networks and more general tensor networks. For tensor train decomposition, we give a bicriteria…

Data Structures and Algorithms · Computer Science 2023-11-28 Arvind V. Mahankali , David P. Woodruff , Ziyu Zhang

Tensor train decomposition is a powerful tool for dealing with high-dimensional, large-scale tensor data, which is not suffering from the curse of dimensionality. To accelerate the calculation of the auxiliary unfolding matrix, some…

Numerical Analysis · Mathematics 2023-08-08 Gaohang Yu , Jinhong Feng , Zhongming Chen , Xiaohao Cai , Liqun Qi

In this paper, we develop a novel procedure for low-rank tensor regression, namely \emph{\underline{I}mportance \underline{S}ketching \underline{L}ow-rank \underline{E}stimation for \underline{T}ensors} (ISLET). The central idea behind…

Machine Learning · Statistics 2020-05-11 Anru Zhang , Yuetian Luo , Garvesh Raskutti , Ming Yuan

We present a new Krylov subspace recycling method for solving a linear system of equations, or a sequence of slowly changing linear systems. Our approach is to reduce the computational overhead of recycling techniques while still benefiting…

Numerical Analysis · Mathematics 2024-09-30 Liam Burke , Stefan Güttel , Kirk M. Soodhalter

Signal decomposition and multiscale signal analysis provide many useful tools for time-frequency analysis. We proposed a random feature method for analyzing time-series data by constructing a sparse approximation to the spectrogram. The…

Signal Processing · Electrical Eng. & Systems 2023-03-17 Nicholas Richardson , Hayden Schaeffer , Giang Tran

This paper is concerned with the low Tucker-rank tensor completion problem, which is about reconstructing a tensor $ T \in\mathbb{R}^{n\times n \times n}$ of low multilinear rank from partially observed entries. Riemannian optimization…

Optimization and Control · Mathematics 2023-08-03 Haifeng Wang , Jinchi Chen , Ke Wei

Tensor rank and low-rank tensor decompositions have many applications in learning and complexity theory. Most known algorithms use unfoldings of tensors and can only handle rank up to $n^{\lfloor p/2 \rfloor}$ for a $p$-th order tensor in…

Data Structures and Algorithms · Computer Science 2015-04-23 Rong Ge , Tengyu Ma

Dimensionality reduction is an essential technique for multi-way large-scale data, i.e., tensor. Tensor ring (TR) decomposition has become popular due to its high representation ability and flexibility. However, the traditional TR…

Numerical Analysis · Mathematics 2024-12-20 Longhao Yuan , Chao Li , Jianting Cao , Qibin Zhao

Tensors or multiarray data are generalizations of matrices. Tensor clustering has become a very important research topic due to the intrinsically rich structures in real-world multiarray datasets. Subspace clustering based on vectorizing…

Computer Vision and Pattern Recognition · Computer Science 2015-04-30 Yanfeng Sun , Junbin Gao , Xia Hong , Bamdev Mishra , Baocai Yin

In this work, we develop an optimization framework for problems whose solutions are well-approximated by Hierarchical Tucker (HT) tensors, an efficient structured tensor format based on recursive subspace factorizations. By exploiting the…

Numerical Analysis · Mathematics 2014-05-12 Curt Da Silva , Felix J. Herrmann

We consider a novel algorithm, for the completion of partially observed low-rank tensors, as a generalization of matrix completion. The proposed low-rank tensor completion (TC) method builds on the conventional nuclear norm (NN)…

Machine Learning · Statistics 2026-05-06 Niclas Führling , Getuar Rexhepi , Giuseppe Thadeu Freitas de Abreu

We comment on two randomized algorithms for constructing low-rank matrix decompositions. Both algorithms employ the Subsampled Randomized Hadamard Transform [14]. The first algorithm appeared recently in [9]; here, we provide a novel…

Data Structures and Algorithms · Computer Science 2012-04-04 Christos Boutsidis

Tensor Factor Models (TFM) are appealing dimension reduction tools for high-order large-dimensional tensor time series, and have wide applications in economics, finance and medical imaging. In this paper, we propose a projection estimator…

Methodology · Statistics 2025-03-03 Matteo Barigozzi , Yong He , Lingxiao Li , Lorenzo Trapani

In the realm of tensor optimization, the low-rank Tucker decomposition is crucial for reducing the number of parameters and for saving storage. We explore the geometry of Tucker tensor varieties -- the set of tensors with bounded Tucker…

Optimization and Control · Mathematics 2024-07-16 Bin Gao , Renfeng Peng , Ya-xiang Yuan

This paper concerns a fundamental class of convex matrix optimization problems. It presents the first algorithm that uses optimal storage and provably computes a low-rank approximation of a solution. In particular, when all solutions have…

Optimization and Control · Mathematics 2017-02-23 Alp Yurtsever , Madeleine Udell , Joel A. Tropp , Volkan Cevher

We consider statistical and algorithmic aspects of solving large-scale least-squares (LS) problems using randomized sketching algorithms. Prior results show that, from an \emph{algorithmic perspective}, when using sketching matrices…

Machine Learning · Statistics 2015-05-26 Garvesh Raskutti , Michael Mahoney

This paper focuses on recovering a low-rank tensor from its incomplete measurements. We propose a novel algorithm termed the Single Mode Quasi Riemannian Gradient Descent (SM-QRGD). By exploiting the benefits of both fixed-rank matrix…

Optimization and Control · Mathematics 2024-01-30 Yuanwei Zhang , Ya-Nan Zhu , Xiaoqun Zhang

Tensor-valued data arise naturally in multidimensional signal and imaging problems, such as biomedical imaging. When incorporated into generalized linear models (GLMs), naive vectorization can destroy their multi-way structure and lead to…

Machine Learning · Statistics 2026-04-07 Xiao Liang , Shuang Li

Multi-dimensional data completion is a critical problem in computational sciences, particularly in domains such as computer vision, signal processing, and scientific computing. Existing methods typically leverage either global low-rank…

Machine Learning · Computer Science 2025-08-07 Wenwu Gong , Lili Yang

Spectral clustering has been one of the widely used methods for community detection in networks. However, large-scale networks bring computational challenges to the eigenvalue decomposition therein. In this paper, we study the spectral…

Social and Information Networks · Computer Science 2022-01-07 Hai Zhang , Xiao Guo , Xiangyu Chang