English
Related papers

Related papers: Wedderburn rank reduction and Krylov subspace meth…

200 papers

This work studies the combinatorial optimization problem of finding an optimal core tensor shape, also called multilinear rank, for a size-constrained Tucker decomposition. We give an algorithm with provable approximation guarantees for its…

Data Structures and Algorithms · Computer Science 2024-06-19 Mehrdad Ghadiri , Matthew Fahrbach , Gang Fu , Vahab Mirrokni

In this paper, we propose a new adaptive cross algorithm for computing a low tubal rank approximation of third-order tensors, with less memory and lower computational complexity than the truncated tensor SVD (t-SVD). This makes it…

This paper is devoted to studying the application of the block Krylov subspace method for approximation of the truncated tensor SVD (T-SVD). The theoretical results of the proposed randomized approach are presented. Several experimental…

Numerical Analysis · Mathematics 2026-03-25 Malihe Nobakht Kooshkghazi , Salman Ahmadi-Asl , Andre L. F. de Almeida

This survey explores modern approaches for computing low-rank approximations of high-dimensional matrices by means of the randomized SVD, randomized subspace iteration, and randomized block Krylov iteration. The paper compares the…

Numerical Analysis · Mathematics 2023-09-25 Joel A. Tropp , Robert J. Webber

This work is concerned with approximating a trivariate function defined on a tensor-product domain via function evaluations. Combining tensorized Chebyshev interpolation with a Tucker decomposition of low multilinear rank yields function…

Numerical Analysis · Mathematics 2023-01-24 Sergey Dolgov , Daniel Kressner , Christoph Strössner

Low-rank approximation in data streams is a fundamental and significant task in computing science, machine learning and statistics. Multiple streaming algorithms have emerged over years and most of them are inspired by randomized…

Data Structures and Algorithms · Computer Science 2022-09-30 Cuiyu Liu , Chuanfu Xiao , Mingshuo Ding , Chao Yang

In intelligent transportation systems, traffic data imputation, estimating the missing value from partially observed data is an inevitable and challenging task. Previous studies have not fully considered traffic data's multidimensionality…

Machine Learning · Statistics 2023-11-01 Wenwu Gong , Zhejun Huang , Lili Yang

In this work, we explore the application of multilinear algebra in reducing the order of multidimentional linear time-invariant (MLTI) systems. We use tensor Krylov subspace methods as key tools, which involve approximating the system…

Numerical Analysis · Mathematics 2023-05-19 M. A. Hamadi , K. Jbilou , A. Ratnani

In this paper, we propose three approaches for the estimation of the Tucker decomposition of multi-way arrays (tensors) from partial observations. All approaches are formulated as convex minimization problems. Therefore, the minimum is…

Machine Learning · Statistics 2015-03-17 Ryota Tomioka , Kohei Hayashi , Hisashi Kashima

Low-tubal-rank tensor approximation has been proposed to analyze large-scale and multi-dimensional data. However, finding such an accurate approximation is challenging in the streaming setting, due to the limited computational resources. To…

Machine Learning · Computer Science 2021-08-24 Qianxin Yi , Chenhao Wang , Kaidong Wang , Yao Wang

Krylov subspace methods are a powerful tool for efficiently solving high-dimensional linear algebra problems. In this work, we study the approximation quality that a Krylov subspace provides for estimating the numerical range of a matrix.…

Numerical Analysis · Mathematics 2024-12-02 Cecilia Chen , John Urschel

In the realm of tensor optimization, the low-rank Tucker decomposition is crucial for reducing the number of parameters and for saving storage. We explore the geometry of Tucker tensor varieties -- the set of tensors with bounded Tucker…

Optimization and Control · Mathematics 2024-07-16 Bin Gao , Renfeng Peng , Ya-xiang Yuan

In this paper, we propose an algorithm for the construction of low-rank approximations of the inverse of an operator given in low-rank tensor format. The construction relies on an updated greedy algorithm for the minimization of a suitable…

Numerical Analysis · Mathematics 2017-05-11 Loic Giraldi , Anthony Nouy , Gregory Legrain

In this paper, we propose different algorithms for the solution of a tensor linear discrete ill-posed problem arising in the application of the meshless method for solving PDEs in three-dimensional space using multiquadric radial basis…

Numerical Analysis · Mathematics 2021-03-04 M. El Guide , K. Jbilou , A. Ratnani

In this paper, we investigate the use of multilinear algebra for reducing the order of multidimensional linear time-invariant (MLTI) systems. Our main tools are tensor rational Krylov subspace methods, which enable us to approximate the…

Numerical Analysis · Mathematics 2024-11-28 Houda Barkouki , Khalide Jbilou

To efficiently express tensor data using the Tucker format, a critical task is to minimize the multilinear rank such that the model would not be over-flexible and lead to overfitting. Due to the lack of rank minimization tools in tensor,…

Signal Processing · Electrical Eng. & Systems 2024-09-11 Xueke Tong , Hancheng Zhu , Lei Cheng , Yik-Chung Wu

In recent years, low-rank tensor completion (LRTC) has received considerable attention due to its applications in image/video inpainting, hyperspectral data recovery, etc. With different notions of tensor rank (e.g., CP, Tucker, tensor…

Machine Learning · Statistics 2020-10-30 Yunfeng Cai , Ping Li

We introduce the definition of tensorized block rational Krylov subspaces and its relation with multivariate rational functions, extending the formulation of tensorized Krylov subspaces introduced in [Kressner D., Tobler C., Krylov subspace…

Numerical Analysis · Mathematics 2023-06-02 Angelo Alberto Casulli

In the past few years powerful generalizations to the Euclidean k-means problem have been made, such as Bregman clustering [7], co-clustering (i.e., simultaneous clustering of rows and columns of an input matrix) [9,18], and tensor…

Data Structures and Algorithms · Computer Science 2009-11-09 Stefanie Jegelka , Suvrit Sra , Arindam Banerjee

In this work, we describe advanced numerical tools for working with multivariate functions and for the analysis of large data sets. These tools will drastically reduce the required computing time and the storage cost, and, therefore, will…

Numerical Analysis · Mathematics 2018-07-04 Alexander Litvinenko , David Keyes , Venera Khoromskaia , Boris N. Khoromskij , Hermann G. Matthies