English
Related papers

Related papers: Very Large-Scale Singular Value Decomposition Usin…

200 papers

In this paper, we focus on the fixed TT-rank and precision problems of finding an approximation of the tensor train (TT) decomposition of a tensor. Note that the TT-SVD and TT-cross are two well-known algorithms for these two problems.…

Numerical Analysis · Mathematics 2025-02-11 Maolin Che , Yimin Wei , Hong Yan

In real-world scenarios, complex data such as multispectral images and multi-frame videos inherently exhibit robust low-rank property. This property is vital for multi-dimensional inverse problems, such as tensor completion, spectral…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Xiangming Wang , Haijin Zeng , Jiaoyang Chen , Sheng Liu , Yongyong Chen , Guoqing Chao

Low-rank approximation of images via singular value decomposition is well-received in the era of big data. However, singular value decomposition (SVD) is only for order-two data, i.e., matrices. It is necessary to flatten a higher order…

Machine Learning · Computer Science 2022-08-26 Liang Liao , Sen Lin , Lun Li , Xiuwei Zhang , Song Zhao , Yan Wang , Xinqiang Wang , Qi Gao , Jingyu Wang

Tensor networks have in recent years emerged as the powerful tools for solving the large-scale optimization problems. One of the most popular tensor network is tensor train (TT) decomposition that acts as the building blocks for the…

Numerical Analysis · Computer Science 2016-06-20 Qibin Zhao , Guoxu Zhou , Shengli Xie , Liqing Zhang , Andrzej Cichocki

Tensor train (TT) format is a common approach for computationally efficient work with multidimensional arrays, vectors, matrices, and discretized functions in a wide range of applications, including computational mathematics and machine…

Numerical Analysis · Mathematics 2022-09-30 Andrei Chertkov , Gleb Ryzhakov , Georgii Novikov , Ivan Oseledets

The singular value decomposition (SVD) of large-scale matrices is a key tool in data analytics and scientific computing. The rapid growth in the size of matrices further increases the need for developing efficient large-scale SVD…

Numerical Analysis · Mathematics 2016-08-31 Ting-Li Chen , Dawei D. Chang , Su-Yun Huang , Hung Chen , Chienyao Lin , Weichung Wang

The singular value decomposition (SVD) is a crucial tool in machine learning and statistical data analysis. However, it is highly susceptible to outliers in the data matrix. Existing robust SVD algorithms often sacrifice speed for…

Machine Learning · Statistics 2024-02-16 Sangil Han , Kyoowon Kim , Sungkyu Jung

The Singular Value Decomposition (SVD) of matrices is a widely used tool in scientific computing. In many applications of machine learning, data analysis, signal and image processing, the large datasets are structured into tensors, for…

Numerical Analysis · Mathematics 2023-11-07 Anas El Hachimi , Khalide Jbilou , Mustapha Hached , Ahmed Ratnani

In this paper we review basic and emerging models and associated algorithms for large-scale tensor networks, especially Tensor Train (TT) decompositions using novel mathematical and graphical representations. We discus the concept of…

Numerical Analysis · Computer Science 2014-08-25 Andrzej Cichocki

An efficient, accurate and reliable approximation of a matrix by one of lower rank is a fundamental task in numerical linear algebra and signal processing applications. In this paper, we introduce a new matrix decomposition approach termed…

Numerical Analysis · Computer Science 2018-08-15 Maboud F. Kaloorazi , Rodrigo C. de Lamare

This paper surveys randomized algorithms in numerical linear algebra for low-rank decompositions of matrices and tensors. The survey begins with a review of classical matrix algorithms that can be accelerated by randomized dimensionality…

Numerical Analysis · Mathematics 2026-01-01 Katherine J. Pearce , Per-Gunnar Martinsson

This paper studies a general framework for high-order tensor SVD. We propose a new computationally efficient algorithm, tensor-train orthogonal iteration (TTOI), that aims to estimate the low tensor-train rank structure from the noisy…

Statistics Theory · Mathematics 2022-01-26 Yuchen Zhou , Anru R. Zhang , Lili Zheng , Yazhen Wang

In this paper, we propose a general framework for tensor singular value decomposition (tensor SVD), which focuses on the methodology and theory for extracting the hidden low-rank structure from high-dimensional tensor data. Comprehensive…

Statistics Theory · Mathematics 2020-01-09 Anru Zhang , Dong Xia

We consider an approximate computation of several minimal eigenpairs of large Hermitian matrices which come from high--dimensional problems. We use the tensor train format (TT) for vectors and matrices to overcome the curse of…

Numerical Analysis · Mathematics 2014-03-05 Sergey V. Dolgov , Boris N. Khoromskij , Ivan V. Oseledets , Dmitry V. Savostyanov

Singular Value Decomposition (SVD) is one of the most useful techniques for analyzing data in linear algebra. SVD decomposes a rectangular real or complex matrix into two orthogonal matrices and one diagonal matrix. In this work we…

Quantum Physics · Physics 2012-07-31 Laszlo Gyongyosi , Sandor Imre

The tensor Singular Value Decomposition (t-SVD) for third order tensors that was proposed by Kilmer and Martin~\cite{2011kilmer} has been applied successfully in many fields, such as computed tomography, facial recognition, and video…

Numerical Analysis · Mathematics 2016-09-23 Jiani Zhang , Arvind K. Saibaba , Misha Kilmer , Shuchin Aeron

This paper introduces the functional tensor singular value decomposition (FTSVD), a novel dimension reduction framework for tensors with one functional mode and several tabular modes. The problem is motivated by high-order longitudinal data…

Methodology · Statistics 2023-10-27 Rungang Han , Pixu Shi , Anru R. Zhang

We propose an efficient, distributed, out-of-memory implementation of the truncated singular value decomposition (t-SVD) for heterogeneous (CPU+GPU) high performance computing (HPC) systems. Various implementations of SVD have been…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-08-18 Ismael Boureima , Manish Bhattarai , Maksim E. Eren , Nick Solovyev , Hristo Djidjev , Boian S. Alexandrov

Efficiently computing a subset of a correlation matrix consisting of values above a specified threshold is important to many practical applications. Real-world problems in genomics, machine learning, finance other applications can produce…

Computation · Statistics 2016-03-15 James Baglama , Michael Kane , Bryan Lewis , Alex Poliakov

Efficient and fast computation of a tensor singular value decomposition (t-SVD) with a few passes over the underlying data tensor is crucial because of its many potential applications. The current/existing subspace randomized algorithms…

Numerical Analysis · Mathematics 2025-02-10 Salman Ahmadi-Asl , Anh-Huy Phan , Andrzej Cichocki