English
Related papers

Related papers: Fast randomized algorithms for computing the gener…

200 papers

Efficiently computing a subset of a correlation matrix consisting of values above a specified threshold is important to many practical applications. Real-world problems in genomics, machine learning, finance other applications can produce…

Computation · Statistics 2016-03-15 James Baglama , Michael Kane , Bryan Lewis , Alex Poliakov

This paper is devoted to proposing a general weighted low-rank recovery model and designing a fast SVD-free computational scheme to solve it. First, our generic weighted low-rank recovery model unifies several existing approaches in the…

Optimization and Control · Mathematics 2022-08-02 Aritra Dutta , Jingwei Liang , Xin Li

What learning algorithms can be run directly on compressively-sensed data? In this work, we consider the question of accurately and efficiently computing low-rank matrix or tensor factorizations given data compressed via random projections.…

Machine Learning · Computer Science 2019-05-28 Vatsal Sharan , Kai Sheng Tai , Peter Bailis , Gregory Valiant

This paper introduces the $w$-product, a novel wavelet-based tensor multiplication scheme leveraging second-generation wavelet transforms to achieve linear transformation complexity while preserving essential algebraic properties. The…

Numerical Analysis · Mathematics 2026-01-14 Aneesh Panchal , Ratikanta Behera

Large tensors are frequently encountered in various fields such as computer vision, scientific simulations, sensor networks, and data mining. However, these tensors are often too large for convenient processing, transfer, or storage.…

Optimization and Control · Mathematics 2024-09-26 Zhiguang Cheng , Gaohang Yu , Xiaohao Cai , Liqun Qi

We show how to construct nonnegative low-rank approximations of nonnegative tensors in Tucker and tensor train formats. We use alternating projections between the nonnegative orthant and the set of low-rank tensors, using STHOSVD and TTSVD…

Numerical Analysis · Mathematics 2023-04-25 Azamat Sultonov , Sergey Matveev , Stanislav Budzinskiy

Randomization has emerged as a powerful set of tools for large-scale matrix and tensor decompositions. Randomized algorithms involve computing sketches with random matrices. A prevalent approach is to take the random matrix as a standard…

Numerical Analysis · Mathematics 2026-04-02 Arvind K. Saibaba , Bhisham Dev Verma , Grey Ballard

Boolean tensor has been broadly utilized in representing high dimensional logical data collected on spatial, temporal and/or other relational domains. Boolean Tensor Decomposition (BTD) factorizes a binary tensor into the Boolean sum of…

Machine Learning · Computer Science 2020-10-28 Changlin Wan , Wennan Chang , Tong Zhao , Sha Cao , Chi Zhang

Video tokenization procedure is critical for a wide range of video processing tasks. Most existing approaches directly transform video into fixed-grid and patch-wise tokens, which exhibit limited versatility. Spatially, uniformly allocating…

Computer Vision and Pattern Recognition · Computer Science 2025-08-18 Zhenghao Chen , Zicong Chen , Lei Liu , Yiming Wu , Dong Xu

We consider the problem of decomposing higher-order moment tensors, i.e., the sum of symmetric outer products of data vectors. Such a decomposition can be used to estimate the means in a Gaussian mixture model and for other applications in…

Numerical Analysis · Mathematics 2020-10-06 Samantha Sherman , Tamara G. Kolda

Solving the generalized eigenvalue problem is a useful method for finding energy eigenstates of large quantum systems. It uses projection onto a set of basis states which are typically not orthogonal. One needs to invert a matrix whose…

Nuclear Theory · Physics 2023-04-05 Caleb Hicks , Dean Lee

Stein variational gradient descent (SVGD) is a kernel-based and non-parametric particle method for sampling from a target distribution, such as in Bayesian inference and other machine learning tasks. Different from other particle methods,…

Optimization and Control · Mathematics 2025-10-02 Viktor Stein , Wuchen Li

This paper presents a randomized quaternion singular value decomposition (QSVD) algorithm for low-rank matrix approximation problems, which are widely used in color face recognition, video compression, and signal processing problems. With…

Numerical Analysis · Mathematics 2021-12-28 Qiaohua Liu , Sitao Ling , Zhigang Jia

This paper presents iterative methods for solving tensor equations involving the T-product. The proposed approaches apply tensor computations without matrix construction. For each initial tensor, these algorithms solve related problems in a…

Numerical Analysis · Mathematics 2025-04-28 Malihe Nobakht Kooshkghazi , Salman Ahmadi-Asl , Hamidreza Afshin

In this paper a new dictionary learning algorithm for multidimensional data is proposed. Unlike most conventional dictionary learning methods which are derived for dealing with vectors or matrices, our algorithm, named KTSVD, learns a…

Machine Learning · Computer Science 2016-01-01 Zemin Zhang , Shuchin Aeron

The present paper is concerned with developing tensor iterative Krylov subspace methods to solve large multi-linear tensor equations. We use the well-known T-product for two tensors to define tensor global Arnoldi and tensor global…

Numerical Analysis · Mathematics 2020-06-15 M. El Guide , A. El Ichi , K. Jbilou , R. Sadaka

In order to compute fast approximations to the singular value decompositions (SVD) of very large matrices, randomized sketching algorithms have become a leading approach. However, a key practical difficulty of sketching an SVD is that the…

Machine Learning · Statistics 2020-03-12 Miles E. Lopes , N. Benjamin Erichson , Michael W. Mahoney

The singular value decomposition (SVD) of a matrix is a powerful tool for many matrix computation problems. In this paper, we consider generalizing the standard SVD to analyze and compute the regularized solution of linear ill-posed…

Numerical Analysis · Mathematics 2023-12-19 Haibo Li

Dynamic mode decomposition (DMD) is a data-driven method for estimating the dynamics of a discrete dynamical system. This paper proposes a tensor-based approach to DMD for applications in which the states can be viewed as tensors.…

Numerical Analysis · Mathematics 2025-08-15 Arvind K. Saibaba , Misha E. Kilmer , Khalil Hall-Hooper , Fan Tian , Alex Mize

Tensor ring (TR) decomposition has recently received increased attention due to its superior expressive performance for high-order tensors. However, the applicability of traditional TR decomposition algorithms to real-world applications is…

Machine Learning · Computer Science 2023-05-17 Yicong He , George K. Atia