English
Related papers

Related papers: An Efficient and Interpretable Autoregressive Mode…

200 papers

Tensor train (TT) decomposition is a powerful representation for high-order tensors, which has been successfully applied to various machine learning tasks in recent years. However, since the tensor product is not commutative, permutation of…

Numerical Analysis · Computer Science 2017-05-31 Qibin Zhao , Masashi Sugiyama , Andrzej Cichocki

This work considers low-rank canonical polyadic decomposition (CPD) under a class of non-Euclidean loss functions that frequently arise in statistical machine learning and signal processing. These loss functions are often used for certain…

Machine Learning · Statistics 2022-05-11 Wenqiang Pu , Shahana Ibrahim , Xiao Fu , Mingyi Hong

We propose a new cross-conv algorithm for approximate computation of convolution in different low-rank tensor formats (tensor train, Tucker, Hierarchical Tucker). It has better complexity with respect to the tensor rank than previous…

Numerical Analysis · Mathematics 2016-09-07 M. V. Rakhuba , I. V. Oseledets

Tensor decomposition is a well-known tool for multiway data analysis. This work proposes using stochastic gradients for efficient generalized canonical polyadic (GCP) tensor decomposition of large-scale tensors. GCP tensor decomposition is…

Numerical Analysis · Mathematics 2020-11-25 Tamara G. Kolda , David Hong

The letter proposes an adaptive model reduction approach based on tensor decomposition to speed up time-domain power system simulation. Taylor series expansion of a power system dynamic model is calculated around multiple equilibria…

Systems and Control · Computer Science 2019-04-02 Denis Osipov , Kai Sun

We study tensor completion (TC) through the lens of low-rank tensor decomposition (TD). Many TD algorithms use fast alternating minimization methods to solve highly structured linear regression problems at each step (e.g., for CP, Tucker,…

Data Structures and Algorithms · Computer Science 2025-08-13 Mehrdad Ghadiri , Matthew Fahrbach , Yunbum Kook , Ali Jadbabaie

Recently, introducing Tensor Decomposition (TD) techniques into unsupervised feature selection (UFS) has been an emerging research topic. A tensor structure is beneficial for mining the relations between different modes and helps relieve…

Machine Learning · Computer Science 2025-07-04 Junjing Zheng , Xinyu Zhang , Weidong Jiang , Xiangfeng Qiu , Mingjian Ren

Many problems in computational neuroscience, neuroinformatics, pattern/image recognition, signal processing and machine learning generate massive amounts of multidimensional data with multiple aspects and high dimensionality. Tensors (i.e.,…

Emerging Technologies · Computer Science 2014-08-26 Andrzej Cichocki

Dimensionality reduction for high-order tensors is a challenging problem. In conventional approaches, higher order tensors are `vectorized` via Tucker decomposition to obtain lower order tensors. This will destroy the inherent high-order…

Computer Vision and Pattern Recognition · Computer Science 2017-07-04 Fujiao Ju , Yanfeng Sun , Junbin Gao , Yongli Hu , Baocai Yin

This paper introduces a novel method for approximating the dynamics of a large autonomous system projected onto a fixed subspace. The core contribution is a novel recursive algorithm to construct an effective time-dependent generator that…

Quantum Physics · Physics 2025-10-24 Tommaso Grigoletto

We propose an isogeometric solver for Poisson problems that combines i)low-rank tensor techniques to approximate the unknown solution and the system matrix, as a sum of a few terms having Kronecker product structure, ii) a Truncated…

Numerical Analysis · Mathematics 2023-09-29 Monica Montardini , Giancarlo Sangalli , Mattia Tani

Recovering a low-rank matrix from highly corrupted measurements arises in compressed sensing of structured high-dimensional signals (e.g., videos and hyperspectral images among others). Robust principal component analysis (RPCA), solved via…

Optimization and Control · Mathematics 2022-06-28 Vahan Hovhannisyan , Yannis Panagakis , Panos Parpas , Stefanos Zafeiriou

The modern convolutional neural networks although achieve great results in solving complex computer vision tasks still cannot be effectively used in mobile and embedded devices due to the strict requirements for computational complexity,…

Computer Vision and Pattern Recognition · Computer Science 2020-06-17 Nikolay Kozyrskiy , Anh-Huy Phan

The CP tensor decomposition is a low-rank approximation of a tensor. We present a distributed-memory parallel algorithm and implementation of an alternating optimization method for computing a CP decomposition of dense tensor data that can…

Numerical Analysis · Computer Science 2018-06-22 Grey Ballard , Koby Hayashi , Ramakrishnan Kannan

The CANDECOMP/PARAFAC (CP) decomposition is a leading method for the analysis of multiway data. The standard alternating least squares algorithm for the CP decomposition (CP-ALS) involves a series of highly overdetermined linear least…

Numerical Analysis · Computer Science 2018-08-23 Casey Battaglino , Grey Ballard , Tamara G. Kolda

Tucker decomposition is a powerful tensor model to handle multi-aspect data. It demonstrates the low-rank property by decomposing the grid-structured data as interactions between a core tensor and a set of object representations (factors).…

Machine Learning · Computer Science 2024-03-20 Shikai Fang , Xin Yu , Zheng Wang , Shibo Li , Mike Kirby , Shandian Zhe

Tensors have broad applications in neuroimaging, data mining, digital marketing, etc. CANDECOMP/PARAFAC (CP) tensor decomposition can effectively reduce the number of parameters to gain dimensionality-reduction and thus plays a key role in…

Statistics Theory · Mathematics 2023-11-23 Qiushi Bu , Hua Liang , Xinyu Zhang , Jiahui Zou

There is an emerging interest in tensor factorization applications in big-data analytics and machine learning. To speed up the factorization of extra-large datasets, organized in multidimensional arrays (aka tensors), easy to compute…

Numerical Analysis · Mathematics 2022-03-23 Boian Alexandrov , Derek DeSantis , Gianmarco Manzini , Erik Skau

We study low rank approximation of tensors, focusing on the tensor train and Tucker decompositions, as well as approximations with tree tensor networks and more general tensor networks. For tensor train decomposition, we give a bicriteria…

Data Structures and Algorithms · Computer Science 2023-11-28 Arvind V. Mahankali , David P. Woodruff , Ziyu Zhang

Recent papers have developed alternating least squares (ALS) methods for CP and tensor ring decomposition with a per-iteration cost which is sublinear in the number of input tensor entries for low-rank decomposition. However, the…

Numerical Analysis · Mathematics 2022-06-22 Osman Asif Malik