English
Related papers

Related papers: Tensor Decomposition Meets RKHS: Efficient Algorit…

200 papers

This paper introduces matrix product state (MPS) decomposition as a new and systematic method to compress multidimensional data represented by higher-order tensors. It solves two major bottlenecks in tensor compression: computation and…

Machine Learning · Statistics 2017-08-02 Johann A. Bengua , Ho N. Phien , Hoang D. Tuan , Minh N. Do

Low-rank tensor factorization or completion is well-studied and applied in various online settings, such as online tensor factorization (where the temporal mode grows) and online tensor completion (where incomplete slices arrive gradually).…

Machine Learning · Computer Science 2022-05-10 Chaoqi Yang , Cheng Qian , Jimeng Sun

Tensor CANDECOMP/PARAFAC (CP) decomposition is an important tool that solves a wide class of machine learning problems. Existing popular approaches recover components one by one, not necessarily in the order of larger components first.…

Machine Learning · Statistics 2020-01-01 Furong Huang , Jialin Li , Xuchen You

In this paper, we define a semi-tensor product for third-order tensors. Based on this definition, we present a new type of tensor decomposition strategy and give the specific algorithm. This decomposition strategy actually generalizes the…

Numerical Analysis · Mathematics 2023-01-18 Zhuo-Ran Chen , Seak-Weng Vong , Ze-Jia Xie

This paper provides a general solution for the Kronecker product decomposition (KPD) of vectors, matrices, and hypermatrices. First, an algorithm, namely, monic decomposition algorithm (MDA), is reviewed. It consists of a set of projections…

Numerical Analysis · Mathematics 2025-09-29 Daizhan Cheng

The block-term tensor decomposition model with multilinear rank-$(L_r,L_r,1)$ terms (or, the "LL1 tensor decomposition" in short) offers a valuable alternative for hyperspectral unmixing (HU) under the linear mixture model. Particularly,…

Signal Processing · Electrical Eng. & Systems 2022-05-10 Meng Ding , Xiao Fu , Xi-Le Zhao

Recurrent Neural Networks (RNNs) have been widely used in sequence analysis and modeling. However, when processing high-dimensional data, RNNs typically require very large model sizes, thereby bringing a series of deployment challenges.…

Machine Learning · Computer Science 2020-05-12 Miao Yin , Siyu Liao , Xiao-Yang Liu , Xiaodong Wang , Bo Yuan

Tensor decomposition has emerged as a powerful framework for feature extraction in multi-modal biomedical data. In this review, we present a comprehensive analysis of tensor decomposition methods such as Tucker, CANDECOMP/PARAFAC, spiked…

Tensor decomposition is a fundamental method used in various areas to deal with high-dimensional data. \emph{Tensor power method} (TPM) is one of the widely-used techniques in the decomposition of tensors. This paper presents a novel tensor…

Machine Learning · Computer Science 2023-06-02 Yichuan Deng , Zhao Song , Junze Yin

Tensor computation has emerged as a powerful mathematical tool for solving high-dimensional and/or extreme-scale problems in science and engineering. The last decade has witnessed tremendous advancement of tensor computation and its…

Signal Processing · Electrical Eng. & Systems 2019-07-05 Kaiqi Zhang , Xiyuan Zhang , Zheng Zhang

Many real-world datasets are represented as tensors, i.e., multi-dimensional arrays of numerical values. Storing them without compression often requires substantial space, which grows exponentially with the order. While many tensor…

Machine Learning · Computer Science 2023-09-21 Taehyung Kwon , Jihoon Ko , Jinhong Jung , Kijung Shin

This work revisits coupled tensor decomposition (CTD)-based hyperspectral super-resolution (HSR). HSR aims at fusing a pair of hyperspectral and multispectral images to recover a super-resolution image (SRI). The vast majority of the HSR…

Signal Processing · Electrical Eng. & Systems 2021-04-21 Meng Ding , Xiao Fu , Ting-Zhu Huang , Jun Wang , Xi-Le Zhao

In this paper, we introduce a unified framework of Tensor Higher-Degree Eigenvalue Complementarity Problem (THDEiCP), which goes beyond the framework of the typical Quadratic Eigenvalue Complementarity Problem (QEiCP) for matrices. First,…

Optimization and Control · Mathematics 2015-07-15 Chen Ling , Hongjin He , Liqun Qi

Deep neural networks (DNNs) have enabled impressive breakthroughs in various artificial intelligence (AI) applications recently due to its capability of learning high-level features from big data. However, the current demand of DNNs for…

Computer Vision and Pattern Recognition · Computer Science 2020-09-22 Bijiao Wu , Dingheng Wang , Guangshe Zhao , Lei Deng , Guoqi Li

One of the main issues in computing a tensor decomposition is how to choose the number of rank-one components, since there is no finite algorithms for determining the rank of a tensor. A commonly used approach for this purpose is to find a…

Computer Vision and Pattern Recognition · Computer Science 2023-09-15 Claudio Turchetti

The Semi-Algebraic framework for the approximate Canonical Polyadic (CP) decomposition via SImultaneaous matrix diagonalization (SECSI) is an efficient tool for the computation of the CP decomposition. The SECSI framework reformulates the…

Information Theory · Computer Science 2017-10-19 Sher Ali Cheema , Emilio Rafael Balda , Yao Cheng , Martin Haardt , Amir Weiss , Arie Yeredor

This paper introduces the functional tensor singular value decomposition (FTSVD), a novel dimension reduction framework for tensors with one functional mode and several tabular modes. The problem is motivated by high-order longitudinal data…

Methodology · Statistics 2023-10-27 Rungang Han , Pixu Shi , Anru R. Zhang

We present a general framework to learn functions in tensor product reproducing kernel Hilbert spaces (TP-RKHSs). The methodology is based on a novel representer theorem suitable for existing as well as new spectral penalties for tensors.…

Machine Learning · Computer Science 2013-10-21 Marco Signoretto , Lieven De Lathauwer , Johan A. K. Suykens

We present a novel analysis of the dynamics of tensor power iterations in the overcomplete regime where the tensor CP rank is larger than the input dimension. Finding the CP decomposition of an overcomplete tensor is NP-hard in general. We…

Machine Learning · Computer Science 2015-09-16 Anima Anandkumar , Rong Ge , Majid Janzamin

Tensor completion estimates missing components by exploiting the low-rank structure of multi-way data. The recently proposed methods based on tensor train (TT) and tensor ring (TR) show better performance in image recovery than classical…

Machine Learning · Computer Science 2020-04-24 Huyan Huang , Yipeng Liu , Ce Zhu