English
Related papers

Related papers: A Coupled Random Projection Approach to Large-Scal…

200 papers

Big data analysis has become a crucial part of new emerging technologies such as the internet of things, cyber-physical analysis, deep learning, anomaly detection, etc. Among many other techniques, dimensionality reduction plays a key role…

The Canonical Polyadic (CP) tensor decomposition is frequently used as a model in applications in a variety of different fields. Using jackknife resampling to estimate parameter uncertainties is often desirable but results in an increase of…

Mathematical Software · Computer Science 2022-04-14 Christos Psarras , Lars Karlsson , Rasmus Bro , Paolo Bientinesi

Canonical Polyadic (also known as Candecomp/Parafac) Decomposition (CPD) of a higher-order tensor is decomposition in a minimal number of rank-1 tensors. In Part I, we gave an overview of existing results concerning uniqueness and presented…

Spectral Theory · Mathematics 2013-07-05 Ignat Domanov , Lieven De Lathauwer

The decomposition of tensors into simple rank-1 terms is key in a variety of applications in signal processing, data analysis and machine learning. While this canonical polyadic decomposition (CPD) is unique under mild conditions, including…

Optimization and Control · Mathematics 2024-04-17 Nico Vervliet , Andreas Themelis , Panagiotis Patrinos , Lieven De Lathauwer

Traditional tensor decomposition methods, e.g., two dimensional principal component analysis and two dimensional singular value decomposition, that minimize mean square errors, are sensitive to outliers. To overcome this problem, in this…

Computer Vision and Pattern Recognition · Computer Science 2020-12-30 Miaohua Zhang , Yongsheng Gao , Changming Sun , Michael Blumenstein

Efficient modelling of feature interactions underpins supervised learning for non-sequential tasks, characterized by a lack of inherent ordering of features (variables). The brute force approach of learning a parameter for each interaction…

Machine Learning · Computer Science 2021-03-31 Alexandros Haliassos , Kriton Konstantinidis , Danilo P. Mandic

We propose a data-driven approach for deep convolutional neural network compression that achieves high accuracy with high throughput and low memory requirements. Current network compression methods either find a low-rank factorization of…

Computer Vision and Pattern Recognition · Computer Science 2019-03-13 Breton Minnehan , Andreas Savakis

CANDECOMP/PARAFAC (CP) decomposition is the mostly used model to formulate the received tensor signal in a massive MIMO system, as the receiver generally sums the components from different paths or users. To achieve accurate and low-latency…

Signal Processing · Electrical Eng. & Systems 2024-11-21 Xiao Gong , Wei Chen , Bo Ai , Geert Leus

We present an algorithm which computes a cylindrical algebraic decomposition of a semialgebraic set using projection sets computed for each cell separately. Such local projection sets can be significantly smaller than the global projection…

Symbolic Computation · Computer Science 2014-05-21 Adam Strzebonski

Tensor decompositions have proven to be effective in analyzing the structure of multidimensional data. However, most of these methods require a key parameter: the number of desired components. In the case of the CANDECOMP/PARAFAC…

Machine Learning · Computer Science 2024-05-28 William Shiao , Evangelos E. Papalexakis

We consider the problem of factorizing a structured 3-way tensor into its constituent Canonical Polyadic (CP) factors. This decomposition, which can be viewed as a generalization of singular value decomposition (SVD) for tensors, reveals…

Machine Learning · Computer Science 2020-07-01 Sirisha Rambhatla , Xingguo Li , Jarvis Haupt

To ensure interpretability of extracted sources in tensor decomposition, we introduce in this paper a dictionary-based tensor canonical polyadic decomposition which enforces one factor to belong exactly to a known dictionary. A new…

Machine Learning · Statistics 2018-03-13 Jérémy E. Cohen , Nicolas Gillis

We present RandomizedCCA, a randomized algorithm for computing canonical analysis, suitable for large datasets stored either out of core or on a distributed file system. Accurate results can be obtained in as few as two data passes, which…

Machine Learning · Statistics 2014-11-14 Paul Mineiro , Nikos Karampatziakis

Our interest lies in the recoverability properties of compressed tensors under the \textit{canonical polyadic decomposition} (CPD) model. The considered problem is well-motivated in many applications, e.g., hyperspectral image and video…

Signal Processing · Electrical Eng. & Systems 2020-08-26 Shahana Ibrahim , Xiao Fu , Xingguo Li

Coupled tensor decompositions (CTDs) perform data fusion by linking factors from different datasets. Although many CTDs have been already proposed, current works do not address important challenges of data fusion, where: 1) the datasets are…

Machine Learning · Computer Science 2024-12-13 Ricardo Augusto Borsoi , Konstantin Usevich , David Brie , Tülay Adali

This paper surveys randomized algorithms in numerical linear algebra for low-rank decompositions of matrices and tensors. The survey begins with a review of classical matrix algorithms that can be accelerated by randomized dimensionality…

Numerical Analysis · Mathematics 2026-01-01 Katherine J. Pearce , Per-Gunnar Martinsson

Feature extraction for tensor data serves as an important step in many tasks such as anomaly detection, process monitoring, image classification, and quality control. Although many methods have been proposed for tensor feature extraction,…

Machine Learning · Computer Science 2021-06-01 Yinan Wang , Weihong "Grace" Guo , Xiaowei Yue

The computation of a structured canonical polyadic decomposition (CPD) is useful to address several important modeling problems in real-world applications. In this paper, we consider the identification of a nonlinear system by means of a…

We introduce a novel random projection technique for efficiently reducing the dimension of very high-dimensional tensors. Building upon classical results on Gaussian random projections and Johnson-Lindenstrauss transforms~(JLT), we propose…

Machine Learning · Computer Science 2020-03-12 Beheshteh T. Rakhshan , Guillaume Rabusseau

Channel pruning and tensor decomposition have received extensive attention in convolutional neural network compression. However, these two techniques are traditionally deployed in an isolated manner, leading to significant accuracy drop…

Computer Vision and Pattern Recognition · Computer Science 2021-05-25 Yuchao Li , Shaohui Lin , Jianzhuang Liu , Qixiang Ye , Mengdi Wang , Fei Chao , Fan Yang , Jincheng Ma , Qi Tian , Rongrong Ji