English
Related papers

Related papers: Error Preserving Correction for CPD and Bounded-No…

200 papers

As tensor-valued data become increasingly common in time series analysis, there is a growing need for flexible and interpretable models that can handle high-dimensional predictors and responses across multiple modes. We propose a unified…

Methodology · Statistics 2025-06-10 Shibo Li , Yao Zheng

Many idealized problems in signal processing, machine learning and statistics can be reduced to the problem of finding the symmetric canonical decomposition of an underlying symmetric and orthogonally decomposable (SOD) tensor. Drawing…

Numerical Analysis · Computer Science 2017-05-31 Cun Mu , Daniel Hsu , Donald Goldfarb

Large CNNs have delivered impressive performance in various computer vision applications. But the storage and computation requirements make it problematic for deploying these models on mobile devices. Recently, tensor decompositions have…

Machine Learning · Computer Science 2016-02-16 Cheng Tai , Tong Xiao , Yi Zhang , Xiaogang Wang , Weinan E

It is well-known that tensor decompositions show separations, that is, that constraints on local terms (such as positivity) may entail an arbitrarily high cost in their representation. Here we show that many of these separations disappear…

Optimization and Control · Mathematics 2021-09-03 Gemma De las Cuevas , Andreas Klingler , Tim Netzer

Tensor decompositions are promising tools for big data analytics as they bring multiple modes and aspects of data to a unified framework, which allows us to discover complex internal structures and correlations of data. Unfortunately most…

Numerical Analysis · Computer Science 2014-12-30 Guoxu Zhou , Andrzej Cichocki , Shengli Xie

This paper studies the rank-$1$ tensor completion problem for cubic tensors. First of all, we show that this problem is equivalent to a special rank-$1$ matrix recovery problem. When the tensor is strongly rank-$1$ completable, we show that…

Optimization and Control · Mathematics 2024-10-23 Jinling Zhou , Jiawang Nie , Zheng Peng , Guangming Zhou

The CP decomposition for high dimensional non-orthogonal spiked tensors is an important problem with broad applications across many disciplines. However, previous works with theoretical guarantee typically assume restrictive incoherence…

Machine Learning · Statistics 2022-09-20 Yuefeng Han , Cun-Hui Zhang

Tensor rank and low-rank tensor decompositions have many applications in learning and complexity theory. Most known algorithms use unfoldings of tensors and can only handle rank up to $n^{\lfloor p/2 \rfloor}$ for a $p$-th order tensor in…

Data Structures and Algorithms · Computer Science 2015-04-23 Rong Ge , Tengyu Ma

Tensor completion refers to the task of estimating the missing data from an incomplete measurement or observation, which is a core problem frequently arising from the areas of big data analysis, computer vision, and network engineering. Due…

Machine Learning · Computer Science 2021-05-21 Chenjian Pan , Chen Ling , Hongjin He , Liqun Qi , Yanwei Xu

In this paper, we propose a novel model to recover a low-rank tensor by simultaneously performing double nuclear norm regularized low-rank matrix factorizations to the all-mode matricizations of the underlying tensor. An block successive…

Computer Vision and Pattern Recognition · Computer Science 2020-05-07 Haijin Zeng , Xiaozhen Xie , Jifeng Ning

This paper tackles the problem of recovering a low-rank signal tensor with possibly correlated components from a random noisy tensor, or so-called spiked tensor model. When the underlying components are orthogonal, they can be recovered…

Machine Learning · Statistics 2023-03-20 Mohamed El Amine Seddik , Mohammed Mahfoud , Merouane Debbah

The damped Gauss-Newton (dGN) algorithm for CANDECOMP/PARAFAC (CP) decomposition can handle the challenges of collinearity of factors and different magnitudes of factors; nevertheless, for factorization of an $N$-D tensor of size $I_1\times…

Numerical Analysis · Computer Science 2015-03-20 Anh Huy Phan , Petr Tichavský , Andrzej Cichocki

Tensor decompositions, which represent an $N$-order tensor using approximately $N$ factors of much smaller dimensions, can significantly reduce the number of parameters. This is particularly beneficial for high-order tensors, as the number…

Machine Learning · Computer Science 2025-06-23 Zhen Qin , Michael B. Wakin , Zhihui Zhu

The PARAFAC2 model provides a flexible alternative to the popular CANDECOMP/PARAFAC (CP) model for tensor decompositions. Unlike CP, PARAFAC2 allows factor matrices in one mode (i.e., evolving mode) to change across tensor slices, which has…

Machine Learning · Computer Science 2023-10-18 Marie Roald , Carla Schenker , Jeremy E. Cohen , Evrim Acar

Recovery of low-rank matrices from a small number of linear measurements is now well-known to be possible under various model assumptions on the measurements. Such results demonstrate robustness and are backed with provable theoretical…

Numerical Analysis · Mathematics 2019-08-23 Rachel Grotheer , Shuang Li , Anna Ma , Deanna Needell , Jing Qin

In numerous settings, it is increasingly common to deal with longitudinal data organized as high-dimensional multi-dimensional arrays, also known as tensors. Within this framework, the time-continuous property of longitudinal data often…

Methodology · Statistics 2026-01-28 Lucas Sort , Laurent Le Brusquet , Arthur Tenenhaus

In the machine learning fields, Recurrent Neural Network (RNN) has become a popular architecture for sequential data modeling. However, behind the impressive performance, RNNs require a large number of parameters for both training and…

Machine Learning · Computer Science 2018-05-09 Andros Tjandra , Sakriani Sakti , Satoshi Nakamura

Candecomp / PARAFAC (CP) decomposition, a generalization of the matrix singular value decomposition to higher-dimensional tensors, is a popular tool for analyzing multidimensional sparse data. On tensors with billions of nonzero entries,…

Numerical Analysis · Mathematics 2024-04-30 Vivek Bharadwaj , Osman Asif Malik , Riley Murray , Aydin Buluç , James Demmel

Nonnegative CANDECOMP/PARAFAC (NCP) decomposition is an important tool to process nonnegative tensor. Sometimes, additional sparse regularization is needed to extract meaningful nonnegative and sparse components. Thus, an optimization…

Machine Learning · Statistics 2018-12-31 Deqing Wang , Fengyu Cong , Tapani Ristaniemi

We consider the problem of downlink channel estimation for millimeter wave (mmWave) MIMO-OFDM systems, where both the base station (BS) and the mobile station (MS) employ large antenna arrays for directional precoding/beamforming. Hybrid…

Information Theory · Computer Science 2016-11-02 Zhou Zhou , Jun Fang , Linxiao Yang , Hongbin Li , Zhi Chen , Rick S. Blum