English
Related papers

Related papers: Analyzing Tensor Power Method Dynamics in Overcomp…

200 papers

The prominence of deep learning, large amount of annotated data and increasingly powerful hardware made it possible to reach remarkable performance for supervised classification tasks, in many cases saturating the training sets. However the…

Computer Vision and Pattern Recognition · Computer Science 2019-11-25 Adrian Bulat , Jean Kossaifi , Georgios Tzimiropoulos , Maja Pantic

Low-rank tensor approximation error bounds are proposed for the case of noisy input data that depend on low-rank representation type, rank and the dimensionality of the tensor. The bounds show that high-dimensional low-rank structured…

Numerical Analysis · Mathematics 2024-12-16 Sergey Petrov , Nikolai Zamarashkin

Higher-order low-rank tensors naturally arise in many applications including hyperspectral data recovery, video inpainting, seismic data recon- struction, and so on. We propose a new model to recover a low-rank tensor by simultaneously…

Numerical Analysis · Computer Science 2015-07-07 Yangyang Xu , Ruru Hao , Wotao Yin , Zhixun Su

Tensor time series, which is a time series consisting of tensorial observations, has become ubiquitous. It typically exhibits high dimensionality. One approach for dimension reduction is to use a factor model structure, in a form similar to…

Methodology · Statistics 2024-07-19 Yuefeng Han , Rong Chen , Dan Yang , Cun-Hui Zhang

Higher-order tensors are well-suited for representing multi-dimensional data, such as images and videos, which typically characterize low-rank structures. Low-rank tensor decomposition has become essential in machine learning and computer…

Computer Vision and Pattern Recognition · Computer Science 2025-10-08 Zhengyun Cheng , Ruizhe Zhang , Guanwen Zhang , Yi Xu , Xiangyang Ji , Wei Zhou

Over recent years it has become well accepted that user interest is not static or immutable. There are a variety of contextual factors, such as time of day, the weather or the user's mood, that influence the current interests of the user.…

Information Retrieval · Computer Science 2025-04-15 Joey De Pauw , Bart Goethals

Tensor CANDECOMP/PARAFAC decomposition (CPD) is a fundamental model for tensor reconstruction. Although the Bayesian framework allows for principled uncertainty quantification and automatic hyperparameter learning, existing methods do not…

Machine Learning · Computer Science 2026-01-27 Bingyang Cheng , Zhongtao Chen , Yichen Jin , Hao Zhang , Chen Zhang , Edmund Y. Lam , Yik-Chung Wu

Tensor linear regression is an important and useful tool for analyzing tensor data. To deal with high dimensionality, CANDECOMP/PARAFAC (CP) low-rank constraints are often imposed on the coefficient tensor parameter in the (penalized)…

Machine Learning · Statistics 2024-04-02 Ya Zhou , Raymond K. W. Wong , Kejun He

The letter proposes an adaptive model reduction approach based on tensor decomposition to speed up time-domain power system simulation. Taylor series expansion of a power system dynamic model is calculated around multiple equilibria…

Systems and Control · Computer Science 2019-04-02 Denis Osipov , Kai Sun

Most machine learning models for structured data encode the structural knowledge of a node by leveraging simple aggregation functions (in neural models, typically a weighted sum) of the information in the node's neighbourhood. Nevertheless,…

Machine Learning · Computer Science 2020-06-18 Daniele Castellana , Davide Bacciu

Recent findings indicate that over-parametrization, while crucial for successfully training deep neural networks, also introduces large amounts of redundancy. Tensor methods have the potential to efficiently parametrize over-complete…

Computer Vision and Pattern Recognition · Computer Science 2019-04-05 Jean Kossaifi , Adrian Bulat , Georgios Tzimiropoulos , Maja Pantic

We investigate the sample size requirement for exact recovery of a high order tensor of low rank from a subset of its entries. In the Tucker decomposition framework, we show that the Riemannian optimization algorithm with initial value…

Machine Learning · Statistics 2019-11-13 Jian-Feng Cai , Lizhang Miao , Yang Wang , Yin Xian

Producing large complex simulation datasets can often be a time and resource consuming task. Especially when these experiments are very expensive, it is becoming more reasonable to generate synthetic data for downstream tasks. Recently,…

Machine Learning · Computer Science 2025-08-28 Paimon Goulart , Shaan Pakala , Evangelos Papalexakis

We present an incremental, scalable and efficient dimension reduction technique for tensors that is based on sparse random linear coding. Data is stored in a compactified representation with fixed size, which makes memory requirements low…

Data Structures and Algorithms · Computer Science 2017-03-16 Fredrik Sandin , Blerim Emruli , Magnus Sahlgren

Low-rank tensor completion recovers missing entries based on different tensor decompositions. Due to its outstanding performance in exploiting some higher-order data structure, low rank tensor ring has been applied in tensor completion. To…

Machine Learning · Computer Science 2020-07-14 Huyan Huang , Yipeng Liu , Ce Zhu

In this paper we propose new techniques to sample arbitrary third-order tensors, with an objective of speeding up tensor algorithms that have recently gained popularity in machine learning. Our main contribution is a new way to select, in a…

Machine Learning · Statistics 2015-02-23 Srinadh Bhojanapalli , Sujay Sanghavi

Tensor networks are efficient representations of high-dimensional tensors which have been very successful for physics and mathematics applications. We demonstrate how algorithms for optimizing such networks can be adapted to supervised…

Machine Learning · Statistics 2017-05-22 E. Miles Stoudenmire , David J. Schwab

In data processing and machine learning, an important challenge is to recover and exploit models that can represent accurately the data. We consider the problem of recovering Gaussian mixture models from datasets. We investigate symmetric…

Algebraic Geometry · Mathematics 2022-06-22 Rima Khouja , Pierre-Alexandre Mattei , Bernard Mourrain

This work studies the Tensor Robust Principal Component Analysis (TRPCA) problem, which aims to exactly recover the low-rank and sparse components from their sum. Our model is motivated by the recently proposed linear transforms based…

Machine Learning · Computer Science 2019-07-22 Canyi Lu , Pan Zhou

We consider sequential state and parameter learning in state-space models with intractable state transition and observation processes. By exploiting low-rank tensor train (TT) decompositions, we propose new sequential learning methods for…

Numerical Analysis · Mathematics 2024-07-04 Yiran Zhao , Tiangang Cui