English
Related papers

Related papers: Efficient Nonnegative Tucker Decompositions: Algor…

200 papers

Unlike the matrix case, computing low-rank approximations of tensors is NP-hard and numerically ill-posed in general. Even the best rank-1 approximation of a tensor is NP-hard. In this paper, we use convex optimization to develop…

Statistics Theory · Mathematics 2016-09-14 Anil Aswani

We consider $N$-way data arrays and low-rank tensor factorizations where the time mode is coded as a sparse linear combination of temporal elements from an over-complete library. Our method, Shape Constrained Tensor Decomposition (SCTD) is…

Machine Learning · Statistics 2016-08-17 Bethany Lusch , Eric C. Chi , J. Nathan Kutz

Over the past decades, the increasing dimensionality of data has increased the need for effective data decomposition methods. Existing approaches, however, often rely on linear models or lack sufficient interpretability or flexibility. To…

Methodology · Statistics 2026-03-24 Jiaji Su , Zhigang Yao

Low-rank tensor approximation approaches have become an important tool in the scientific computing community. The aim is to enable the simulation and analysis of high-dimensional problems which cannot be solved using conventional methods…

Numerical Analysis · Mathematics 2019-02-26 Patrick Gelß , Stefan Klus , Sebastian Matera , Christof Schütte

In this work we present recent results on application of low-rank tensor decompositions to modelling of aggregation kinetics taking into account multi-particle collisions (for three and more particles). Such kinetics can be described by…

Numerical Analysis · Mathematics 2020-08-18 Daniil A. Stefonishin , Sergey A. Matveev , Dmitry A. Zheltkov

The decomposition of tensors into simple rank-1 terms is key in a variety of applications in signal processing, data analysis and machine learning. While this canonical polyadic decomposition (CPD) is unique under mild conditions, including…

Optimization and Control · Mathematics 2024-04-17 Nico Vervliet , Andreas Themelis , Panagiotis Patrinos , Lieven De Lathauwer

Tucker decomposition is one of the SOTA CNN model compression techniques. However, unlike the FLOPs reduction, we observe very limited inference time reduction with Tucker-compressed models using existing GPU software such as cuDNN. To this…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-01-06 Lizhi Xiang , Miao Yin , Chengming Zhang , Aravind Sukumaran-Rajam , P. Sadayappan , Bo Yuan , Dingwen Tao

As low-rank modeling has achieved great success in tensor recovery, many research efforts devote to defining the tensor rank. Among them, the recent popular tensor tubal rank, defined based on the tensor singular value decomposition…

Computer Vision and Pattern Recognition · Computer Science 2018-12-04 Yu-Bang Zheng , Ting-Zhu Huang , Xi-Le Zhao , Tai-Xiang Jiang , Teng-Yu Ji , Tian-Hui Ma

In this article two new algorithms are presented that convert a given data tensor train into either a Tucker decomposition with orthogonal matrix factors or a multi-scale entanglement renormalization ansatz (MERA). The Tucker core tensor is…

Numerical Analysis · Mathematics 2019-12-23 Kim Batselier , Andrzej Cichocki , Ngai Wong

Tensor decomposition is a mathematically supported technique for data compression. It consists of applying some kind of a Low Rank Decomposition technique on the tensors or matrices in order to reduce the redundancy of the data. However, it…

Machine Learning · Computer Science 2025-05-27 Habib Hajimolahoseini , Walid Ahmed , Austin Wen , Yang Liu

In the last decades, tensors have emerged as the right tool to represent multidimensional data in a compact yet informative manner. Moreover, it is well-known that by performing low-rank factorizations of such tensors one is often able to…

Numerical Analysis · Mathematics 2026-03-31 Martina Iannacito , Sascha Portaro , Davide Palitta , Claudio Arlandini , Domitilla Brandoni

A rising problem in the compression of Deep Neural Networks is how to reduce the number of parameters in convolutional kernels and the complexity of these layers by low-rank tensor approximation. Canonical polyadic tensor decomposition…

Machine Learning · Computer Science 2022-03-08 Anh-Huy Phan , Konstantin Sobolev , Dmitry Ermilov , Igor Vorona , Nikolay Kozyrskiy , Petr Tichavsky , Andrzej Cichocki

Compressed sensing extends from the recovery of sparse vectors from undersampled measurements via efficient algorithms to the recovery of matrices of low rank from incomplete information. Here we consider a further extension to the…

Numerical Analysis · Mathematics 2014-11-04 Holger Rauhut , Reinhold Schneider , Zeljka Stojanac

Low-rank tensor completion recovers missing entries based on different tensor decompositions. Due to its outstanding performance in exploiting some higher-order data structure, low rank tensor ring has been applied in tensor completion. To…

Machine Learning · Computer Science 2020-07-14 Huyan Huang , Yipeng Liu , Ce Zhu

In this paper, we explore the role of tensor algebra in balanced truncation (BT) based model reduction/identification for high-dimensional multilinear/linear time invariant systems. In particular, we employ tensor train decomposition (TTD),…

Systems and Control · Electrical Eng. & Systems 2020-01-28 Can Chen , Amit Surana , Anthony Bloch , Indika Rajapakse

The tensor-train (TT) format is a data-sparse tensor representation commonly used in high dimensional data approximations. In order to represent data with interpretability in data science, researchers develop data-centric skeletonized low…

Numerical Analysis · Mathematics 2026-02-10 Daniel Hayes , Jing-Mei Qiu , Tianyi Shi

We introduce a new adaptive decomposition tool, which we refer to as Nonlinear Mode Decomposition (NMD). It decomposes a given signal into a set of physically meaningful oscillations for any waveform, simultaneously removing the noise. NMD…

Numerical Analysis · Mathematics 2015-10-07 Dmytro Iatsenko , Peter V. E. McClintock , Aneta Stefanovska

Topological data analysis (TDA) has become an attractive area for the application of quantum computing. Recent advances have uncovered many interesting connections between the two fields. On one hand, complexity theoretic results show that…

Quantum Physics · Physics 2025-11-06 Nhat A. Nghiem

Low rank tensor decompositions are a powerful tool for learning generative models, and uniqueness results give them a significant advantage over matrix decomposition methods. However, tensors pose significant algorithmic challenges and…

Data Structures and Algorithms · Computer Science 2014-01-21 Aditya Bhaskara , Moses Charikar , Ankur Moitra , Aravindan Vijayaraghavan

The Hadamard decomposition is a powerful technique for data analysis and matrix compression, which decomposes a given matrix into the element-wise product of two or more low-rank matrices. In this paper, we develop an efficient algorithm to…

Machine Learning · Computer Science 2025-04-23 Samuel Wertz , Arnaud Vandaele , Nicolas Gillis