English
Related papers

Related papers: Low-Rank Tensor Networks for Dimensionality Reduct…

200 papers

We propose new algorithms for singular value decomposition (SVD) of very large-scale matrices based on a low-rank tensor approximation technique called the tensor train (TT) format. The proposed algorithms can compute several dominant…

Numerical Analysis · Mathematics 2016-02-11 Namgil Lee , Andrzej Cichocki

With the advances in data acquisition technology, tensor objects are collected in a variety of applications including multimedia, medical and hyperspectral imaging. As the dimensionality of tensor objects is usually very high,…

Image and Video Processing · Electrical Eng. & Systems 2019-11-06 Seyyid Emre Sofuoglu , Selin Aviyente

Tensor network decomposition, originated from quantum physics to model entangled many-particle quantum systems, turns out to be a promising mathematical technique to efficiently represent and process big data in parsimonious manner. In this…

Machine Learning · Computer Science 2018-12-12 Jenn-Bing Ong , Wee-Keong Ng , C. -C. Jay Kuo

Observations in various applications are frequently represented as a time series of multidimensional arrays, called tensor time series, preserving the inherent multidimensional structure. In this paper, we present a factor model approach,…

Methodology · Statistics 2024-04-22 Yuefeng Han , Dan Yang , Cun-Hui Zhang , Rong Chen

Tensors with unit Frobenius norm are fundamental objects in many fields, including scientific computing and quantum physics, which are able to represent normalized eigenvectors and pure quantum states. While the tensor train decomposition…

Numerical Analysis · Mathematics 2025-11-07 Renfeng Peng , Chengkai Zhu , Bin Gao , Xin Wang , Ya-xiang Yuan

The analysis and visualization of tensor fields is a very challenging task. Besides the cases of zeroth- and first-order tensors, most techniques focus on symmetric second-order tensors. Only a few works concern totally symmetric tensors of…

General Mathematics · Mathematics 2020-09-25 Chiara Hergl , Thomas Nagel , Gerik Scheuermann

Unlike the matrix case, computing low-rank approximations of tensors is NP-hard and numerically ill-posed in general. Even the best rank-1 approximation of a tensor is NP-hard. In this paper, we use convex optimization to develop…

Statistics Theory · Mathematics 2016-09-14 Anil Aswani

Deep neural networks currently demonstrate state-of-the-art performance in several domains. At the same time, models of this class are very demanding in terms of computational resources. In particular, a large amount of memory is required…

Machine Learning · Computer Science 2015-12-22 Alexander Novikov , Dmitry Podoprikhin , Anton Osokin , Dmitry Vetrov

Researchers are increasingly incorporating numeric high-order data, i.e., numeric tensors, within their practice. Just like the matrix/vector (MV) paradigm, the development of multi-purpose, but high-performance, sparse data structures and…

Mathematical Software · Computer Science 2018-02-09 Adam P. Harrison , Dileepan Joseph

In this paper we study the problem of decomposing a given tensor into a tensor train such that the tensors at the vertices are orthogonally decomposable. When the tensor train has length two, and the orthogonally decomposable tensors at the…

Numerical Analysis · Mathematics 2021-09-27 Karim Halaseh , Tommi Muller , Elina Robeva

Low rank tensor decompositions are a powerful tool for learning generative models, and uniqueness results give them a significant advantage over matrix decomposition methods. However, tensors pose significant algorithmic challenges and…

Data Structures and Algorithms · Computer Science 2014-01-21 Aditya Bhaskara , Moses Charikar , Ankur Moitra , Aravindan Vijayaraghavan

A rising problem in the compression of Deep Neural Networks is how to reduce the number of parameters in convolutional kernels and the complexity of these layers by low-rank tensor approximation. Canonical polyadic tensor decomposition…

Machine Learning · Computer Science 2022-03-08 Anh-Huy Phan , Konstantin Sobolev , Dmitry Ermilov , Igor Vorona , Nikolay Kozyrskiy , Petr Tichavsky , Andrzej Cichocki

Tensor decomposition plays a key role in identifying common features across a collection of matrices in many areas of science. A fundamental need in big data research is to process data tabulated as large-scale matrices using eigenvectors.…

Computational Engineering, Finance, and Science · Computer Science 2016-05-24 HyungSeon Oh

We introduce two nonlinear sufficient dimension reduction methods for regressions with tensor-valued predictors. Our goal is two-fold: the first is to preserve the tensor structure when performing dimension reduction, particularly the…

Statistics Theory · Mathematics 2025-12-24 Dianjun Lin , Bing Li , Lingzhou Xue

An increasing number of data science and machine learning problems rely on computation with tensors, which better capture the multi-way relationships and interactions of data than matrices. When tapping into this critical advantage, a key…

Machine Learning · Statistics 2023-02-23 Harry Dong , Tian Tong , Cong Ma , Yuejie Chi

It is well known that tensor network regression models operate on an exponentially large feature space, but questions remain as to how effectively they are able to utilize this space. Using a polynomial featurization, we propose the…

Machine Learning · Computer Science 2023-01-27 Ian Convy , K. Birgitta Whaley

This paper studies the issues about tensors. Three typical kinds of tensor decomposition are mentioned. Among these decompositions, the t-SVD is proposed in this decade. Different definitions of rank derive from tensor decompositions. Based…

Numerical Analysis · Mathematics 2020-05-26 Jun Han

Dynamic multilayer networks are frequently used to describe the structure and temporal evolution of multiple relationships among common entities, with applications in fields such as sociology, economics, and neuroscience. However,…

Methodology · Statistics 2026-04-06 Runshi Tang , Runbing Zheng , Anru R. Zhang , Carey E. Priebe

Over recent years it has become well accepted that user interest is not static or immutable. There are a variety of contextual factors, such as time of day, the weather or the user's mood, that influence the current interests of the user.…

Information Retrieval · Computer Science 2025-04-15 Joey De Pauw , Bart Goethals

Tensor Decomposition Networks (TDNs) prevail for their inherent compact architectures. To give more researchers a flexible way to exploit TDNs, we present a Pytorch toolkit named TedNet. TedNet implements 5 kinds of tensor…

Machine Learning · Computer Science 2021-11-23 Yu Pan , Maolin Wang , Zenglin Xu