English
Related papers

Related papers: On Algorithms for and Computing with the Tensor Ri…

200 papers

Tensor completion is an extension of matrix completion aimed at recovering a multiway data tensor by leveraging a given subset of its entries (observations) and the pattern of observation. The low-rank assumption is key in establishing a…

Numerical Analysis · Mathematics 2026-03-12 Shakir Showkat Sofi , Lieven De Lathauwer

We develop new approximation algorithms and data structures for representing and computing with multivariate functions using the functional tensor-train (FT), a continuous extension of the tensor-train (TT) decomposition. The FT represents…

Numerical Analysis · Mathematics 2018-12-13 Alex A. Gorodetsky , Sertac Karaman , Youssef M. Marzouk

While post-training model compression can greatly reduce the inference cost of a deep neural network, uncompressed training still consumes a huge amount of hardware resources, run-time and energy. It is highly desirable to directly train a…

Machine Learning · Computer Science 2021-10-05 Cole Hawkins , Xing Liu , Zheng Zhang

Due to the explosive growth of large-scale data sets, tensors have been a vital tool to analyze and process high-dimensional data. Different from the matrix case, tensor decomposition has been defined in various formats, which can be…

Optimization and Control · Mathematics 2023-12-27 Rachel Grotheer , Shuang Li , Anna Ma , Deanna Needell , Jing Qin

We introduce a method for transforming low-order tensors into higher-order tensors and apply it to tensors defined by graphs and hypergraphs. The transformation proceeds according to a surgery-like procedure that splits vertices, creates…

Combinatorics · Mathematics 2018-06-08 Matthias Christandl , Jeroen Zuiddam

We propose a strategy to compress and store large volumes of scientific data represented on unstructured grids. Approaches utilizing tensor decompositions for data compression have already been proposed. Here, data on a structured grid is…

Numerical Analysis · Mathematics 2024-09-23 Prashant Rai , Hemanth Kolla , Lewis Cannada , Alex Gorodetsky

Recent years have seen rapid advances in the data-driven analysis of dynamical systems based on Koopman operator theory and related approaches. On the other hand, low-rank tensor product approximations -- in particular the tensor train (TT)…

Numerical Analysis · Mathematics 2021-08-11 Feliks Nüske , Patrick Gelß , Stefan Klus , Cecilia Clementi

Convolutional neural networks excel in image recognition tasks, but this comes at the cost of high computational and memory complexity. To tackle this problem, [1] developed a tensor factorization framework to compress fully-connected…

Machine Learning · Computer Science 2016-11-11 Timur Garipov , Dmitry Podoprikhin , Alexander Novikov , Dmitry Vetrov

The Canonical Polyadic decomposition (CPD) is a convenient and intuitive tool for tensor factorization; however, for higher-order tensors, it often exhibits high computational cost and permutation of tensor entries, these undesirable…

Numerical Analysis · Computer Science 2018-09-05 Anh-Huy Phan , Andrzej Cichocki , Ivan Oseledets , Salman Ahmadi Asl , Giuseppe Calvi , Danilo Mandic

We introduce a new low-dimensional model of high-dimensional numerical simulation data based on low-rank tensor decompositions. Our new model aims to minimize differences between the model data and simulation data as well as functions of…

Numerical Analysis · Mathematics 2025-08-18 Daniel M. Dunlavy , Eric T. Phipps , Hemanth Kolla , John N. Shadid , Edward Phillips

In this era of big data, data analytics and machine learning, it is imperative to find ways to compress large data sets such that intrinsic features necessary for subsequent analysis are not lost. The traditional workhorse for data…

Numerical Analysis · Mathematics 2020-01-03 Misha Kilmer , Lior Horesh , Haim Avron , Elizabeth Newman

This work studies the combinatorial optimization problem of finding an optimal core tensor shape, also called multilinear rank, for a size-constrained Tucker decomposition. We give an algorithm with provable approximation guarantees for its…

Data Structures and Algorithms · Computer Science 2024-06-19 Mehrdad Ghadiri , Matthew Fahrbach , Gang Fu , Vahab Mirrokni

Tensor algebra lies at the core of computational science and machine learning. Due to its high usage, entire libraries exist dedicated to improving its performance. Conventional tensor algebra performance boosts focus on algorithmic…

Programming Languages · Computer Science 2022-08-16 Sathvik Redrouthu , Rishi Athavale

Tensors are multidimensional arrays of numerical values and therefore generalize matrices to multiple dimensions. While tensors first emerged in the psychometrics community in the $20^{\text{th}}$ century, they have since then spread to…

Machine Learning · Statistics 2017-11-30 Stephan Rabanser , Oleksandr Shchur , Stephan Günnemann

The approximation of tensors is important for the efficient numerical treatment of high dimensional problems, but it remains an extremely challenging task. One of the most popular approach to tensor approximation is the alternating least…

Numerical Analysis · Mathematics 2015-06-02 Mike Espig , Wolfgang Hackbusch , Aram Khachatryan

Higher-order data with high dimensionality arise in a diverse set of application areas such as computer vision, video analytics and medical imaging. Tensors provide a natural tool for representing these types of data. Although there has…

Signal Processing · Electrical Eng. & Systems 2020-08-04 Seyyid Emre Sofuoglu , Selin Aviyente

Tensor networks have proven to be a valuable tool, for instance, in the classical simulation of (strongly correlated) quantum systems. As the size of the systems increases, contracting larger tensor networks becomes computationally…

Quantum Physics · Physics 2025-07-29 Manuel Geiger , Qunsheng Huang , Christian B. Mendl

In this paper we study the problem of decomposing a given tensor into a tensor train such that the tensors at the vertices are orthogonally decomposable. When the tensor train has length two, and the orthogonally decomposable tensors at the…

Numerical Analysis · Mathematics 2021-09-27 Karim Halaseh , Tommi Muller , Elina Robeva

Tensors or multiarray data are generalizations of matrices. Tensor clustering has become a very important research topic due to the intrinsically rich structures in real-world multiarray datasets. Subspace clustering based on vectorizing…

Computer Vision and Pattern Recognition · Computer Science 2015-04-30 Yanfeng Sun , Junbin Gao , Xia Hong , Bamdev Mishra , Baocai Yin

We propose a framework for discrete scientific data compression based on the tensor-train (TT) decomposition. Our approach is tailored to handle unstructured output data from discrete element method (DEM) simulations, demonstrating its…

Numerical Analysis · Mathematics 2022-10-18 Saibal De , Eduardo Corona , Paramsothy Jayakumar , Shravan Veerapaneni