English
Related papers

Related papers: An Incremental Tensor Train Decomposition Algorith…

200 papers

The growing demands of distributed learning on resource constrained edge devices underscore the importance of efficient on device model compression. Tensor Train Decomposition (TTD) offers high compression ratios with minimal accuracy loss,…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-11-19 Hyunseok Kwak , Kyeongwon Lee , Kyeongpil Min , Chaebin Jung , Woojoo Lee

The tensor-train (TT) decomposition is widely used to compress large tensors into a more compact form by exploiting their inherent data structures. A fundamental approach for constructing the TT format is the well-known TT-SVD method, which…

Numerical Analysis · Mathematics 2026-05-26 Yuchao Wang , Maolin Che , Yimin Wei

Tensor Train (TT) decompositions provide a powerful framework to compress grid-structured data, such as sampled function values, on regular Cartesian grids. Such high compression, in turn, enables efficient high-dimensional computations.…

Numerical Analysis · Mathematics 2026-01-08 Siddhartha E. Guzman , Egor Tiunov , Leandro Aolita

In this paper, we focus on the fixed TT-rank and precision problems of finding an approximation of the tensor train (TT) decomposition of a tensor. Note that the TT-SVD and TT-cross are two well-known algorithms for these two problems.…

Numerical Analysis · Mathematics 2025-02-11 Maolin Che , Yimin Wei , Hong Yan

The tensor train (TT) format enjoys appealing advantages in handling structural high-order tensors. The recent decade has witnessed the wide applications of TT-format tensors from diverse disciplines, among which tensor completion has drawn…

Machine Learning · Computer Science 2022-03-22 Jian-Feng Cai , Jingyang Li , Dong Xia

We propose an algorithm for solution of high-dimensional evolutionary equations (ODEs and discretized time-dependent PDEs) in the Tensor Train (TT) decomposition, assuming that the solution and the right-hand side of the ODE admit such a…

Numerical Analysis · Mathematics 2017-10-05 Sergey V. Dolgov

In this paper, we aim at the completion problem of high order tensor data with missing entries. The existing tensor factorization and completion methods suffer from the curse of dimensionality when the order of tensor N>>3. To overcome this…

Numerical Analysis · Computer Science 2017-09-15 Longhao Yuan , Qibin Zhao , Jianting Cao

In this paper we review basic and emerging models and associated algorithms for large-scale tensor networks, especially Tensor Train (TT) decompositions using novel mathematical and graphical representations. We discus the concept of…

Numerical Analysis · Computer Science 2014-08-25 Andrzej Cichocki

Tensor ring (TR) decomposition has recently received increased attention due to its superior expressive performance for high-order tensors. However, the applicability of traditional TR decomposition algorithms to real-world applications is…

Machine Learning · Computer Science 2023-05-17 Yicong He , George K. Atia

In this paper, we consider the tensor completion problem representing the solution in the tensor train (TT) format. It is assumed that tensor is high-dimensional, and tensor values are generated by an unknown smooth function. The assumption…

Numerical Analysis · Mathematics 2020-08-27 Yermek Kapushev , Ivan Oseledets , Evgeny Burnaev

The ability to learn compact, high-quality, and easy-to-optimize representations for visual data is paramount to many applications such as novel view synthesis and 3D reconstruction. Recent work has shown substantial success in using tensor…

Computer Vision and Pattern Recognition · Computer Science 2024-06-07 Sebastian Loeschcke , Dan Wang , Christian Leth-Espensen , Serge Belongie , Michael J. Kastoryano , Sagie Benaim

Tensor train (TT) decomposition is a powerful representation for high-order tensors, which has been successfully applied to various machine learning tasks in recent years. However, since the tensor product is not commutative, permutation of…

Numerical Analysis · Computer Science 2017-05-31 Qibin Zhao , Masashi Sugiyama , Andrzej Cichocki

We develop new approximation algorithms and data structures for representing and computing with multivariate functions using the functional tensor-train (FT), a continuous extension of the tensor-train (TT) decomposition. The FT represents…

Numerical Analysis · Mathematics 2018-12-13 Alex A. Gorodetsky , Sertac Karaman , Youssef M. Marzouk

Tensor decomposition is a mathematically supported technique for data compression. It consists of applying some kind of a Low Rank Decomposition technique on the tensors or matrices in order to reduce the redundancy of the data. However, it…

Machine Learning · Computer Science 2025-05-27 Habib Hajimolahoseini , Walid Ahmed , Austin Wen , Yang Liu

Tensor Train~(TT) decomposition is widely used in the machine learning and quantum physics communities as a popular tool to efficiently compress high-dimensional tensor data. In this paper, we propose an efficient algorithm to accelerate…

Data Structures and Algorithms · Computer Science 2024-06-07 Vivek Bharadwaj , Beheshteh T. Rakhshan , Osman Asif Malik , Guillaume Rabusseau

We propose a framework for discrete scientific data compression based on the tensor-train (TT) decomposition. Our approach is tailored to handle unstructured output data from discrete element method (DEM) simulations, demonstrating its…

Numerical Analysis · Mathematics 2022-10-18 Saibal De , Eduardo Corona , Paramsothy Jayakumar , Shravan Veerapaneni

We present efficient and scalable parallel algorithms for performing mathematical operations for low-rank tensors represented in the tensor train (TT) format. We consider algorithms for addition, elementwise multiplication, computing norms…

Numerical Analysis · Mathematics 2021-09-08 Hussam Al Daas , Grey Ballard , Peter Benner

We propose a new tensor completion method based on tensor trains. The to-be-completed tensor is modeled as a low-rank tensor train, where we use the known tensor entries and their coordinates to update the tensor train. A novel tensor train…

Numerical Analysis · Computer Science 2018-11-14 Ching-Yun Ko , Kim Batselier , Wenjian Yu , Ngai Wong

Tensor Networks (TN) offer a powerful framework to efficiently represent very high-dimensional objects. TN have recently shown their potential for machine learning applications and offer a unifying view of common tensor decomposition models…

Machine Learning · Computer Science 2021-06-24 Meraj Hashemizadeh , Michelle Liu , Jacob Miller , Guillaume Rabusseau

In this article two new algorithms are presented that convert a given data tensor train into either a Tucker decomposition with orthogonal matrix factors or a multi-scale entanglement renormalization ansatz (MERA). The Tucker core tensor is…

Numerical Analysis · Mathematics 2019-12-23 Kim Batselier , Andrzej Cichocki , Ngai Wong