English
Related papers

Related papers: On some orthogonalization schemes in Tensor Train …

200 papers

We investigate the application of tensor-train (TT) algorithms to multigroup thermal radiation transport (i.e., photon radiation transport). The TT framework enables simulations at discretizations that might otherwise be computationally…

Instrumentation and Methods for Astrophysics · Physics 2026-04-10 Aditya S. Deshpande , Patrick D. Mullen , Alex A. Gorodetsky , Joshua C. Dolence , Chad D. Meyer , Jonah M. Miller , Luke F. Roberts

Tensor completion estimates missing components by exploiting the low-rank structure of multi-way data. The recently proposed methods based on tensor train (TT) and tensor ring (TR) show better performance in image recovery than classical…

Machine Learning · Computer Science 2020-04-24 Huyan Huang , Yipeng Liu , Ce Zhu

In this paper, we provide the first convergence guarantee for the factorization approach. Specifically, to avoid the scaling ambiguity and to facilitate theoretical analysis, we optimize over the so-called left-orthogonal TT format which…

Machine Learning · Statistics 2025-09-01 Zhen Qin , Michael B. Wakin , Zhihui Zhu

Tensor Train (TT) decompositions provide a powerful framework to compress grid-structured data, such as sampled function values, on regular Cartesian grids. Such high compression, in turn, enables efficient high-dimensional computations.…

Numerical Analysis · Mathematics 2026-01-08 Siddhartha E. Guzman , Egor Tiunov , Leandro Aolita

We propose a method (TT-GP) for approximate inference in Gaussian Process (GP) models. We build on previous scalable GP research including stochastic variational inference based on inducing inputs, kernel interpolation, and structure…

Machine Learning · Computer Science 2018-01-18 Pavel Izmailov , Alexander Novikov , Dmitry Kropotov

In recent years, the application of tensors has become more widespread in fields that involve data analytics and numerical computation. Due to the explosive growth of data, low-rank tensor decompositions have become a powerful tool to…

Numerical Analysis · Mathematics 2020-11-03 Lingjie Li , Wenjian Yu , Kim Batselier

Tensor train (TT) factorization and corresponding TT rank, which can well express the low-rankness and mode correlations of higher-order tensors, have attracted much attention in recent years. However, TT factorization based methods are…

Image and Video Processing · Electrical Eng. & Systems 2022-05-09 Gaohang Yu , Shaochun Wan , Liqun Qi , Yanwei Xu

We study the recovery of the underlying graphs or permutations for tensors in the tensor ring or tensor train format. Our proposed algorithms compare the matricization ranks after down-sampling, whose complexity is $O(d\log d)$ for $d$-th…

Numerical Analysis · Mathematics 2024-04-04 Ziang Chen , Jianfeng Lu , Anru R. Zhang

In this article two new algorithms are presented that convert a given data tensor train into either a Tucker decomposition with orthogonal matrix factors or a multi-scale entanglement renormalization ansatz (MERA). The Tucker core tensor is…

Numerical Analysis · Mathematics 2019-12-23 Kim Batselier , Andrzej Cichocki , Ngai Wong

We introduce compositional tensor trains (CTTs) for the approximation of multivariate functions, a class of models obtained by composing low-rank functions in the tensor-train format. This format can encode standard approximation tools,…

Numerical Analysis · Mathematics 2025-12-23 Martin Eigel , Charles Miranda , Anthony Nouy , David Sommer

Machine learning and data mining algorithms are becoming increasingly important in analyzing large volume, multi-relational and multi--modal datasets, which are often conveniently represented as multiway arrays or tensors. It is therefore…

Numerical Analysis · Computer Science 2017-09-12 A. Cichocki , N. Lee , I. V. Oseledets , A. -H. Phan , Q. Zhao , D. Mandic

In this paper we review basic and emerging models and associated algorithms for large-scale tensor networks, especially Tensor Train (TT) decompositions using novel mathematical and graphical representations. We discus the concept of…

Numerical Analysis · Computer Science 2014-08-25 Andrzej Cichocki

An increasing amount of collected data are high-dimensional multi-way arrays (tensors), and it is crucial for efficient learning algorithms to exploit this tensorial structure as much as possible. The ever-present curse of dimensionality…

Machine Learning · Computer Science 2021-08-04 Kirandeep Kour , Sergey Dolgov , Martin Stoll , Peter Benner

The tensor-train (TT) decomposition expresses a tensor in a data-sparse format used in molecular simulations, high-order correlation functions, and optimization. In this paper, we propose four parallelizable algorithms that compute the TT…

Numerical Analysis · Mathematics 2021-11-23 Tianyi Shi , Maximilian Ruth , Alex Townsend

This paper proposes a novel formulation of the tensor completion problem to impute missing entries of data represented by tensors. The formulation is introduced in terms of tensor train (TT) rank which can effectively capture global…

Numerical Analysis · Computer Science 2016-01-07 Ho N. Phien , Hoang D. Tuan , Johann A. Bengua , Minh N. Do

We introduce a new coarse-graining algorithm, tensor network skeletonization, for the numerical computation of tensor networks. This approach utilizes a structure-preserving skeletonization procedure to remove short-range correlations…

Numerical Analysis · Mathematics 2016-07-05 Lexing Ying

Various tensor decomposition methods have been proposed for data compression. In real world applications of the tensor decomposition, selecting the tensor shape for the given data poses a challenge and the shape of the tensor may affect the…

Image and Video Processing · Electrical Eng. & Systems 2022-05-24 Ryan Solgi , Zichang He , William Jiahua Liang , Zheng Zhang

In this paper, we focus on the fixed TT-rank and precision problems of finding an approximation of the tensor train (TT) decomposition of a tensor. Note that the TT-SVD and TT-cross are two well-known algorithms for these two problems.…

Numerical Analysis · Mathematics 2025-02-11 Maolin Che , Yimin Wei , Hong Yan

Three dimensional convolutional neural networks (3DCNNs) have been applied in many tasks, e.g., video and 3D point cloud recognition. However, due to the higher dimension of convolutional kernels, the space complexity of 3DCNNs is generally…

Computer Vision and Pattern Recognition · Computer Science 2020-08-12 Dingheng Wang , Guangshe Zhao , Guoqi Li , Lei Deng , Yang Wu

Block classical Gram-Schmidt (BCGS) is commonly used for orthogonalizing a set of vectors $X$ in distributed computing environments due to its favorable communication properties relative to other orthogonalization approaches, such as…

Numerical Analysis · Mathematics 2025-10-28 Erin Carson , Kathryn Lund , Yuxin Ma , Eda Oktay