English
Related papers

Related papers: Parallel algorithms for computing the tensor-train…

200 papers

We propose RTSMS (Randomized Tucker via Single-Mode-Sketching), a randomized algorithm for approximately computing a low-rank Tucker decomposition of a given tensor. It uses sketching and least-squares to compute the Tucker decomposition in…

Numerical Analysis · Mathematics 2023-11-28 Behnam Hashemi , Yuji Nakatsukasa

Tensor decompositions, which represent an $N$-order tensor using approximately $N$ factors of much smaller dimensions, can significantly reduce the number of parameters. This is particularly beneficial for high-order tensors, as the number…

Machine Learning · Computer Science 2025-06-23 Zhen Qin , Michael B. Wakin , Zhihui Zhu

Tensor completion can estimate missing values of a high-order data from its partially observed entries. Recent works show that low rank tensor ring approximation is one of the most powerful tools to solve tensor completion problem. However,…

Numerical Analysis · Mathematics 2021-01-03 Abdul Ahad , Zhen Long , Ce Zhu , Yipeng Liu

We present a novel offline-online method to mitigate the computational burden of the characterization of posterior random variables in statistical learning. In the offline phase, the proposed method learns the joint law of the parameter…

Machine Learning · Statistics 2023-03-07 Tiangang Cui , Sergey Dolgov , Olivier Zahm

Data encoding remains a fundamental bottleneck in quantum machine learning, where amplitude encoding of high-dimensional classical vectors into quantum states incurs exponential cost. In this work, we propose a pre-trained tensor-train (TT)…

Quantum Physics · Physics 2026-02-11 Jun Qi , Chao-Han Huck Yang , Pin-Yu Chen , Min-Hsiu Hsieh

Tensor train is a hierarchical tensor network structure that helps alleviate the curse of dimensionality by parameterizing large-scale multidimensional data via a set of network of low-rank tensors. Associated with such a construction is a…

Machine Learning · Computer Science 2018-03-15 Wenqi Wang , Vaneet Aggarwal , Shuchin Aeron

We consider the problem of automatically decomposing operations over tensors or arrays so that they can be executed in parallel on multiple devices. We address two, closely-linked questions. First, what programming abstraction should…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-10-04 Daniel Bourgeois , Zhimin Ding , Dimitrije Jankov , Jiehui Li , Mahmoud Sleem , Yuxin Tang , Jiawen Yao , Xinyu Yao , Chris Jermaine

CP tensor decomposition with alternating least squares (ALS) is dominated in cost by the matricized-tensor times Khatri-Rao product (MTTKRP) kernel that is necessary to set up the quadratic optimization subproblems. State-of-art parallel…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-10-26 Linjian Ma , Edgar Solomonik

Tucker decomposition is a common method for the analysis of multi-way/tensor data. Standard Tucker has been shown to be sensitive against heavy corruptions, due to its L2-norm-based formulation which places squared emphasis to peripheral…

Numerical Analysis · Computer Science 2019-04-16 Dimitris G. Chachlakis , Ashley Prater-Bennette , Panos P. Markopoulos

Tensor networks are a class of algorithms aimed at reducing the computational complexity of high-dimensional problems. They are used in an increasing number of applications, from quantum simulations to machine learning. Exploiting data…

Numerical Analysis · Mathematics 2024-10-25 Melven Röhrig-Zöllner , Manuel Joey Becklas , Jonas Thies , Achim Basermann

The numerical solution of kinetic equations is challenging due to the high dimensionality of the underlying phase space. In this paper, we develop a dynamical low-rank method based on the projector-splitting integrator in tensor-train (TT)…

Numerical Analysis · Mathematics 2026-03-31 Geshuo Wang , Jingwei Hu

Tensors with unit Frobenius norm are fundamental objects in many fields, including scientific computing and quantum physics, which are able to represent normalized eigenvectors and pure quantum states. While the tensor train decomposition…

Numerical Analysis · Mathematics 2025-11-07 Renfeng Peng , Chengkai Zhu , Bin Gao , Xin Wang , Ya-xiang Yuan

Low-rank Tucker and CP tensor decompositions are powerful tools in data analytics. The widely used alternating least squares (ALS) method, which solves a sequence of over-determined least squares subproblems, is costly for large and sparse…

Numerical Analysis · Mathematics 2021-08-26 Linjian Ma , Edgar Solomonik

In this work, we firstly apply the Train-Tensor (TT) networks to construct a compact representation of the classical Multilayer Perceptron, representing a reduction of up to 95% of the coefficients. A comparative analysis between tensor…

Machine Learning · Computer Science 2021-03-31 M. Nazareth da Costa , R. Attux , A. Cichocki , J. M. T. Romano

Path-integral techniques are a powerful tool used in open quantum systems to provide an exact solution for the non-Markovian dynamics. However, the exponential scaling of the tensor size with quantum memory length of these techniques limits…

Quantum Physics · Physics 2025-08-25 L. M. J. Hall , A. Gisdakis , E. A. Muljarov

The interplay of quantum and classical simulation and the delicate divide between them is in the focus of massively parallelized tensor network state (TNS) algorithms designed for high performance computing (HPC). In this contribution, we…

Quantum Physics · Physics 2023-05-10 Andor Menczer , Örs Legeza

We present an approach for penalized tensor decomposition (PTD) that estimates smoothly varying latent factors in multi-way data. This generalizes existing work on sparse tensor decomposition and penalized matrix decompositions, in a manner…

Methodology · Statistics 2016-05-16 Oscar Hernan Madrid Padilla , James G. Scott

Improving the computational efficiency of quantum many-body calculations from a hardware perspective remains a critical challenge. Although field-programmable gate arrays (FPGAs) have recently been exploited to improve the computational…

Strongly Correlated Electrons · Physics 2026-02-06 Songtai Lv , Yang Liang , Rui Zhu , Qibin Zheng , Haiyuan Zou

Practical tensor data is often along with time information. Most existing temporal decomposition approaches estimate a set of fixed factors for the objects in each tensor mode, and hence cannot capture the temporal evolution of the objects'…

Machine Learning · Computer Science 2023-11-09 Shikai Fang , Xin Yu , Shibo Li , Zheng Wang , Robert Kirby , Shandian Zhe

We investigate the application of tensor-train (TT) algorithms to multigroup thermal radiation transport (i.e., photon radiation transport). The TT framework enables simulations at discretizations that might otherwise be computationally…

Instrumentation and Methods for Astrophysics · Physics 2026-04-10 Aditya S. Deshpande , Patrick D. Mullen , Alex A. Gorodetsky , Joshua C. Dolence , Chad D. Meyer , Jonah M. Miller , Luke F. Roberts