English
Related papers

Related papers: Fast elementwise operations on tensor trains with …

200 papers

Tensor decompositions such as the canonical format and the tensor train format have been widely utilized to reduce storage costs and operational complexities for high-dimensional data, achieving linear scaling with the input dimension…

Numerical Analysis · Mathematics 2020-02-11 Oscar Mickelin , Sertac Karaman

In this study, we introduce a tensor-train (TT) finite difference WENO method for solving compressible Euler equations. In a step-by-step manner, the tensorization of the governing equations is demonstrated. We also introduce…

Numerical Analysis · Mathematics 2024-05-22 Mustafa Engin Danis , Duc Truong , Ismael Boureima , Oleg Korobkin , Kim Rasmussen , Boian Alexandrov

$\rm{SO}(3)$-equivariant networks are the dominant models for machine learning interatomic potentials (MLIPs). The key operation of such networks is the Clebsch-Gordan (CG) tensor product, which is computationally expensive. To accelerate…

Machine Learning · Computer Science 2026-01-14 Yuchao Lin , Cong Fu , Zachary Krueger , Haiyang Yu , Maho Nakata , Jianwen Xie , Emine Kucukbenli , Xiaofeng Qian , Shuiwang Ji

In this article two new algorithms are presented that convert a given data tensor train into either a Tucker decomposition with orthogonal matrix factors or a multi-scale entanglement renormalization ansatz (MERA). The Tucker core tensor is…

Numerical Analysis · Mathematics 2019-12-23 Kim Batselier , Andrzej Cichocki , Ngai Wong

We propose new algorithms for singular value decomposition (SVD) of very large-scale matrices based on a low-rank tensor approximation technique called the tensor train (TT) format. The proposed algorithms can compute several dominant…

Numerical Analysis · Mathematics 2016-02-11 Namgil Lee , Andrzej Cichocki

In this paper, we explore the role of tensor algebra in balanced truncation (BT) based model reduction/identification for high-dimensional multilinear/linear time invariant systems. In particular, we employ tensor train decomposition (TTD),…

Systems and Control · Electrical Eng. & Systems 2020-01-28 Can Chen , Amit Surana , Anthony Bloch , Indika Rajapakse

Numerically solving multi-marginal optimal transport (MMOT) problems is computationally prohibitive, even for moderate-scale instances involving $l\ge4$ marginals with support sizes of $N\ge1000$. The cost in MMOT is represented as a tensor…

Numerical Analysis · Mathematics 2026-04-03 Chunhui Chen , Jing Chen , Baojia Luo , Shi Jin , Hao Wu

The Faithful Shapley Interaction (FSI) index uniquely satisfies the faithfulness axiom among Shapley interaction indices, but computing FSI requires $O(d^\ell \cdot 2^d)$ time and existing implementations use $O(4^d)$ memory. We present…

Machine Learning · Computer Science 2026-01-06 Ungsik Kim , Suwon Lee

This paper introduces a randomized variation of the alternating least squares (ALS) algorithm for rank reduction of canonical tensor formats. The aim is to address the potential numerical ill-conditioning of least squares matrices at each…

Numerical Analysis · Mathematics 2015-10-07 Matthew Reynolds , Alireza Doostan , Gregory Beylkin

Modeling the joint distribution of high-dimensional data is a central task in unsupervised machine learning. In recent years, many interests have been attracted to developing learning models based on tensor networks, which have the…

Statistical Mechanics · Physics 2023-02-02 Jing Liu , Sujie Li , Jiang Zhang , Pan Zhang

Joint analysis of data from multiple sources has the potential to improve our understanding of the underlying structures in complex data sets. For instance, in restaurant recommendation systems, recommendations can be based on rating…

Numerical Analysis · Mathematics 2015-03-19 Evrim Acar , Tamara G. Kolda , Daniel M. Dunlavy

This paper proposes a fast Markov Matrix-based methodology for computing Top Trading Cycles (TTC) that delivers O(1) computational speed, that is speed independent of the number of agents and objects in the system. The proposed methodology…

Econometrics · Economics 2024-03-25 Irene Aldridge

This paper introduces matrix product state (MPS) decomposition as a computational tool for extracting features of multidimensional data represented by higher-order tensors. Regardless of tensor order, MPS extracts its relevant features to…

Computer Vision and Pattern Recognition · Computer Science 2016-01-22 Johann A. Bengua , Ho N. Phien , Hoang D. Tuan , Minh N. Do

Matrix product states (MPS) and matrix product operators (MPOs) are one dimensional tensor networks that underlie the modern density matrix renormalization group (DMRG) algorithm. The use of MPOs accounts for the high level of generality…

Strongly Correlated Electrons · Physics 2020-05-27 Matthew J. O'Rourke , Garnet Kin-Lic Chan

Combination of low-tensor rank techniques and the Fast Fourier transform (FFT) based methods had turned out to be prominent in accelerating various statistical operations such as Kriging, computing conditional covariance, geostatistical…

Computation · Statistics 2019-04-23 Sergey Dolgov , Alexander Litvinenko , Dishi Liu

Offline Reinforcement Learning (RL) relies on policy constraints to mitigate extrapolation error, where both the constraint form and constraint strength critically shape performance. However, most existing methods commit to a single…

Machine Learning · Computer Science 2026-02-02 Xinchen Han , Qiuyang Fang , Hossam Afifi , Michel Marot

This paper lies in the intersection of several fields: number theory, lattice theory, multilinear algebra, and scientific computing. We adapt existing solution algorithms for tensor eigenvalue problems to the tensor-train framework. As an…

Numerical Analysis · Mathematics 2017-10-05 Harri Hakula , Pauliina Ilmonen , Vesa Kaarnioja

In this study, we present a tensor--train framework for nonintrusive operator inference aimed at learning discrete operators and using them to predict solutions of physical governing equations. Our framework comprises three approaches:…

Numerical Analysis · Mathematics 2025-09-11 Engin Danis , Duc Truong , Kim Ø. Rasmussen§ , Boian S. Alexandrov

We propose a parallel version of the cross interpolation algorithm and apply it to calculate high-dimensional integrals motivated by Ising model in quantum physics. In contrast to mainstream approaches, such as Monte Carlo and quasi Monte…

Numerical Analysis · Mathematics 2019-08-27 Sergey Dolgov , Dmitry Savostyanov

We consider an approximate computation of several minimal eigenpairs of large Hermitian matrices which come from high--dimensional problems. We use the tensor train format (TT) for vectors and matrices to overcome the curse of…

Numerical Analysis · Mathematics 2014-03-05 Sergey V. Dolgov , Boris N. Khoromskij , Ivan V. Oseledets , Dmitry V. Savostyanov