English
Related papers

Related papers: Distributed memory parallel adaptive tensor-train …

200 papers

The application of Tensor Networks (TN) in quantum computing has shown promise, particularly for data loading. However, the assumption that data is readily available often renders the integration of TN techniques into Quantum Monte Carlo…

This paper presents a method to build explicit tensor-train (TT) representations. We show that a wide class of tensors can be explicitly represented with sparse TT-cores, obtaining, in many cases, optimal TT-ranks. Numerical experiments…

Numerical Analysis · Mathematics 2022-06-16 Gleb Ryzhakov , Ivan Oseledets

The CP tensor decomposition is a low-rank approximation of a tensor. We present a distributed-memory parallel algorithm and implementation of an alternating optimization method for computing a CP decomposition of dense tensor data that can…

Numerical Analysis · Computer Science 2018-06-22 Grey Ballard , Koby Hayashi , Ramakrishnan Kannan

In this work, we firstly apply the Train-Tensor (TT) networks to construct a compact representation of the classical Multilayer Perceptron, representing a reduction of up to 95% of the coefficients. A comparative analysis between tensor…

Machine Learning · Computer Science 2021-03-31 M. Nazareth da Costa , R. Attux , A. Cichocki , J. M. T. Romano

Using the matrix product state (MPS) representation of tensor train decompositions, in this paper we propose a tensor completion algorithm which alternates over the matrices (tensors) in the MPS representation. This development is motivated…

Numerical Analysis · Computer Science 2016-10-03 Wenqi Wang , Vaneet Aggarwal , Shuchin Aeron

Bayesian inference in high-dimensional discrete-input additive noise models is a fundamental challenge in communication systems, as the support of the required joint a posteriori probability (APP) mass function grows exponentially with the…

Information Theory · Computer Science 2026-04-08 Luca Schmid , Dominik Sulz , Shrinivas Chimmalgi , Laurent Schmalen

Machine learning and data mining algorithms are becoming increasingly important in analyzing large volume, multi-relational and multi--modal datasets, which are often conveniently represented as multiway arrays or tensors. It is therefore…

Numerical Analysis · Computer Science 2017-09-12 A. Cichocki , N. Lee , I. V. Oseledets , A. -H. Phan , Q. Zhao , D. Mandic

Tensor trains are a versatile tool to compress and work with high-dimensional data and functions. In this work we introduce the Streaming Tensor Train Approximation (STTA), a new class of algorithms for approximating a given tensor…

Numerical Analysis · Mathematics 2022-08-05 Daniel Kressner , Bart Vandereycken , Rik Voorhaar

For three-dimensional (3D) magnetic objects with linear size $L$ exceeding a few exchange lengths, the micromagnetic state exhibits pronounced informational sparsity: low-dimensional, high-gradient regions (e.g., domain walls) coexist with…

Mesoscale and Nanoscale Physics · Physics 2026-05-01 Thierry Valet , Nicolas Vukadinovic

This paper is concerned with the approximation of tensors using tree-based tensor formats, which are tensor networks whose graphs are dimension partition trees. We consider Hilbert tensor spaces of multivariate functions defined on a…

Numerical Analysis · Mathematics 2019-09-11 Anthony Nouy

In this paper the efficiency of multilevel sparse tensor approximation methods for high-dimensional affine parametric diffusion equations is investigated. Methodologically, the recently presented Sparse Alternating Least Squares (SALS)…

Numerical Analysis · Mathematics 2026-03-17 Martin Eigel , Philipp Trunschke , Dana Wrischnig

Tensor networks have proven to be a valuable tool, for instance, in the classical simulation of (strongly correlated) quantum systems. As the size of the systems increases, contracting larger tensor networks becomes computationally…

Quantum Physics · Physics 2025-07-29 Manuel Geiger , Qunsheng Huang , Christian B. Mendl

The numerical solution of kinetic equations is challenging due to the high dimensionality of the underlying phase space. In this paper, we develop a dynamical low-rank method based on the projector-splitting integrator in tensor-train (TT)…

Numerical Analysis · Mathematics 2026-03-31 Geshuo Wang , Jingwei Hu

This paper describes the adaptation of a well-scaling parallel algorithm for computing Morse-Smale segmentations based on path compression to a distributed computational setting. Additionally, we extend the algorithm to efficiently compute…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-09-09 Michael Will , Jonas Lukasczyk , Julien Tierny , Christoph Garth

Decompositions of tensors into factor matrices, which interact through a core tensor, have found numerous applications in signal processing and machine learning. A more general tensor model which represents data as an ordered network of…

Numerical Analysis · Computer Science 2016-09-30 Anh-Huy Phan , Andrzej Cichocki , Andre Uschmajew , Petr Tichavsky , George Luta , Danilo Mandic

To address the scalability limitations of Gaussian process (GP) regression, several approximation techniques have been proposed. One such method is based on tensor networks, which utilizes an exponential number of basis functions without…

Machine Learning · Statistics 2025-12-03 Albert Saiapin , Kim Batselier

We study low rank approximation of tensors, focusing on the tensor train and Tucker decompositions, as well as approximations with tree tensor networks and more general tensor networks. For tensor train decomposition, we give a bicriteria…

Data Structures and Algorithms · Computer Science 2023-11-28 Arvind V. Mahankali , David P. Woodruff , Ziyu Zhang

In this paper, we explore the role of tensor algebra in balanced truncation (BT) based model reduction/identification for high-dimensional multilinear/linear time invariant systems. In particular, we employ tensor train decomposition (TTD),…

Systems and Control · Electrical Eng. & Systems 2020-01-28 Can Chen , Amit Surana , Anthony Bloch , Indika Rajapakse

Tensor train (TT) decomposition, a powerful tool for analyzing multidimensional data, exhibits superior performance in many machine learning tasks. However, existing methods for TT decomposition either suffer from noise overfitting, or…

Signal Processing · Electrical Eng. & Systems 2023-06-27 Le Xu , Lei Cheng , Ngai Wong , Yik-Chung Wu

Deep neural networks (DNNs) have enabled impressive breakthroughs in various artificial intelligence (AI) applications recently due to its capability of learning high-level features from big data. However, the current demand of DNNs for…

Computer Vision and Pattern Recognition · Computer Science 2020-09-22 Bijiao Wu , Dingheng Wang , Guangshe Zhao , Lei Deng , Guoqi Li