English
Related papers

Related papers: TT-GMRES: on solution to a linear system in the st…

200 papers

In this article, we design an original solver based on Quantized Tensor Trains (QTT) for linear elliptic equations with heterogeneous coefficient field, that allows for extremely fine meshes. It can achieve full-field simulations in…

Numerical Analysis · Mathematics 2026-05-22 Marc Josien , Anas El Hachimi , Isabelle Ramière

We propose a new method for low-rank approximation of Moore-Penrose pseudoinverses (MPPs) of large-scale matrices using tensor networks. The computed pseudoinverses can be useful for solving or preconditioning of large-scale overdetermined…

Numerical Analysis · Mathematics 2016-07-06 Namgil Lee , Andrzej Cichocki

Tensor completion estimates missing components by exploiting the low-rank structure of multi-way data. The recently proposed methods based on tensor train (TT) and tensor ring (TR) show better performance in image recovery than classical…

Machine Learning · Computer Science 2020-04-24 Huyan Huang , Yipeng Liu , Ce Zhu

This paper investigates the low-rank tensor completion problem, which is about recovering a tensor from partially observed entries. We consider this problem in the tensor train format and extend the preconditioned metric from the matrix…

Optimization and Control · Mathematics 2023-04-19 Jian-Feng Cai , Wen Huang , Haifeng Wang , Ke Wei

This paper describes a flexible framework for generalized low-rank tensor estimation problems that includes many important instances arising from applications in computational imaging, genomics, and network analysis. The proposed estimator…

Statistics Theory · Mathematics 2021-02-08 Rungang Han , Rebecca Willett , Anru R. Zhang

When solving the time-dependent radiative transport equation (RTE), implicit time discretization is often employed for its robustness and stability. This results in a sequence of steady-state RTEs with identical cross-sections but varying…

Numerical Analysis · Mathematics 2026-04-24 Qinchen Song , Lei Zhang , Min Tang

We apply the Tensor Train (TT) approximation to construct the Polynomial Chaos Expansion (PCE) of a random field, and solve the stochastic elliptic diffusion PDE with the stochastic Galerkin discretization. We compare two strategies of the…

Numerical Analysis · Mathematics 2014-06-12 Sergey Dolgov , Boris N. Khoromskij , Alexander Litvinenko , Hermann G. Matthies

In this paper, we provide the first convergence guarantee for the factorization approach. Specifically, to avoid the scaling ambiguity and to facilitate theoretical analysis, we optimize over the so-called left-orthogonal TT format which…

Machine Learning · Statistics 2025-09-01 Zhen Qin , Michael B. Wakin , Zhihui Zhu

Tensor train decomposition is one of the most powerful approaches for processing high-dimensional data. For low-rank tensor train decomposition of large tensors, the alternating least squares (ALS) algorithm is widely used by updating each…

Numerical Analysis · Mathematics 2023-09-18 Zhongming Chen , Huilin Jiang , Gaohang Yu , Liqun Qi

This paper is concerned with the approximation of tensors using tree-based tensor formats, which are tensor networks whose graphs are dimension partition trees. We consider Hilbert tensor spaces of multivariate functions defined on a…

Numerical Analysis · Mathematics 2019-09-11 Anthony Nouy

The letter proposes an adaptive model reduction approach based on tensor decomposition to speed up time-domain power system simulation. Taylor series expansion of a power system dynamic model is calculated around multiple equilibria…

Systems and Control · Computer Science 2019-04-02 Denis Osipov , Kai Sun

In this paper, we introduce a high-order tensor-train (TT) finite volume method for the Shallow Water Equations (SWEs). We present the implementation of the $3^{rd}$ order Upwind and the $5^{th}$ order Upwind and WENO reconstruction schemes…

We present a stationary iteration method, namely Alternating Symmetric positive definite and Scaled symmetric positive semidefinite Splitting (ASSS), for solving the system of linear equations obtained by using finite element discretization…

Numerical Analysis · Mathematics 2021-09-06 Davod Khojasteh Salkuyeh

We discuss extended definitions of linear and multilinear operations such as Kronecker, Hadamard, and contracted products, and establish links between them for tensor calculus. Then we introduce effective low-rank tensor approximation…

Numerical Analysis · Mathematics 2016-02-26 Namgil Lee , Andrzej Cichocki

Large language models (LLMs) are both storage-intensive and computation-intensive, posing significant challenges when deployed on resource-constrained hardware. As linear layers in LLMs are mainly resource consuming parts, this paper…

Hardware Architecture · Computer Science 2025-02-03 Sixiao Huang , Tintin Wang , Ang Li , Ao Shen , Kai Li , Keyao Jiang , Mingqiang Huang , Hao Yu

Tensor network methods provide a scalable solution to represent high-dimensional data. However, their efficacy is often limited by static, expert-defined structures that fail to adapt to evolving data correlations. We address this…

Computational Engineering, Finance, and Science · Computer Science 2026-03-31 Zheng Guo , Aditya Deshpande , Xinyu Wang , Brian C. Kiedrowski , Alex A. Gorodetsky

Sampling from probability densities is a common challenge in fields such as Uncertainty Quantification (UQ) and Generative Modelling (GM). In GM in particular, the use of reverse-time diffusion processes depending on the log-densities of…

Machine Learning · Statistics 2024-02-26 David Sommer , Robert Gruhlke , Max Kirstein , Martin Eigel , Claudia Schillings

Advanced tensor decomposition, such as Tensor train (TT) and Tensor ring (TR), has been widely studied for deep neural network (DNN) model compression, especially for recurrent neural networks (RNNs). However, compressing convolutional…

Computer Vision and Pattern Recognition · Computer Science 2021-07-28 Miao Yin , Yang Sui , Siyu Liao , Bo Yuan

There are several different notions of "low rank" for tensors, associated to different formats. Among them, the Tensor Train (TT) format is particularly well suited for tensors of high order, as it circumvents the curse of dimensionality:…

Optimization and Control · Mathematics 2020-11-30 Michael Psenka , Nicolas Boumal

We present a method for converting tensors into tensor train format based on actions of the tensor as a vector-valued multilinear function. Existing methods for constructing tensor trains require access to "array entries" of the tensor and…

Numerical Analysis · Mathematics 2020-08-06 Nick Alger , Peng Chen , Omar Ghattas