English
Related papers

Related papers: Recursive Sketched Interpolation: Efficient Hadama…

200 papers

A sum-factorization form for the evaluation of Hadamard products with a tensor product basis is derived in this work. The proposed algorithm allows for Hadamard products to be computed in $\mathcal{O}\left(n^{d+1}\right)$ flops rather than…

Numerical Analysis · Mathematics 2023-06-21 Alexander Cicchino , Siva Nadarajah

In this paper, we propose and study a fast multilevel dimension iteration (MDI) algorithm for computing arbitrary $d$-dimensional integrals based on tensor product approximations. It reduces the computational complexity (in terms of the CPU…

Numerical Analysis · Mathematics 2022-10-26 Xiaobing Feng , Huicong Zhong

Tensor decompositions have become essential tools for feature extraction and compression of multiway data. Recent advances in tensor operators have enabled desirable properties of standard matrix algebra to be retained for multilinear…

Numerical Analysis · Mathematics 2024-10-01 Katherine Keegan , Elizabeth Newman

In this article, we derive a semi-Lagrangian scheme for the solution of the Vlasov equation represented as a low-parametric tensor. Grid-based methods for the Vlasov equation have been shown to give accurate results but their use has mostly…

Numerical Analysis · Mathematics 2019-03-05 Katharina Kormann

We study the tensor renormalization group (TRG) in the dimension larger than two as the Higher-order TRG (HOTRG) with the randomized SVD method. The randomized SVD and the detailed discussion on the low order tensor representation, we can…

High Energy Physics - Lattice · Physics 2024-01-15 Katsumasa Nakayama

We introduce the tubal tensor train (TTT) decomposition, a tensor-network model that combines the t-product algebra of the tensor singular value decomposition (T-SVD) with the low-order core structure of the tensor train (TT) format. For an…

Numerical Analysis · Mathematics 2026-03-12 Salman Ahmadi-Asl , Valentin Leplat , Anh-Huy Phan , Andrzej Cichocki

We propose a new operator defined between two tensors, the broadcast product. The broadcast product calculates the Hadamard product after duplicating elements to align the shapes of the two tensors. Complex tensor operations in libraries…

Machine Learning · Computer Science 2024-09-27 Yusuke Matsui , Tatsuya Yokota

The tensor train decomposition decomposes a tensor into a "train" of 3-way tensors that are interconnected through the summation of auxiliary indices. The decomposition is stable, has a well-defined notion of rank and enables the user to…

Numerical Analysis · Computer Science 2018-11-12 Kim Batselier

This paper studies a general framework for high-order tensor SVD. We propose a new computationally efficient algorithm, tensor-train orthogonal iteration (TTOI), that aims to estimate the low tensor-train rank structure from the noisy…

Statistics Theory · Mathematics 2022-01-26 Yuchen Zhou , Anru R. Zhang , Lili Zheng , Yazhen Wang

The tensor-train (TT) format is a data-sparse tensor representation commonly used in high dimensional function approximations arising from computational and data sciences. Various sequential and parallel TT decomposition algorithms have…

Numerical Analysis · Mathematics 2025-09-05 Tianyi Shi , Daniel Hayes , Jing-Mei Qiu

The Tensor-Train (TT) format is a highly compact low-rank representation for high-dimensional tensors. TT is particularly useful when representing approximations to the solutions of certain types of parametrized partial differential…

In [8] a notion of generalized Hadamard product was introduced. We show that when certain kinds of tensors interact with the eigenvalues of symmetric matrices the resulting formulae can be nicely expressed using the generalized Hadamard…

Optimization and Control · Mathematics 2007-05-23 Hristo S. Sendov

Given a matrix $X$, and two ranks $r_1$ and $r_2$, the Hadamard decomposition (HD) looks for two low-rank matrices, $X_1$ of rank $r_1$ and $X_2$ of rank $r_2$, both of the same size as $X$, such that $X\approx X_1\circ X_2$, where $\circ$…

Optimization and Control · Mathematics 2026-05-29 Nicolas Gillis , Subhayan Saha , Stefano Sicilia , Arnaud Vandaele

The existing tensor networks adopt conventional matrix product for connection. The classical matrix product requires strict dimensionality consistency between factors, which can result in redundancy in data representation. In this paper,…

Machine Learning · Computer Science 2021-10-01 Hengling Zhao , Yipeng Liu , Xiaolin Huang , Ce Zhu

Tensor train (TT) decomposition provides a space-efficient representation for higher-order tensors. Despite its advantage, we face two crucial limitations when we apply the TT decomposition to machine learning problems: the lack of…

Machine Learning · Statistics 2017-08-03 Masaaki Imaizumi , Takanori Maehara , Kohei Hayashi

We propose new algorithms for singular value decomposition (SVD) of very large-scale matrices based on a low-rank tensor approximation technique called the tensor train (TT) format. The proposed algorithms can compute several dominant…

Numerical Analysis · Mathematics 2016-02-11 Namgil Lee , Andrzej Cichocki

The tensor-train (TT) decomposition is widely used to compress large tensors into a more compact form by exploiting their inherent data structures. A fundamental approach for constructing the TT format is the well-known TT-SVD method, which…

Numerical Analysis · Mathematics 2026-05-26 Yuchao Wang , Maolin Che , Yimin Wei

The tensor train (TT) format enjoys appealing advantages in handling structural high-order tensors. The recent decade has witnessed the wide applications of TT-format tensors from diverse disciplines, among which tensor completion has drawn…

Machine Learning · Computer Science 2022-03-22 Jian-Feng Cai , Jingyang Li , Dong Xia

We present a novel tensor interpolation algorithm for the time integration of nonlinear tensor differential equations (TDEs) on the tensor train and Tucker tensor low-rank manifolds, which are the building blocks of many tensor network…

Numerical Analysis · Mathematics 2024-06-12 Behzad Ghahremani , Hessam Babaee

We present the first application of quantics tensor trains (QTTs) and tensor cross interpolation (TCI) to the solution of a full set of self-consistent equations for multivariate functions, the so-called parquet equations. We show that the…

Strongly Correlated Electrons · Physics 2025-04-29 Stefan Rohshap , Marc K. Ritter , Hiroshi Shinaoka , Jan von Delft , Markus Wallerberger , Anna Kauch