English
Related papers

Related papers: Local Interpolation via Low-Rank Tensor Trains

200 papers

We present a novel tensor interpolation algorithm for the time integration of nonlinear tensor differential equations (TDEs) on the tensor train and Tucker tensor low-rank manifolds, which are the building blocks of many tensor network…

Numerical Analysis · Mathematics 2024-06-12 Behzad Ghahremani , Hessam Babaee

Despite their high accuracy, complex neural networks demand significant computational resources, posing challenges for deployment on resource constrained devices such as mobile phones and embedded systems. Compression algorithms have been…

Machine Learning · Computer Science 2025-09-23 Ali Aghababaei-Harandi , Massih-Reza Amini

The tensor-train (TT) decomposition expresses a tensor in a data-sparse format used in molecular simulations, high-order correlation functions, and optimization. In this paper, we propose four parallelizable algorithms that compute the TT…

Numerical Analysis · Mathematics 2021-11-23 Tianyi Shi , Maximilian Ruth , Alex Townsend

Recently, triple decomposition has attracted increasing attention for decomposing third-order tensors into three factor tensors. However, this approach is limited to third-order tensors and enforces uniformity in the lower dimensions across…

Numerical Analysis · Mathematics 2025-11-14 Kunjing Yang , Libin Zheng , Minru Bai

Real-world physical systems, like composite materials and porous media, exhibit complex heterogeneities and multiscale nature, posing significant computational challenges. Computational homogenization is useful for predicting macroscopic…

Computational Engineering, Finance, and Science · Computer Science 2024-07-29 Yuki Sato , Yuto Lewis Terashima , Ruho Kondo

We propose a multilevel tensor-train (TT) framework for solving nonlinear partial differential equations (PDEs) in a global space-time formulation. While space-time TT solvers have demonstrated significant potential for compressed…

Numerical Analysis · Mathematics 2026-02-10 N. R. Rapaka , R. Peddinti , E. Tiunov , N. J. Faraj , A. N. Alkhooori , L. Aolita , Y. Addad , M. K. Riahi

In this paper, we aim at the completion problem of high order tensor data with missing entries. The existing tensor factorization and completion methods suffer from the curse of dimensionality when the order of tensor N>>3. To overcome this…

Numerical Analysis · Computer Science 2017-09-15 Longhao Yuan , Qibin Zhao , Jianting Cao

We study low-rank parameterizations of weight matrices with embedded spectral properties in the Deep Learning context. The low-rank property leads to parameter efficiency and permits taking computational shortcuts when computing mappings.…

Machine Learning · Computer Science 2021-07-15 Anton Obukhov , Maxim Rakhuba , Alexander Liniger , Zhiwu Huang , Stamatios Georgoulis , Dengxin Dai , Luc Van Gool

We introduce a low-rank framework for adaptive isogeometric analysis with truncated hierarchical B-splines (THB-splines) that targets the main bottleneck of local refinement: memory- and time-intensive matrix assembly once the global…

Numerical Analysis · Mathematics 2025-09-12 Tom-Christian Riemer , Martin Stoll

The goals of this work are two-fold: firstly, to propose a new theoretical framework for representing random fields on a large class of multidimensional geometrical domain in the tensor train format; secondly, to develop a new algorithm…

Numerical Analysis · Mathematics 2020-05-26 Ling-Ze Bu , Wei Zhao , Wei Wang

Various tensor decomposition methods have been proposed for data compression. In real world applications of the tensor decomposition, selecting the tensor shape for the given data poses a challenge and the shape of the tensor may affect the…

Image and Video Processing · Electrical Eng. & Systems 2022-05-24 Ryan Solgi , Zichang He , William Jiahua Liang , Zheng Zhang

This paper lies in the intersection of several fields: number theory, lattice theory, multilinear algebra, and scientific computing. We adapt existing solution algorithms for tensor eigenvalue problems to the tensor-train framework. As an…

Numerical Analysis · Mathematics 2017-10-05 Harri Hakula , Pauliina Ilmonen , Vesa Kaarnioja

Treating high dimensionality is one of the main challenges in the development of computational methods for solving problems arising in finance, where tasks such as pricing, calibration, and risk assessment need to be performed accurately…

Computational Finance · Quantitative Finance 2019-02-13 Kathrin Glau , Daniel Kressner , Francesco Statti

We consider the approximate solution of parametric PDEs using the low-rank Tensor Train (TT) decomposition. Such parametric PDEs arise for example in uncertainty quantification problems in engineering applications. We propose an algorithm…

Numerical Analysis · Mathematics 2018-07-06 Sergey Dolgov , Robert Scheichl

Large-scale Dynamic Networks (LDNs) are becoming increasingly important in the Internet age, yet the dynamic nature of these networks captures the evolution of the network structure and how edge weights change over time, posing unique…

Machine Learning · Computer Science 2023-04-19 Qu Wang

Quantized tensor trains (QTTs) are a low-rank and multiscale framework that allows for efficient approximation and manipulation of multi-dimensional, high resolution data. One area of active research is their use in numerical simulation of…

Numerical Analysis · Mathematics 2025-12-18 Erika Ye , Chao Yang

Tensor ring (TR) decomposition is a simple but effective tensor network for analyzing and interpreting latent patterns of tensors. In this work, we propose a doubly randomized optimization framework for computing TR decomposition. It can be…

Numerical Analysis · Mathematics 2023-03-30 Yajie Yu , Hanyu Li , Jingchun Zhou

Many real-world datasets are represented as tensors, i.e., multi-dimensional arrays of numerical values. Storing them without compression often requires substantial space, which grows exponentially with the order. While many tensor…

Machine Learning · Computer Science 2023-09-21 Taehyung Kwon , Jihoon Ko , Jinhong Jung , Kijung Shin

We present efficient and scalable parallel algorithms for performing mathematical operations for low-rank tensors represented in the tensor train (TT) format. We consider algorithms for addition, elementwise multiplication, computing norms…

Numerical Analysis · Mathematics 2021-09-08 Hussam Al Daas , Grey Ballard , Peter Benner

Low-rank tensor representation (LRTR) has emerged as a powerful tool for multi-dimensional data processing. However, classical LRTR-based methods face two critical limitations: (1) they typically assume that the holistic data is low-rank,…

Computer Vision and Pattern Recognition · Computer Science 2025-08-21 Zhizhou Wang , Jianli Wang , Ruijing Zheng , Zhenyu Wu