English
Related papers

Related papers: Fast elementwise operations on tensor trains with …

200 papers

Nonnegative tensors arise very naturally in many applications that involve large and complex data flows. Due to the relatively small requirement in terms of memory storage and number of operations per step, the (shifted) higher-order power…

Numerical Analysis · Mathematics 2019-08-27 Stefano Cipolla , Michela Redivo-Zaglia , Francesco Tudisco

We give two algorithms for output-sparse matrix multiplication (OSMM), the problem of multiplying two $n \times n$ matrices $A, B$ when their product $AB$ is promised to have at most $O(n^{\delta})$ many non-zero entries for a given value…

Data Structures and Algorithms · Computer Science 2025-08-15 Huck Bennett , Karthik Gajulapalli , Alexander Golovnev , Evelyn Warton

The algorithm "automated compression of environments" (ACE) [Nat. Phys. 18, 662 (2022)] provides a versatile way of simulating an extremely broad class of open quantum systems. This is achieved by encapsulating the influence of the…

Quantum Physics · Physics 2025-05-01 Moritz Cygorek , Brendon W. Lovett , Jonathan Keeling , Erik M. Gauger

Solving the Boltzmann-BGK equation with traditional numerical methods suffers from high computational and memory costs due to the curse of dimensionality. In this paper, we propose a novel accuracy-preserved tensor-train (APTT) method to…

Numerical Analysis · Mathematics 2024-05-22 Zhitao Zhu , Chuanfu Xiao , Kejun Tang , Jizu Huang , Chao Yang

We consider the problem of nonnegative tensor completion. We adopt the alternating optimization framework and solve each nonnegative matrix completion problem via a stochastic variation of the accelerated gradient algorithm. We…

Signal Processing · Electrical Eng. & Systems 2021-09-21 Ioanna Siaminou , Ioannis Marios Papagiannakos , Christos Kolomvakis , Athanasios P. Liavas

We develop new approximation algorithms and data structures for representing and computing with multivariate functions using the functional tensor-train (FT), a continuous extension of the tensor-train (TT) decomposition. The FT represents…

Numerical Analysis · Mathematics 2018-12-13 Alex A. Gorodetsky , Sertac Karaman , Youssef M. Marzouk

We propose a strategy for the generation of fast and accurate versions of non-commutative recursive matrix multiplication algorithms. To generate these algorithms, we consider matrix and tensor norm bounds governing the stability and…

Numerical Analysis · Mathematics 2025-06-25 Jean-Guillaume Dumas , Clément Pernet , Alexandre Sedoglavic

We propose a new fast randomized algorithm for interpolative decomposition of matrices which utilizes CountSketch. We then extend this approach to the tensor interpolative decomposition problem introduced by Biagioni et al. (J. Comput.…

Numerical Analysis · Mathematics 2024-12-20 Osman Asif Malik , Stephen Becker

We apply the Tensor Train (TT) decomposition to construct the tensor product Polynomial Chaos Expansion (PCE) of a random field, to solve the stochastic elliptic diffusion PDE with the stochastic Galerkin discretization, and to compute some…

Numerical Analysis · Mathematics 2015-03-12 Sergey Dolgov , Boris N. Khoromskij , Alexander Litvinenko , Hermann G. Matthies

Efficient modelling of feature interactions underpins supervised learning for non-sequential tasks, characterized by a lack of inherent ordering of features (variables). The brute force approach of learning a parameter for each interaction…

Machine Learning · Computer Science 2021-03-31 Alexandros Haliassos , Kriton Konstantinidis , Danilo P. Mandic

High-dimensional partial differential equations (PDEs) are ubiquitous in economics, science and engineering. However, their numerical treatment poses formidable challenges since traditional grid-based methods tend to be frustrated by the…

Machine Learning · Statistics 2021-07-20 Lorenz Richter , Leon Sallandt , Nikolas Nüsken

This article presents a sparse, low-memory footprint optimization algorithm for the implementation of the model predictive control (MPC) for tracking formulation in embedded systems. This MPC formulation has several advantages over standard…

Systems and Control · Electrical Eng. & Systems 2021-12-13 Pablo Krupa , Ignacio Alvarado , Daniel Limon , Teodoro Alamo

We present a novel tensor network algorithm to solve the time-dependent, gray thermal radiation transport equation. The method invokes a tensor train (TT) decomposition for the specific intensity. The efficiency of this approach is dictated…

Instrumentation and Methods for Astrophysics · Physics 2025-03-25 Alex A. Gorodetsky , Patrick D. Mullen , Aditya Deshpande , Joshua C. Dolence , Chad D. Meyer , Jonah M. Miller , Luke F. Roberts

In this work we present recent results on application of low-rank tensor decompositions to modelling of aggregation kinetics taking into account multi-particle collisions (for three and more particles). Such kinetics can be described by…

Numerical Analysis · Mathematics 2020-08-18 Daniil A. Stefonishin , Sergey A. Matveev , Dmitry A. Zheltkov

Higher-order data with high dimensionality arise in a diverse set of application areas such as computer vision, video analytics and medical imaging. Tensors provide a natural tool for representing these types of data. Although there has…

Signal Processing · Electrical Eng. & Systems 2020-08-04 Seyyid Emre Sofuoglu , Selin Aviyente

In this work, we firstly apply the Train-Tensor (TT) networks to construct a compact representation of the classical Multilayer Perceptron, representing a reduction of up to 95% of the coefficients. A comparative analysis between tensor…

Machine Learning · Computer Science 2021-03-31 M. Nazareth da Costa , R. Attux , A. Cichocki , J. M. T. Romano

We are concerned with the computation of the mean-time-to-absorption (MTTA) for a large system of loosely interconnected components, modeled as continuous time Markov chains. In particular, we show that splitting the local and…

Numerical Analysis · Mathematics 2019-07-05 Leonardo Robol , Giulio Masetti

We study piecewise affine policies for multi-stage adjustable robust optimization (ARO) problems with non-negative right-hand side uncertainty. First, we construct new dominating uncertainty sets and show how a multi-stage ARO problem can…

Optimization and Control · Mathematics 2024-02-06 Simon Thomä , Grit Walther , Maximilian Schiffer

In recent years, interest in expressing the success of neural networks to the quantum computing has increased significantly. Tensor network theory has become increasingly popular and widely used to simulate strongly entangled correlated…

Quantum Physics · Physics 2019-05-07 Amandeep Singh Bhatia , Mandeep Kaur Saggi , Ajay Kumar , Sushma Jain

This paper presents iterative methods for solving tensor equations involving the T-product. The proposed approaches apply tensor computations without matrix construction. For each initial tensor, these algorithms solve related problems in a…

Numerical Analysis · Mathematics 2025-04-28 Malihe Nobakht Kooshkghazi , Salman Ahmadi-Asl , Hamidreza Afshin