English
Related papers

Related papers: Wedderburn rank reduction and Krylov subspace meth…

200 papers

Unlike the matrix case, computing low-rank approximations of tensors is NP-hard and numerically ill-posed in general. Even the best rank-1 approximation of a tensor is NP-hard. In this paper, we use convex optimization to develop…

Statistics Theory · Mathematics 2016-09-14 Anil Aswani

This paper is concerned with the approximation of tensors using tree-based tensor formats, which are tensor networks whose graphs are dimension partition trees. We consider Hilbert tensor spaces of multivariate functions defined on a…

Numerical Analysis · Mathematics 2019-09-11 Anthony Nouy

We consider an effective new method for solving trust-region and norm-regularization problems that arise as subproblems in many optimization applications. We show that the solutions to such subproblems effectively lie in a…

Numerical Analysis · Mathematics 2026-03-03 Hussam Al Daas , Nicholas I. M. Gould

In this paper we extend the Residual Arnoldi method for calculating an extreme eigenvalue (e.g. largest real part, dominant,...) to the case where the matrices depend on parameters. The difference between this Arnoldi method and the…

Numerical Analysis · Mathematics 2020-12-18 Koen Ruymbeek , Karl Meerbergen , Wim Michiels

Existing methods of vector autoregressive model for multivariate time series analysis make use of low-rank matrix approximation or Tucker decomposition to reduce the dimension of the over-parameterization issue. In this paper, we propose a…

Statistics Theory · Mathematics 2026-01-05 Sijia Xia , Michael K. Ng , Xiongjun Zhang

In this research, we solve polynomial, Sobolev polynomial, rational, and Sobolev rational least squares problems. Although the increase in the approximation degree allows us to fit the data better in attacking least squares problems, the…

Numerical Analysis · Mathematics 2024-07-09 Amin Faghih , Marc Van Barel , Niel Van Buggenhout , Raf Vandebril

We consider generalizations of the Sylvester matrix equation, consisting of the sum of a Sylvester operator and a linear operator $\Pi$ with a particular structure. More precisely, the commutator of the matrix coefficients of the operator…

Numerical Analysis · Mathematics 2019-06-18 Elias Jarlebring , Giampaolo Mele , Davide Palitta , Emil Ringh

In classical frameworks as the Euclidean space, positive definite kernels as well as their analytic properties are explicitly available and can be incorporated directly in kernel-based learning algorithms. This is different if the…

Numerical Analysis · Mathematics 2023-01-18 Wolfgang Erb

Because of the attractiveness of the canonical polyadic (CP) tensor decomposition in various applications, several algorithms have been designed to compute it, but efficient ones are still lacking. Iterative deflation algorithms based on…

Numerical Analysis · Computer Science 2015-08-24 Alex Pereira da Silva , Pierre Comon , Andre Lima Ferrer de Almeida

We develop a new method HTBB for the multidimensional black-box approximation and gradient-free optimization, which is based on the low-rank hierarchical Tucker decomposition with the use of the MaxVol indices selection procedure. Numerical…

Machine Learning · Computer Science 2024-02-06 Gleb Ryzhakov , Andrei Chertkov , Artem Basharin , Ivan Oseledets

We consider iterative (`turbo') algorithms for compressed sensing. First, a unified exposition of the different approaches available in the literature is given, thereby enlightening the general principles and main differences. In particular…

Information Theory · Computer Science 2017-05-22 Robert F. H. Fischer , Susanne Sparrer

This work is concerned with the computation of the action of a matrix function f(A), such as the matrix exponential or the matrix square root, on a vector b. For a general matrix A, this can be done by computing the compression of A onto a…

Numerical Analysis · Mathematics 2023-06-06 Alice Cortinovis , Daniel Kressner , Yuji Nakatsukasa

For a given matrix subspace, how can we find a basis that consists of low-rank matrices? This is a generalization of the sparse vector problem. It turns out that when the subspace is spanned by rank-1 matrices, the matrices can be obtained…

Numerical Analysis · Computer Science 2016-06-29 Yuji Nakatsukasa , Tasuku Soma , André Uschmajew

Tensor train (TT) format is a common approach for computationally efficient work with multidimensional arrays, vectors, matrices, and discretized functions in a wide range of applications, including computational mathematics and machine…

Numerical Analysis · Mathematics 2022-09-30 Andrei Chertkov , Gleb Ryzhakov , Georgii Novikov , Ivan Oseledets

Recently, a tensor factorization based method for a low tubal rank tensor completion problem of a third order tensor was proposed, which performed better than some existing methods. Tubal rank is only defined on one mode of third order…

Optimization and Control · Mathematics 2024-08-20 Quan Yu , Xinzhen Zhang , Zheng-Hai Huang

A CUR approximation of a matrix $A$ is a particular type of low-rank approximation $A \approx C U R$, where $C$ and $R$ consist of columns and rows of $A$, respectively. One way to obtain such an approximation is to apply column subset…

Numerical Analysis · Mathematics 2019-08-19 Alice Cortinovis , Daniel Kressner

Projected gradient descent and its Riemannian variant belong to a typical class of methods for low-rank matrix estimation. This paper proposes a new Nesterov's Accelerated Riemannian Gradient algorithm by efficient orthographic retraction…

Optimization and Control · Mathematics 2023-06-05 Hongyi Li , Zhen Peng , Chengwei Pan , Di Zhao

A classical problem in matrix computations is the efficient and reliable approximation of a given matrix by a matrix of lower rank. The truncated singular value decomposition (SVD) is known to provide the best such approximation for any…

Numerical Analysis · Mathematics 2014-08-12 Ming Gu

We propose a block coordinate descent type algorithm for estimating the rank of a given tensor. In addition, the algorithm provides the canonical polyadic decomposition of a tensor. In order to estimate the tensor rank we use sparse…

Numerical Analysis · Mathematics 2019-04-30 Ramin Goudarzi Karim , Carmeliza Navasca , Da Yan

In this work, we present the tree tensor network Nystr\"om (TTNN), an algorithm that extends recent research on streamable tensor approximation, such as for Tucker and tensor-train formats, to the more general tree tensor network format,…

Numerical Analysis · Mathematics 2024-12-10 Alberto Bucci , Gianfranco Verzella