English
Related papers

Related papers: A robust GMRES algorithm in Tensor Train format

200 papers

To determine the optimal set of hyperparameters of a Gaussian process based on a large number of training data, both a linear system and a trace estimation problem must be solved. In this paper, we focus on establishing numerical methods…

Optimization and Control · Mathematics 2023-12-27 Josie König , Max Pfeffer , Martin Stoll

We consider the problem of recovering a low-multilinear-rank tensor from a small amount of linear measurements. We show that the Riemannian gradient algorithm initialized by one step of iterative hard thresholding can reconstruct an…

Numerical Analysis · Mathematics 2021-01-14 Jian-Feng Cai , Lizhang Miao , Yang Wang , Yin Xian

Low rank tensor representation underpins much of recent progress in tensor completion. In real applications, however, this approach is confronted with two challenging problems, namely (1) tensor rank determination; (2) handling real tensor…

Computer Vision and Pattern Recognition · Computer Science 2017-08-04 Lei Zhang , Wei Wei , Qinfeng Shi , Chunhua Shen , Anton van den Hengel , Yanning Zhang

In recent years, there have been an increasing number of applications of tensor completion based on the tensor train (TT) format because of its efficiency and effectiveness in dealing with higher-order tensor data. However, existing tensor…

Computer Vision and Pattern Recognition · Computer Science 2022-01-25 Yang Zhang , Yao Wang , Zhi Han , Xi'ai Chen , Yandong Tang

The advancement of sensing technology has driven the widespread application of high-dimensional data. However, issues such as missing entries during acquisition and transmission negatively impact the accuracy of subsequent tasks. Tensor…

Image and Video Processing · Electrical Eng. & Systems 2025-04-09 Jie Yang , Chang Su , Yuhan Zhang , Jianjun Zhu , Jianli Wang

In recent works, both sparsity-based methods as well as learning-based methods have proven to be successful in solving several challenging linear inverse problems. However, sparsity priors for natural signals and images suffer from poor…

Machine Learning · Statistics 2018-02-26 Viraj Shah , Chinmay Hegde

The tensor train decomposition decomposes a tensor into a "train" of 3-way tensors that are interconnected through the summation of auxiliary indices. The decomposition is stable, has a well-defined notion of rank and enables the user to…

Numerical Analysis · Computer Science 2018-11-12 Kim Batselier

This paper proposes a novel method for learning highly nonlinear, multivariate functions from examples. Our method takes advantage of the property that continuous functions can be approximated by polynomials, which in turn are representable…

Machine Learning · Computer Science 2020-05-05 Sandor Szedmak , Anna Cichonska , Heli Julkunen , Tapio Pahikkala , Juho Rousu

We discuss extended definitions of linear and multilinear operations such as Kronecker, Hadamard, and contracted products, and establish links between them for tensor calculus. Then we introduce effective low-rank tensor approximation…

Numerical Analysis · Mathematics 2016-02-26 Namgil Lee , Andrzej Cichocki

Deep learning has shown successful application in visual recognition and certain artificial intelligence tasks. Deep learning is also considered as a powerful tool with high flexibility to approximate functions. In the present work,…

Machine Learning · Computer Science 2021-12-23 Ayan Chakraborty , Thomas Wick , Xiaoying Zhuang , Timon Rabczuk

A tensor network is a type of decomposition used to express and approximate large arrays of data. A given data-set, quantum state or higher dimensional multi-linear map is factored and approximated by a composition of smaller multi-linear…

Quantum Physics · Physics 2022-07-08 Richik Sengupta , Soumik Adhikary , Ivan Oseledets , Jacob Biamonte

We propose a new algorithm for the computation of a singular value decomposition (SVD) low-rank approximation of a matrix in the Matrix Product Operator (MPO) format, also called the Tensor Train Matrix format. Our tensor network randomized…

Numerical Analysis · Mathematics 2017-07-26 Kim Batselier , Wenjian Yu , Luca Daniel , Ngai Wong

The numerical solution of partial differential equations on high-dimensional domains gives rise to computationally challenging linear systems. When using standard discretization techniques, the size of the linear system grows exponentially…

Numerical Analysis · Mathematics 2015-08-13 Daniel Kressner , Michael Steinlechner , Bart Vandereycken

Inverse problems are in many cases solved with optimization techniques. When the underlying model is linear, first-order gradient methods are usually sufficient. With nonlinear models, due to nonconvexity, one must often resort to…

Numerical Analysis · Mathematics 2023-05-15 Arttu Arjas , Mikko J. Sillanpää , Andreas Hauptmann

We present a novel deep learning approach to approximate the solution of large, sparse, symmetric, positive-definite linear systems of equations. These systems arise from many problems in applied science, e.g., in numerical methods for…

Machine Learning · Computer Science 2022-10-04 Ayano Kaneda , Osman Akar , Jingyu Chen , Victoria Kala , David Hyde , Joseph Teran

Nonlinear filtering with correlated noise leads to a Duncan-Mortensen-Zakai (DMZ) equation in the form of a stochastic partial differential equation (SPDE). Unlike the independent noise case, the presence of correlation prevents the…

Numerical Analysis · Mathematics 2026-05-26 Yuhua Meng , Stephen S. -T. Yau , Zhiwen Zhang

The so-called block-term decomposition (BTD) tensor model has been recently receiving increasing attention due to its enhanced ability of representing systems and signals that are composed of \emph{blocks} of rank higher than one, a…

Numerical Analysis · Mathematics 2021-04-21 Athanasios A. Rontogiannis , Eleftherios Kofidis , Paris V. Giampouras

Tree tensor networks such as the tensor train format are a common tool for high dimensional problems. The associated multivariate rank and accordant tuples of singular values are based on different matricizations of the same tensor. While…

Numerical Analysis · Mathematics 2019-04-10 Sebastian Krämer

We study the problem of recovery of matrices that are simultaneously low rank and row and/or column sparse. Such matrices appear in recent applications in cognitive neuroscience, imaging, computer vision, macroeconomics, and genetics. We…

Machine Learning · Statistics 2019-04-11 Ming Yu , Varun Gupta , Mladen Kolar

Multiscale Models are known to be successful in uncovering and analyzing the structures in data at different resolutions. In the current work we propose a feature driven Reproducing Kernel Hilbert space (RKHS), for which the associated…

Machine Learning · Computer Science 2022-08-24 Prashant Shekhar , Abani Patra