English
Related papers

Related papers: Optimal Rank-1 Directional State Transition Tensor…

200 papers

In this paper, we consider the estimation of a low Tucker rank tensor from a number of noisy linear measurements. The general problem covers many specific examples arising from applications, including tensor regression, tensor completion,…

Machine Learning · Statistics 2023-07-11 Yuetian Luo , Anru R. Zhang

In this paper, we propose an algorithm for the construction of low-rank approximations of the inverse of an operator given in low-rank tensor format. The construction relies on an updated greedy algorithm for the minimization of a suitable…

Numerical Analysis · Mathematics 2017-05-11 Loic Giraldi , Anthony Nouy , Gregory Legrain

An optimization-based approach for the Tucker tensor approximation of parameter-dependent data tensors and solutions of tensor differential equations with low Tucker rank is presented. The problem of updating the tensor decomposition is…

Optimization and Control · Mathematics 2019-05-31 Lukas Exl

In this paper, we investigate the statistical convergence rate of a Bayesian low-rank tensor estimator. Our problem setting is the regression problem where a tensor structure underlying the data is estimated. This problem setting occurs in…

Machine Learning · Statistics 2014-08-14 Taiji Suzuki

Tensor train decomposition is widely used in machine learning and quantum physics due to its concise representation of high-dimensional tensors, overcoming the curse of dimensionality. Cross approximation-originally developed for…

Machine Learning · Computer Science 2023-06-27 Zhen Qin , Alexander Lidiak , Zhexuan Gong , Gongguo Tang , Michael B. Wakin , Zhihui Zhu

The problem of symmetric rank-one approximation of symmetric tensors is important in Independent Components Analysis, also known as Blind Source Separation, as well as polynomial optimization. We analyze the symmetric rank-one approximation…

Computation · Statistics 2011-12-14 Michael James O'Hara

This paper studies the rank-$1$ tensor completion problem for cubic tensors. First of all, we show that this problem is equivalent to a special rank-$1$ matrix recovery problem. When the tensor is strongly rank-$1$ completable, we show that…

Optimization and Control · Mathematics 2024-10-23 Jinling Zhou , Jiawang Nie , Zheng Peng , Guangming Zhou

We study the problem of finding orthogonal low-rank approximations of symmetric tensors. In the case of matrices, the approximation is a truncated singular value decomposition which is then symmetric. Moreover, for rank-one approximations…

Numerical Analysis · Mathematics 2019-06-18 Oscar Mickelin , Sertac Karaman

The results of Strassen and Raz show that good enough tensor rank lower bounds have implications for algebraic circuit/formula lower bounds. We explore tensor rank lower and upper bounds, focusing on explicit tensors. For odd d, we…

Computational Complexity · Computer Science 2012-03-05 Boris Alexeev , Michael Forbes , Jacob Tsimerman

There has been growing interest in extending traditional vector-based machine learning techniques to their tensor forms. An example is the support tensor machine (STM) that utilizes a rank-one tensor to capture the data structure, thereby…

Machine Learning · Computer Science 2018-04-18 Cong Chen , Kim Batselier , Ching-Yun Ko , Ngai Wong

We present an approach to identify topological order based on unbiased infinite projected entangled-pair states (iPEPS) simulations, i.e. where we do not impose a virtual symmetry on the tensors during the optimization of the tensor network…

Strongly Correlated Electrons · Physics 2020-09-04 S. P. G. Crone , P. Corboz

We characterize optimal rank-1 matrix approximations with Hankel or Toeplitz structure with regard to two different norms, the Frobenius norm and the spectral norm, in a new way. More precisely, we show that these rank-1 matrix…

Numerical Analysis · Mathematics 2021-03-09 Hanna Knirsch , Markus Petz , Gerlind Plonka

Motivated by the many potential applications of low-rank multi-way tensor approximations, we set out to count the rank-one tensors that are critical points of the distance function to a general tensor v. As this count depends on v, we…

Optimization and Control · Mathematics 2017-10-10 Jan Draisma , Emil Horobet

Low rank tensor representation underpins much of recent progress in tensor completion. In real applications, however, this approach is confronted with two challenging problems, namely (1) tensor rank determination; (2) handling real tensor…

Computer Vision and Pattern Recognition · Computer Science 2017-08-04 Lei Zhang , Wei Wei , Qinfeng Shi , Chunhua Shen , Anton van den Hengel , Yanning Zhang

We introduce the tensor numerical method for solving optimal control problems that are constrained by fractional 2D and 3D elliptic operators with variable coefficients. We solve the governing equation for the control function which…

Numerical Analysis · Mathematics 2020-07-07 Britta Schmitt , Boris N. Khoromskij , Venera Khoromskaia , Volker Schulz

We propose a numerical method to obtain an adequate value for the upper bound on the rank for the tensor completion problem on the variety of third-order tensors of bounded tensor-train rank. The method is inspired by the parametrization of…

Optimization and Control · Mathematics 2024-09-10 Charlotte Vermeylen , Guillaume Olikier , P. -A. Absil , Marc Van Barel

Low rank tensor learning, such as tensor completion and multilinear multitask learning, has received much attention in recent years. In this paper, we propose higher order matching pursuit for low rank tensor learning problems with a convex…

Machine Learning · Statistics 2015-03-10 Yuning Yang , Siamak Mehrkanoon , Johan A. K. Suykens

By a tensor we mean an element of a tensor product of vector spaces over a field. Up to a choice of bases in factors of tensor products, every tensor may be coordinatized, that is, represented as an array consisting of numbers. This note is…

Functional Analysis · Mathematics 2019-01-11 R. N. Gumerov , A. S. Sharafutdinov

We present an efficient low-rank approximation algorithm for non-negative tensors. The algorithm is derived from our two findings: First, we show that rank-1 approximation for tensors can be viewed as a mean-field approximation by treating…

Machine Learning · Statistics 2021-10-26 Kazu Ghalamkari , Mahito Sugiyama

Rank-metric codes are subspaces of matrices over finite fields endowed with the rank metric and admit a natural tensorial representation. The tensor rank provides a measure of the minimal size of a decomposition of a code into rank-one…

Information Theory · Computer Science 2026-05-22 Matteo Bonini , Eimear Byrne , Giuseppe Cotardo