English
Related papers

Related papers: Riemannian Conjugate Gradient Descent Method for T…

200 papers

This paper studies the rank-$1$ tensor completion problem for cubic tensors. First of all, we show that this problem is equivalent to a special rank-$1$ matrix recovery problem. When the tensor is strongly rank-$1$ completable, we show that…

Optimization and Control · Mathematics 2024-10-23 Jinling Zhou , Jiawang Nie , Zheng Peng , Guangming Zhou

The problem of low-tubal-rank tensor estimation is a fundamental task with wide applications across high-dimensional signal processing, machine learning, and image science. Traditional approaches tackle such a problem by performing tensor…

Machine Learning · Computer Science 2025-12-24 Zhiyu Liu , Zhi Han , Yandong Tang , Jun Fan , Yao Wang

In this paper, we propose three approaches for the estimation of the Tucker decomposition of multi-way arrays (tensors) from partial observations. All approaches are formulated as convex minimization problems. Therefore, the minimum is…

Machine Learning · Statistics 2015-03-17 Ryota Tomioka , Kohei Hayashi , Hisashi Kashima

Tensor decomposition is a mathematically supported technique for data compression. It consists of applying some kind of a Low Rank Decomposition technique on the tensors or matrices in order to reduce the redundancy of the data. However, it…

Machine Learning · Computer Science 2025-05-27 Habib Hajimolahoseini , Walid Ahmed , Austin Wen , Yang Liu

In the noisy tensor completion problem we observe $m$ entries (whose location is chosen uniformly at random) from an unknown $n_1 \times n_2 \times n_3$ tensor $T$. We assume that $T$ is entry-wise close to being rank $r$. Our goal is to…

Machine Learning · Computer Science 2016-02-19 Boaz Barak , Ankur Moitra

The linear transform-based tensor nuclear norm (TNN) methods have recently obtained promising results for tensor completion. The main idea of this type of methods is exploiting the low-rank structure of frontal slices of the targeted tensor…

Computer Vision and Pattern Recognition · Computer Science 2021-10-19 Ben-Zheng Li , Xi-Le Zhao , Teng-Yu Ji , Xiong-Jun Zhang , Ting-Zhu Huang

Provably finding stationary points on bounded-rank tensors turns out to be an open problem [E. Levin, J. Kileel, and N. Boumal, Math. Program., 199 (2023), pp. 831--864] due to the inherent non-smoothness of the set of bounded-rank tensors.…

Optimization and Control · Mathematics 2026-05-14 Bin Gao , Renfeng Peng , Ya-xiang Yuan

We analyze inexact Riemannian gradient descent (RGD) where Riemannian gradients and retractions are inexactly (and cheaply) computed. Our focus is on understanding when inexact RGD converges and what is the complexity in the general…

Optimization and Control · Mathematics 2024-05-10 Yuchen Li , Laura Balzano , Deanna Needell , Hanbaek Lyu

Tensor train (TT) decomposition provides a space-efficient representation for higher-order tensors. Despite its advantage, we face two crucial limitations when we apply the TT decomposition to machine learning problems: the lack of…

Machine Learning · Statistics 2017-08-03 Masaaki Imaizumi , Takanori Maehara , Kohei Hayashi

The goal of this paper is to find a low-rank approximation for a given tensor. Specifically, we give a computable strategy on calculating the rank of a given tensor, based on approximating the solution to an NP-hard problem. In this paper,…

Numerical Analysis · Mathematics 2016-10-20 Xiaofei Wang , Carmeliza Navasca

This paper studies tensors that admit decomposition in the Extended Tensor Train (ETT) format, with a key focus on the case where some decomposition factors are constrained to be equal. This factor sharing introduces additional challenges,…

Numerical Analysis · Mathematics 2025-08-29 Alexander Molozhavenko , Maxim Rakhuba

In this paper, we aim at the problem of tensor data completion. Tensor-train decomposition is adopted because of its powerful representation ability and linear scalability to tensor order. We propose an algorithm named Sparse Tensor-train…

Numerical Analysis · Computer Science 2018-03-23 Longhao Yuan , Qibin Zhao , Jianting Cao

In this paper, we study Riemannian zeroth-order optimization in settings where the underlying Riemannian metric $g$ is geodesically incomplete, and the goal is to approximate stationary points with respect to this incomplete metric. To…

Machine Learning · Computer Science 2026-04-14 Shaocong Ma , Heng Huang

Tensor train (TT) factorization and corresponding TT rank, which can well express the low-rankness and mode correlations of higher-order tensors, have attracted much attention in recent years. However, TT factorization based methods are…

Image and Video Processing · Electrical Eng. & Systems 2022-05-09 Gaohang Yu , Shaochun Wan , Liqun Qi , Yanwei Xu

We define the reduced biquaternion tensor ring (RBTR) decomposition and provide a detailed exposition of the corresponding algorithm RBTR-SVD. Leveraging RBTR decomposition, we propose a novel low-rank tensor completion algorithm RBTR-TV…

Commutative Algebra · Mathematics 2025-01-10 Hui Luo , Xin Liu , Wei Liu , Yang Zhang

The tensor rank decomposition, also known as canonical polyadic(CP) or simply tensor decomposition, has a long history in multilinear algebra. However, computing a rank decomposition becomes particularly challenging when the rank lies…

Optimization and Control · Mathematics 2025-11-11 Zequn Zheng , Hongchao Zhang , Guangming Zhou

We propose a novel Riemannian method for solving the Extreme multi-label classification problem that exploits the geometric structure of the sparse low-dimensional local embedding models. A constrained optimization problem is formulated as…

Optimization and Control · Mathematics 2021-10-01 Jayadev Naram , Tanmay Kumar Sinha , Pawan Kumar

In this paper, we investigate the sample size requirement for exact recovery of a high order tensor of low rank from a subset of its entries. We show that a gradient descent algorithm with initial value obtained from a spectral method can,…

Machine Learning · Statistics 2017-02-27 Dong Xia , Ming Yuan

A matrix completion problem is to recover the missing entries in a partially observed matrix. Most of the existing matrix completion methods assume a low rank structure of the underlying complete matrix. In this paper, we introduce an…

Machine Learning · Statistics 2020-11-16 Chencheng Cai , Rong Chen , Han Xiao

This paper addresses the problem of low-rank distance matrix completion. This problem amounts to recover the missing entries of a distance matrix when the dimension of the data embedding space is possibly unknown but small compared to the…

Optimization and Control · Mathematics 2013-04-26 B. Mishra , G. Meyer , R. Sepulchre