English
Related papers

Related papers: A Single-Mode Quasi Riemannian Gradient Descent Al…

200 papers

Low-rank tensor completion aims to recover a tensor from partially observed entries, and it is widely applicable in fields such as quantum computing and image processing. Due to the significant advantages of the tensor train (TT) format in…

Machine Learning · Computer Science 2025-01-24 Fengmiao Bian , Jian-Feng Cai , Xiaoqun Zhang , Yuanwei Zhang

We consider the problem of recovering a low-multilinear-rank tensor from a small amount of linear measurements. We show that the Riemannian gradient algorithm initialized by one step of iterative hard thresholding can reconstruct an…

Numerical Analysis · Mathematics 2021-01-14 Jian-Feng Cai , Lizhang Miao , Yang Wang , Yin Xian

The low-rank matrix recovery problem often arises in various fields, including signal processing, machine learning, and imaging science. The Riemannian gradient descent (RGD) algorithm has proven to be an efficient algorithm for solving…

Optimization and Control · Mathematics 2023-05-05 Fengmiao Bian , Jian-Feng Cai , Rui Zhang

Projected gradient descent and its Riemannian variant belong to a typical class of methods for low-rank matrix estimation. This paper proposes a new Nesterov's Accelerated Riemannian Gradient algorithm by efficient orthographic retraction…

Optimization and Control · Mathematics 2023-06-05 Hongyi Li , Zhen Peng , Chengwei Pan , Di Zhao

Recovering a low-CP-rank tensor from noisy linear measurements is a central challenge in high-dimensional data analysis, with applications spanning tensor PCA, tensor regression, and beyond. We exploit the intrinsic geometry of rank-one…

Machine Learning · Statistics 2025-10-02 Ke Xu , Yuefeng Han

We study the stochastic Riemannian gradient algorithm for matrix eigen-decomposition. The state-of-the-art stochastic Riemannian algorithm requires the learning rate to decay to zero and thus suffers from slow convergence and sub-optimal…

Machine Learning · Computer Science 2016-05-30 Zhiqiang Xu , Yiping Ke

We establish theoretical recovery guarantees of a family of Riemannian optimization algorithms for low rank matrix recovery, which is about recovering an $m\times n$ rank $r$ matrix from $p < mn$ number of linear measurements. The…

Numerical Analysis · Mathematics 2016-04-12 Ke Wei , Jian-Feng Cai , Tony F. Chan , Shingyu Leung

We study a type of Riemannian gradient descent (RGD) algorithm, designed through Riemannian preconditioning, for optimization on $\mathcal{M}_k^{m\times n}$ -- the set of $m\times n$ real matrices with a fixed rank $k$. Our analysis is…

Optimization and Control · Mathematics 2024-08-15 Shuyu Dong , Bin Gao , Wen Huang , Kyle A. Gallivan

The goal of tensor completion is to fill in missing entries of a partially known tensor under a low-rank constraint. In this paper, we mainly study low rank third-order tensor completion problems by using Riemannian optimization methods on…

Optimization and Control · Mathematics 2020-11-24 Guang-Jing Song , Xue-Zhong Wang , Michael K. Ng

We propose a generic framework based on a new stochastic variance-reduced gradient descent algorithm for accelerating nonconvex low-rank matrix recovery. Starting from an appropriate initial estimator, our proposed algorithm performs…

Machine Learning · Statistics 2017-01-20 Lingxiao Wang , Xiao Zhang , Quanquan Gu

We initiate the study of online quantum state tomography (QST), where the matrix representation of an unknown quantum state is reconstructed by sequentially performing a batch of measurements and updating the state estimate using only the…

Quantum Physics · Physics 2025-07-11 Jian-Feng Cai , Yuling Jiao , Yinan Li , Xiliang Lu , Jerry Zhijian Yang , Juntao You

We study extensions of compressive sensing and low rank matrix recovery (matrix completion) to the recovery of low rank tensors of higher order from a small number of linear measurements. While the theoretical understanding of low rank…

Information Theory · Computer Science 2016-02-18 Holger Rauhut , Reinhold Schneider , Zeljka Stojanac

In this paper, we propose a new global analysis framework for a class of low-rank matrix recovery problems on the Riemannian manifold. We analyze the global behavior for the Riemannian optimization with random initialization. We use the…

Machine Learning · Statistics 2021-04-20 Thomas Y. Hou , Zhenzhen Li , Ziyun Zhang

In this paper, we propose a Riemannian steepest descent method for solving a blind deconvolution problem. We prove that the proposed algorithm with an appropriate initialization will recover the exact solution with high probability when the…

Information Theory · Computer Science 2018-04-17 Wen Huang , Paul Hand

A Riemannian gradient descent algorithm and a truncated variant are presented to solve systems of phaseless equations $|Ax|^2=y$. The algorithms are developed by exploiting the inherent low rank structure of the problem based on the…

Numerical Analysis · Mathematics 2018-09-11 Jian-Feng Cai , Ke Wei

This paper considers the problem of recovering a tensor with an underlying low-tubal-rank structure from a small number of corrupted linear measurements. Traditional approaches tackling such a problem require the computation of tensor…

Machine Learning · Computer Science 2025-01-13 Zhiyu Liu , Zhi Han , Yandong Tang , Xi-Le Zhao , Yao Wang

In recent years, stochastic variance reduction algorithms have attracted considerable attention for minimizing the average of a large but finite number of loss functions. This paper proposes a novel Riemannian extension of the Euclidean…

Machine Learning · Computer Science 2019-06-03 Hiroyuki Sato , Hiroyuki Kasai , Bamdev Mishra

In this paper a new Riemannian rank adaptive method (RRAM) is proposed for the low-rank tensor completion problem (LRTCP) formulated as a least-squares optimization problem on the algebraic variety of tensors of bounded tensor-train (TT)…

Optimization and Control · Mathematics 2024-02-20 Charlotte Vermeylen , Marc Van Barel

We consider the problem of low-rank rectangular matrix completion in the regime where the matrix $M$ of size $n\times m$ is ``long", i.e., the aspect ratio $m/n$ diverges to infinity. Such matrices are of particular interest in the study of…

Statistics Theory · Mathematics 2024-06-24 Ludovic Stephan , Yizhe Zhu

This paper investigates the low-rank tensor completion problem, which is about recovering a tensor from partially observed entries. We consider this problem in the tensor train format and extend the preconditioned metric from the matrix…

Optimization and Control · Mathematics 2023-04-19 Jian-Feng Cai , Wen Huang , Haifeng Wang , Ke Wei
‹ Prev 1 2 3 10 Next ›