English
Related papers

Related papers: Riemannian preconditioning for tensor completion

200 papers

We develop a new Riemannian descent algorithm that relies on momentum to improve over existing first-order methods for geodesically convex optimization. In contrast, accelerated convergence rates proved in prior work have only been shown to…

Optimization and Control · Mathematics 2021-02-16 Foivos Alimisis , Antonio Orvieto , Gary Bécigneul , Aurelien Lucchi

This paper considers optimization problems on Riemannian manifolds and analyzes iteration-complexity for gradient and subgradient methods on manifolds with non-negative curvature. By using tools from the Riemannian convex analysis and…

Numerical Analysis · Mathematics 2016-09-19 G. C. Bento , O. P. Ferreira , J. G. Melo

In this paper, we consider the problem of minimizing a smooth function on a Riemannian manifold and present a Riemannian gradient method with momentum. The proposed algorithm represents a substantial and nontrivial extension of a recently…

Optimization and Control · Mathematics 2026-03-05 Filippo Leggio , Diego Scuppa

In the low-rank matrix completion (LRMC) problem, the low-rank assumption means that the columns (or rows) of the matrix to be completed are points on a low-dimensional linear algebraic variety. This paper extends this thinking to cases…

Machine Learning · Statistics 2020-09-08 Greg Ongie , Daniel Pimentel-Alarcón , Laura Balzano , Rebecca Willett , Robert D. Nowak

Recent literature has advocated the use of randomized methods for accelerating the solution of various matrix problems arising throughout data science and computational science. One popular strategy for leveraging randomization is to use it…

Numerical Analysis · Mathematics 2024-09-27 Boris Shustin , Haim Avron

We investigate the fundamental conditions on the sampling pattern, i.e., locations of the sampled entries, for finite completability of a low-rank tensor given some components of its Tucker rank. In order to find the deterministic necessary…

Numerical Analysis · Computer Science 2019-05-13 Morteza Ashraphijuo , Vaneet Aggarwal , Xiaodong Wang

In this paper we provide a new method for establishing the rotational symmetry of the solutions to a couple of very classical overdetermined problems arising in potential theory, in both the exterior and the interior punctured domain.…

Analysis of PDEs · Mathematics 2015-02-19 Virginia Agostiniani , Lorenzo Mazzieri

In this paper, we propose a novel model to recover a low-rank tensor by simultaneously performing double nuclear norm regularized low-rank matrix factorizations to the all-mode matricizations of the underlying tensor. An block successive…

Computer Vision and Pattern Recognition · Computer Science 2020-05-07 Haijin Zeng , Xiaozhen Xie , Jifeng Ning

We consider discretized two-dimensional PDE-constrained shape optimization problems, in which shapes are represented by triangular meshes. Given the connectivity, the space of admissible vertex positions was recently identified to be a…

Optimization and Control · Mathematics 2023-08-17 Roland Herzog , Estefanía Loayza-Romero

We consider maximum likelihood estimation for Gaussian Mixture Models (Gmms). This task is almost invariably solved (in theory and practice) via the Expectation Maximization (EM) algorithm. EM owes its success to various factors, of which…

Machine Learning · Statistics 2018-06-04 Reshad Hosseini , Suvrit Sra

In recent years, there have been an increasing number of applications of tensor completion based on the tensor train (TT) format because of its efficiency and effectiveness in dealing with higher-order tensor data. However, existing tensor…

Computer Vision and Pattern Recognition · Computer Science 2022-01-25 Yang Zhang , Yao Wang , Zhi Han , Xi'ai Chen , Yandong Tang

This paper introduces a new metric and mean on the set of positive semidefinite matrices of fixed-rank. The proposed metric is derived from a well-chosen Riemannian quotient geometry that generalizes the reductive geometry of the positive…

Optimization and Control · Mathematics 2009-10-21 Silvere Bonnabel , Rodolphe Sepulchre

Constrained optimization plays a crucial role in the fields of quantum physics and quantum information science and becomes especially challenging for high-dimensional complex structure problems. One specific issue is that of quantum process…

Quantum Physics · Physics 2024-04-30 Daniel Volya , Andrey Nikitin , Prabhat Mishra

The analysis of the acceleration behavior of gradient-based eigensolvers with preconditioning presents a substantial theoretical challenge. In this work, we present a novel framework for preconditioning on Riemannian manifolds and introduce…

Numerical Analysis · Mathematics 2024-10-25 Nian Shao , Wenbin Chen

Imposing additional constraints on low-rank optimization has garnered growing interest. However, the geometry of coupled constraints hampers the well-developed low-rank structure and makes the problem intricate. To this end, we propose a…

Optimization and Control · Mathematics 2025-10-01 Yan Yang , Bin Gao , Ya-xiang Yuan

From optimal transport to robust dimensionality reduction, a plethora of machine learning applications can be cast into the min-max optimization problems over Riemannian manifolds. Though many min-max algorithms have been analyzed in the…

Optimization and Control · Mathematics 2022-09-29 Michael I. Jordan , Tianyi Lin , Emmanouil-Vasileios Vlatakis-Gkaragkounis

This study aims to solve the over-reliance on the rank estimation strategy in the standard tensor factorization-based tensor recovery and the problem of a large computational cost in the standard t-SVD-based tensor recovery. To this end, we…

Machine Learning · Computer Science 2023-05-22 Jingjing Zheng , Wenzhe Wang , Xiaoqin Zhang , Xianta Jiang

An interior point method for the structural topology optimization is proposed. The linear systems arising in the method are solved by the conjugate gradient method preconditioned by geometric multigrid. The resulting method is then compared…

Optimization and Control · Mathematics 2016-06-21 Michal Kocvara , Sudaba Mohammed

We establish theoretical recovery guarantees of a family of Riemannian optimization algorithms for low rank matrix recovery, which is about recovering an $m\times n$ rank $r$ matrix from $p < mn$ number of linear measurements. The…

Numerical Analysis · Mathematics 2016-04-12 Ke Wei , Jian-Feng Cai , Tony F. Chan , Shingyu Leung

Numerical continuation in the context of optimization can be used to mitigate convergence issues due to a poor initial guess. In this work, we extend this idea to Riemannian optimization problems, that is, the minimization of a target…

Optimization and Control · Mathematics 2023-05-30 Axel Séguin , Daniel Kressner