English
Related papers

Related papers: Preconditioned low-rank Riemannian optimization fo…

200 papers

We propose a novel Riemannian manifold preconditioning approach for the tensor completion problem with rank constraint. A novel Riemannian metric or inner product is proposed that exploits the least-squares structure of the cost function…

Machine Learning · Computer Science 2016-05-27 Hiroyuki Kasai , Bamdev Mishra

We propose a novel Riemannian preconditioning approach for the tensor completion problem with rank constraint. A Riemannian metric or inner product is proposed that exploits the least-squares structure of the cost function and takes into…

Numerical Analysis · Computer Science 2016-05-30 Hiroyuki Kasai , Bamdev Mishra

There are several different notions of "low rank" for tensors, associated to different formats. Among them, the Tensor Train (TT) format is particularly well suited for tensors of high order, as it circumvents the curse of dimensionality:…

Optimization and Control · Mathematics 2020-11-30 Michael Psenka , Nicolas Boumal

We propose Riemannian preconditioned algorithms for the tensor completion problem via tensor ring decomposition. A new Riemannian metric is developed on the product space of the mode-2 unfolding matrices of the core tensors in tensor ring…

Optimization and Control · Mathematics 2023-11-15 Bin Gao , Renfeng Peng , Ya-xiang Yuan

In this study, we consider the numerical solution of large systems of linear equations obtained from the stochastic Galerkin formulation of stochastic partial differential equations. We propose an iterative algorithm that exploits the…

Numerical Analysis · Mathematics 2016-05-18 Kookjin Lee , Howard C. Elman

In scientific computing and machine learning applications, matrices and more general multidimensional arrays (tensors) can often be approximated with the help of low-rank decompositions. Since matrices and tensors of fixed rank form smooth…

Optimization and Control · Mathematics 2021-10-26 Alexander Novikov , Maxim Rakhuba , Ivan Oseledets

This paper investigates the low-rank tensor completion problem, which is about recovering a tensor from partially observed entries. We consider this problem in the tensor train format and extend the preconditioned metric from the matrix…

Optimization and Control · Mathematics 2023-04-19 Jian-Feng Cai , Wen Huang , Haifeng Wang , Ke Wei

Low-rank tensor completion aims to recover a tensor from partially observed entries, and it is widely applicable in fields such as quantum computing and image processing. Due to the significant advantages of the tensor train (TT) format in…

Machine Learning · Computer Science 2025-01-24 Fengmiao Bian , Jian-Feng Cai , Xiaoqun Zhang , Yuanwei Zhang

We propose new Riemannian preconditioned algorithms for low-rank tensor completion via the polyadic decomposition of a tensor. These algorithms exploit a non-Euclidean metric on the product space of the factor matrices of the low-rank…

Optimization and Control · Mathematics 2022-06-06 Shuyu Dong , Bin Gao , Yu Guan , François Glineur

This paper presents a memory efficient, first-order method for low multi-linear rank approximation of high-order, high-dimensional tensors. In our method, we exploit the second-order information of the cost function and the constraints to…

Optimization and Control · Mathematics 2024-03-22 Mohammad Hamed , Reshad Hosseini

Tensor methods are among the most prominent tools for the numerical solution of high-dimensional problems where functions of multiple variables have to be approximated. These methods exploit the tensor structure of function spaces and apply…

Numerical Analysis · Mathematics 2021-02-01 Anthony Nouy

This work is concerned with the numerical solution of large-scale symmetric positive definite matrix equations of the form $A_1XB_1^\top + A_2XB_2^\top + \dots + A_\ell X B_\ell^\top = F$, as they arise from discretized partial differential…

Numerical Analysis · Mathematics 2024-12-04 Ivan Bioli , Daniel Kressner , Leonardo Robol

The goal of tensor completion is to fill in missing entries of a partially known tensor under a low-rank constraint. In this paper, we mainly study low rank third-order tensor completion problems by using Riemannian optimization methods on…

Optimization and Control · Mathematics 2020-11-24 Guang-Jing Song , Xue-Zhong Wang , Michael K. Ng

This paper presents a numerical framework for the low-rank approximation of the solution to three-dimensional parabolic problems. The key contribution of this work is the tensorization process based on a tensor-train reformulation of the…

Numerical Analysis · Mathematics 2025-09-15 Gianmarco Manzini , Tommaso Sorgente

Since optimization on Riemannian manifolds relies on the chosen metric, it is appealing to know that how the performance of a Riemannian optimization method varies with different metrics and how to exquisitely construct a metric such that a…

Optimization and Control · Mathematics 2025-02-19 Bin Gao , Renfeng Peng , Ya-xiang Yuan

In this paper, we propose a descent method for composite optimization problems with linear operators. Specifically, we first design a structure-exploiting preconditioner tailored to the linear operator so that the resulting preconditioned…

Optimization and Control · Mathematics 2026-03-20 Jian Chen , Xinmin Yang

Such problems as computation of spectra of spin chains and vibrational spectra of molecules can be written as high-dimensional eigenvalue problems, i.e., when the eigenvector can be naturally represented as a multidimensional tensor. Tensor…

Numerical Analysis · Mathematics 2019-09-04 Maxim Rakhuba , Alexander Novikov , Ivan Oseledets

We consider the problem of recovering a low-multilinear-rank tensor from a small amount of linear measurements. We show that the Riemannian gradient algorithm initialized by one step of iterative hard thresholding can reconstruct an…

Numerical Analysis · Mathematics 2021-01-14 Jian-Feng Cai , Lizhang Miao , Yang Wang , Yin Xian

In this paper, we propose a method for the approximation of the solution of high-dimensional weakly coercive problems formulated in tensor spaces using low-rank approximation formats. The method can be seen as a perturbation of a minimal…

Numerical Analysis · Mathematics 2015-02-13 Marie Billaud-Friess , Anthony Nouy , Olivier Zahm

The Symmetric Tensor Approximation problem (STA) consists of approximating a symmetric tensor or a homogeneous polynomial by a linear combination of symmetric rank-1 tensors or powers of linear forms of low symmetric rank. We present two…

Numerical Analysis · Mathematics 2021-12-23 Rima Khouja , Houssam Khalil , Bernard Mourrain
‹ Prev 1 2 3 10 Next ›