English
Related papers

Related papers: Sufficient Descent Riemannian Conjugate Gradient M…

200 papers

This paper presents the Hager-Zhang (HZ)-type Riemannian conjugate gradient method that uses the exponential retraction. We also present global convergence analyses of our proposed method under two kinds of assumptions. Moreover, we…

Optimization and Control · Mathematics 2022-07-06 Hiroyuki Sakai , Hiroyuki Sato , Hideaki Iiduka

This paper proposes a novel general framework of Riemannian conjugate gradient methods, that is, conjugate gradient methods on Riemannian manifolds. The conjugate gradient methods are important first-order optimization algorithms both in…

Optimization and Control · Mathematics 2022-11-21 Hiroyuki Sato

Conjugate gradient (CG) methods are widely acknowledged as efficient for minimizing continuously differentiable functions in Euclidean spaces. In recent years, various CG methods have been extended to Riemannian manifold optimization, but…

Optimization and Control · Mathematics 2026-05-26 Chunming Tang , Shaohui Liang , Huangyue Chen

In this paper, we propose nonlinear conjugate gradient methods for vector optimization on Riemannian manifolds. The concepts of Wolfe and Zoutendjik conditions are extended for Riemannian manifolds. Specifically, we establish the existence…

Optimization and Control · Mathematics 2025-09-03 Kangming Chen , Ellen H. Fukuda , Hiroyuki Sato

Gradient descent methods are fundamental first-order optimization algorithms in both Euclidean spaces and Riemannian manifolds. However, the exact gradient is not readily available in many scenarios. This paper proposes a novel inexact…

Optimization and Control · Mathematics 2024-09-18 Juan Zhou , Kangkang Deng , Hongxia Wang , Zheng Peng

In this paper, a descent method for nonsmooth multiobjective optimization problems on complete Riemannian manifolds is proposed. The objective functions are only assumed to be locally Lipschitz continuous instead of convexity used in…

Optimization and Control · Mathematics 2025-01-14 Chunming Tang , Hao He , Jinbao Jian , Miantao Chao

In recent years, Riemannian stochastic gradient descent (R-SGD), Riemannian stochastic variance reduction (R-SVRG) and Riemannian stochastic recursive gradient (R-SRG) have attracted considerable attention on Riemannian optimization. Under…

Optimization and Control · Mathematics 2021-10-18 Jiabao Yang

We introduce two derivative-free projection methods for large-scale systems of nonlinear monotone equations subject to convex constraints. Both methods incorporate an adaptive spectral parameter into established conjugate gradient…

Optimization and Control · Mathematics 2026-05-18 Kabenge Hamiss , Mohammed Alshahrani , Mujahid N. Syed

Landing methods have recently emerged in Riemannian matrix optimization as efficient schemes for handling nonlinear equality constraints without resorting to costly retractions. These methods decompose the search direction into tangent and…

Optimization and Control · Mathematics 2026-03-26 Florentin Goyens , Florian Feppon

In this work, we propose two derivative-free methods to address the problem of large-scale nonlinear equations with convex constraints. These algorithms satisfy the sufficient descent condition. The search directions can be considered…

Numerical Analysis · Mathematics 2025-11-17 Kabenge Hamiss , Mohammed M. Alshahrani , Mujahid N. Syed

This article describes a new Riemannian conjugate gradient method and presents a global convergence analysis. The existing Fletcher-Reeves-type Riemannian conjugate gradient method is guaranteed to be globally convergent if it is…

Optimization and Control · Mathematics 2016-06-20 Hiroyuki Sato

We propose an inexact optimization algorithm on Riemannian manifolds, motivated by quadratic discrimination tasks in high-dimensional, low-sample-size (HDLSS) imaging settings. In such applications, gradient evaluations are often biased due…

Optimization and Control · Mathematics 2025-07-08 Uday Talwar , Meredith K. Kupinski , Afrooz Jalilzadeh

For optimization problems on Riemannian manifolds, many types of globally convergent algorithms have been proposed, and they are often equipped with the Riemannian version of the Armijo line search for global convergence. Such existing…

Optimization and Control · Mathematics 2025-04-11 Hiroyuki Sato , Yuya Yamakawa , Kensuke Aihara

We propose a descent subgradient algorithm for minimizing a real function, assumed to be locally Lipschitz, but not necessarily smooth or convex. To find an effective descent direction, the Goldstein subdifferential is approximated through…

Optimization and Control · Mathematics 2023-04-11 Morteza Maleknia , Majid Soleimani-damaneh

In this paper, two new subspace minimization conjugate gradient methods based on $p - $regularization models are proposed, where a special scaled norm in $p - $regularization model is analyzed. Different choices for special scaled norm lead…

Optimization and Control · Mathematics 2020-04-06 Ting Zhao , Hongwei Liu , Zexian Liu

In this work, we consider smooth unconstrained optimization problems and we deal with the class of gradient methods with momentum, i.e., descent algorithms where the search direction is defined as a linear combination of the current…

Optimization and Control · Mathematics 2025-12-04 Matteo Lapucci , Giampaolo Liuzzi , Stefano Lucidi , Davide Pucci , Marco Sciandrone

By restricting the iterate on a nonlinear manifold, the recently proposed Riemannian optimization methods prove to be both efficient and effective in low rank tensor completion problems. However, existing methods fail to exploit the easily…

Machine Learning · Statistics 2017-02-24 Tengfei Zhou , Hui Qian , Zebang Shen , Congfu Xu

In this paper, a new conjugate gradient-like algorithm is proposed to solve unconstrained optimization problems. The step directions generated by the new algorithm satisfy sufficient descent condition independent of the line search. The…

Optimization and Control · Mathematics 2021-05-11 Ahmad Kamandi , Keyvan Amini

This paper explores variants of the subspace iteration algorithm for computing approximate invariant subspaces. The standard subspace iteration approach is revisited and new variants that exploit gradient-type techniques combined with a…

Numerical Analysis · Mathematics 2024-05-14 Foivos Alimisis , Yousef Saad , Bart Vandereycken

This paper addresses unconstrained multiobjective optimization problems where two or more continuously differentiable functions have to be minimized. We delve into the conjugate gradient methods proposed by Lucambio P\'{e}rez and Prudente…

Optimization and Control · Mathematics 2024-10-15 Wang Chen , Yong Zhao , Liping Tang , Xinmin Yang
‹ Prev 1 2 3 10 Next ›