English
Related papers

Related papers: A Modified Dai-Liao Spectral Conjugate Gradient Me…

200 papers

The conjugate gradient (CG) method is widely used for solving nonlinear unconstrained optimization problems because it requires less memory to implement. In this paper, we propose a new parameter of the Dai Liao conjugacy condition of the…

Optimization and Control · Mathematics 2024-12-24 Ahmad Alhawarat

In this paper, we propose a globally convergent method for solving constrained nonlinear systems. The method combines an efficient Newton conditional gradient method with a derivative-free and nonmonotone linesearch strategy. The global…

Optimization and Control · Mathematics 2018-06-06 M. L. N. Gonçalves , F. R. Oliveira

We propose a new stepsize for the gradient method. It is shown that this new stepsize will converge to the reciprocal of the largest eigenvalue of the Hessian, when Dai-Yang's asymptotic optimal gradient method (Computational Optimization…

Optimization and Control · Mathematics 2019-05-13 Yakui Huang , Yu-Hong Dai , Xin-Wei Liu , Hongchao Zhang

In this paper, we combine the $m$th-order Taylor expansion of the objective function with cubic Hermite interpolation conditions. Then, we derive a series of modified secant equations with higher accuracy in approximation of the Hessian…

Optimization and Control · Mathematics 2023-02-21 Hao Wu , Liping Wang , Hongchao Zhang

We introduce two derivative-free projection methods for large-scale systems of nonlinear monotone equations subject to convex constraints. Both methods incorporate an adaptive spectral parameter into established conjugate gradient…

Optimization and Control · Mathematics 2026-05-18 Kabenge Hamiss , Mohammed Alshahrani , Mujahid N. Syed

We present a gradient-based algorithm for unconstrained minimization derived from iterated linear change of basis. The new method is equivalent to linear conjugate gradient in the case of a quadratic objective function. In the case of exact…

Optimization and Control · Mathematics 2008-08-19 Stephen A. Vavasis

In this paper, we propose a modified nonlinear conjugate gradient (NCG) method for functions with a non-Lipschitz continuous gradient. First, we present a new formula for the conjugate coefficient \beta_k in NCG, conducting a search…

Numerical Analysis · Mathematics 2022-04-19 Bingjie Li , Tianhao Ni , Zhenyue Zhang

This article describes a new Riemannian conjugate gradient method and presents a global convergence analysis. The existing Fletcher-Reeves-type Riemannian conjugate gradient method is guaranteed to be globally convergent if it is…

Optimization and Control · Mathematics 2016-06-20 Hiroyuki Sato

Nonlinear conjugate gradients are among the most popular techniques for solving continuous optimization problems. Although these schemes have long been studied from a global convergence standpoint, their worst-case complexity properties…

Optimization and Control · Mathematics 2022-09-01 Rémi Chan--Renous-Legoubin , Clément W. Royer

In this paper, a new conjugate gradient-like algorithm is proposed to solve unconstrained optimization problems. The step directions generated by the new algorithm satisfy sufficient descent condition independent of the line search. The…

Optimization and Control · Mathematics 2021-05-11 Ahmad Kamandi , Keyvan Amini

A new spectral conjugate subgradient method is presented to solve nonsmooth unconstrained optimization problems. The method combines the spectral conjugate gradient method for smooth problems with the spectral subgradient method for…

Optimization and Control · Mathematics 2025-10-10 Milagros Loreto , Thomas Humphries , Chella Raghavan , Kenneth Wu , Sam Kwak

Subspace minimization conjugate gradient (SMCG) methods have become a class of quite efficient iterative methods for unconstrained optimization and have attracted extensive attention recently. Usually, the search directions of SMCG methods…

Optimization and Control · Mathematics 2023-03-24 Zexian Liu , Yan Ni , Hongwei Liu , Wumei Sun

In this paper, we propose an inexact Newton-like conditional gradient method for solving constrained systems of nonlinear equations. The local convergence of the new method as well as results on its rate are established by using a general…

Optimization and Control · Mathematics 2017-05-23 M. L. N. Goncalves , F. R. Oliveira

In this paper, a new variant of accelerated gradient descent is proposed. The pro-posed method does not require any information about the objective function, usesexact line search for the practical accelerations of convergence, converges…

Optimization and Control · Mathematics 2019-05-14 Yurii Nesterov , Alexander Gasnikov , Sergey Guminov , Pavel Dvurechensky

This paper presents new Riemannian conjugate gradient methods and global convergence analyses under the strong Wolfe conditions. The main idea of the new methods is to combine the good global convergence properties of the Dai-Yuan method…

Optimization and Control · Mathematics 2020-05-26 Hiroyuki Sakai , Hideaki Iiduka

This paper presents a novel variant of the Broyden quasi-Newton secant-type method aimed at solving constrained mixed generalized equations, which can include functions that are not necessarily differentiable. The proposed method integrates…

Optimization and Control · Mathematics 2025-03-11 P. C. da Silva Junior , O. P. Ferreira , G. N. Silva

This paper introduces a subgradient extragradient algorithm with a conjugate gradient-type direction to solve pseudomonotone variational inequality problems in Hilbert spaces. The algorithm features a self-adaptive strategy that eliminates…

Optimization and Control · Mathematics 2025-05-07 Ibrahim Arzuka , Parin Chaipunya , Poom Kumam

We present a novel deep learning approach to approximate the solution of large, sparse, symmetric, positive-definite linear systems of equations. These systems arise from many problems in applied science, e.g., in numerical methods for…

Machine Learning · Computer Science 2022-10-04 Ayano Kaneda , Osman Akar , Jingyu Chen , Victoria Kala , David Hyde , Joseph Teran

A fundamental task in numerical computation is the solution of large linear systems. The conjugate gradient method is an iterative method which offers rapid convergence to the solution, particularly when an effective preconditioner is…

Methodology · Statistics 2018-12-18 Jon Cockayne , Chris Oates , Ilse Ipsen , Mark Girolami

The article proposes a Caputo fractional conjugate gradient (CFCG) method for unconstrained optimization problems which is applicable to smooth as well as non-smooth problmes. The proposed method uses a non-adaptive version of the Caputo…

Optimization and Control · Mathematics 2025-12-22 Barsha Shawa , Md Abu Talhamainuddin Ansary
‹ Prev 1 2 3 10 Next ›