English
Related papers

Related papers: An optimal class of eighth-order iterative methods…

200 papers

The primary focus of this paper is on designing an inexact first-order algorithm for solving constrained nonlinear optimization problems. By controlling the inexactness of the subproblem solution, we can significantly reduce the…

Optimization and Control · Mathematics 2019-11-19 Hao Wang , Fan Zhang , Jiashan Wang , Yuyang Rong

A very simple first-order algorithm is proposed for solving nonlinear optimization problems with deterministic nonlinear equality constraints. This algorithm adaptively selects steps in the plane tangent to the constraints or steps that…

Optimization and Control · Mathematics 2026-03-11 Serge Gratton , Philippe L. Toint

In this paper, we introduce an iterative numerical method to solve systems of nonlinear equations. The third-order convergence of this method is analyzed. Several examples are given to illustrate the efficiency of the proposed method.

Dynamical Systems · Mathematics 2009-04-23 M. Eshaghi Gordji , A. Ebadian , M. B. Ghaemi , J. Shokri

In this paper, we propose and analyze a fast two-point gradient algorithm for solving nonlinear ill-posed problems, which is based on the sequential subspace optimization method. A complete convergence analysis is provided under the…

Analysis of PDEs · Mathematics 2019-11-06 Guangyu Gao , Bo Han , Shanshan Tong

In this paper, we propose a new zero order optimization method called minibatch stochastic three points (MiSTP) method to solve an unconstrained minimization problem in a setting where only an approximation of the objective function…

Optimization and Control · Mathematics 2022-09-19 Soumia Boucherouite , Grigory Malinovsky , Peter Richtárik , EL Houcine Bergou

In this paper, we propose a class of super-schemes for efficiently solving nonlinear unconstrained optimization problems. The proposed approach introduces two novel choices of step-size parameters, leading to efficient descent directions…

Optimization and Control · Mathematics 2026-04-24 Tugal Zhanlav , Lkhamsuren Altangerel , Khuder Otgondorj

In this paper, we study inexact high-order Tensor Methods for solving convex optimization problems with composite objective. At every step of such methods, we use approximate solution of the auxiliary problem, defined by the bound for the…

Optimization and Control · Mathematics 2020-12-23 Nikita Doikov , Yurii Nesterov

In this paper, several row and column orthogonal projection methods are proposed for solving matrix equation $AXB=C$, where the matrix $A$ and $B$ are full rank or rank deficient and equation is consistent or not. These methods are…

Numerical Analysis · Mathematics 2023-05-29 Xing Lili , Bao Wendi , Li Weiguo

This paper focuses on regularisation methods using models up to the third order to search for up to second-order critical points of a finite-sum minimisation problem. The variant presented belongs to the framework of [3]: it employs random…

Numerical Analysis · Mathematics 2021-04-05 Stefania Bellavia , Gianmarco Gurioli , Benedetta Morini , Philippe L. Toint

This paper deals with the estimation of the modes of an univariate mixture when the number of components is known and when the component density are well separated. We propose an algorithm based on the minimization of the "kp" criterion we…

Data Analysis, Statistics and Probability · Physics 2007-05-23 Nicolas Paul , Luc Fety , Michel Terre

This paper investigates the performance of a subclass of exponential integrators, specifically explicit exponential Runge--Kutta methods. It is well known that third-order methods can suffer from order reduction when applied to linearized…

Numerical Analysis · Mathematics 2024-12-30 Thi Tam Dang , Trung Hau Hoang

In this paper we consider the unconstrained minimization problem of a smooth function in ${\mathbb{R}}^n$ in a setting where only function evaluations are possible. We design a novel randomized derivative-free algorithm --- the stochastic…

Optimization and Control · Mathematics 2019-05-08 El Houcine Bergou , Eduard Gorbunov , Peter Richtárik

This document introduces a strategy to solve linear optimization problems. The strategy is based on the bounding condition each constraint produces on each one of the problem's dimension. The solution of a linear optimization problem is…

Optimization and Control · Mathematics 2018-09-24 Gerardo L. Febres

In this paper we consider a fully third order nonlinear boundary value problem which is of great interest of many researchers. First we establish the existence, uniqueness of solution. Next, we propose simple iterative methods on both…

Numerical Analysis · Mathematics 2020-04-24 Dang Quang A , Dang Quang Long

In this paper we propose third-order methods for composite convex optimization problems in which the smooth part is a three-times continuously differentiable function with Lipschitz continuous third-order derivatives. The methods are…

Optimization and Control · Mathematics 2022-02-28 Geovani Nunes Grapiglia , Yurii Nesterov

The classical method to solve a quadratic optimization problem with nonlinear equality constraints is to solve the Karush-Kuhn-Tucker (KKT) optimality conditions using Newton's method. This approach however is usually computationally…

Optimization and Control · Mathematics 2016-03-17 Tuan T. Nguyen , Mircea Lazar , Hans Butler

In this paper we present two optimized eight-step symmetric implicit methods with phase-lag order ten and infinite (phase-fitted). The methods are constructed to solve numerically the radial time-independent Schr\"odinger equation with the…

Numerical Analysis · Mathematics 2008-11-18 G. A. Panopoulos , Z. A. Anastassi , T. E. Simos

Derivative based optimization methods are efficient at solving optimal control problems near local optima. However, their ability to converge halts when derivative information vanishes. The inference approach to optimal control does not…

Robotics · Computer Science 2022-03-01 Daniel Layeghi , Steve Tonneau , Michael Mistry

The real-time solution of parametric optimization problems is critical for applications that demand high accuracy under tight real-time constraints, such as model predictive control. To this end, this work presents a learning-based…

Machine Learning · Computer Science 2025-11-17 Lukas Lüken , Sergio Lucia

The Optimized Gradient Method (OGM), its strongly convex extension, the Information Theoretical Exact Method (ITEM), as well as the related Triple Momentum Method (TMM) have superior convergence guarantees when compared to the Fast Gradient…

Optimization and Control · Mathematics 2024-05-14 Mihai I. Florea