English
Related papers

Related papers: On the Convergence of Interior-Point Methods for B…

200 papers

Regularization and interior point approaches offer valuable perspectives to address constrained nonlinear optimization problems in view of control applications. This paper discusses the interactions between these techniques and proposes an…

Optimization and Control · Mathematics 2022-10-31 Alberto De Marchi

We introduce a detailed analysis of the convergence of first-order methods with composite noise (sum of relative and absolute) in gradient for convex and smooth function minimization. This paper illustrates instances of practical problems…

Optimization and Control · Mathematics 2026-03-16 Artem Vasin , Alexander Gasnikov

In this paper, we consider bilevel optimization problem where the lower-level has coupled constraints, i.e. the constraints depend both on the upper- and lower-level variables. In particular, we consider two settings for the lower-level…

Optimization and Control · Mathematics 2025-03-14 Xiaotian Jiang , Jiaxiang Li , Mingyi Hong , Shuzhong Zhang

In this paper we theoretically show that interior-point methods based on self-concordant barriers possess favorable global complexity beyond their standard application area of convex optimization. To do that we propose first- and…

Optimization and Control · Mathematics 2024-04-30 Pavel Dvurechensky , Mathias Staudigl

An interior-point algorithm framework is proposed, analyzed, and tested for solving nonlinearly constrained continuous optimization problems. The main setting of interest is when the objective and constraint functions may be nonlinear…

Optimization and Control · Mathematics 2024-08-30 Frank E. Curtis , Xin Jiang , Qi Wang

We study the gradient method under the assumption that an additively inexact gradient is available for, generally speaking, non-convex problems. The non-convexity of the objective function, as well as the use of an inexactness specified…

Optimization and Control · Mathematics 2022-12-13 Boris T. Polyak , Ilia A. Kuruzov , Fedor S. Stonyakin

Many practical optimization problems involve objective function values that are corrupted by unavoidable numerical errors. In smooth nonconvex optimization, quasi-Newton methods combined with line search are widely used due to their…

Optimization and Control · Mathematics 2026-03-12 Hiroki Hamaguchi , Naoki Marumo , Akiko Takeda

The combinatorial optimization problem is one of the important applications in neural network computation. The solutions of linearly constrained continuous optimization problems are difficult with an exact algorithm, but the algorithm for…

Numerical Analysis · Computer Science 2009-12-22 A. K. Ojha , C. Mallick , D. Mallick

This paper introduces a modified Byrd-Omojokun (BO) trust region algorithm to address the challenges posed by noisy function and gradient evaluations. The original BO method was designed to solve equality constrained problems and it forms…

Optimization and Control · Mathematics 2024-11-06 Shigeng Sun , Jorge Nocedal

H-infinity filter has been widely applied in engineering field, but copping with bounded noise is still an open problem and difficult to solve. This paper considers the H-infinity filtering problem for linear system with bounded process and…

Systems and Control · Electrical Eng. & Systems 2020-08-04 Jie Li , Shengbo Eben Li , Kaiming Tang , Yao Lv , Wenhan Cao

Identifying active constraints from a point near an optimal solution is important both theoretically and practically in constrained continuous optimization, as it can help identify optimal Lagrange multipliers and essentially reduces an…

Optimization and Control · Mathematics 2025-09-03 Frank E. Curtis , Daniel P. Robinson , Lara Zebiane

In many iterative optimization methods, fixed-point theory enables the analysis of the convergence rate via the contraction factor associated with the linear approximation of the fixed-point operator. While this factor characterizes the…

Systems and Control · Electrical Eng. & Systems 2022-06-22 Trung Vu , Raviv Raich

In this paper we consider constrained optimization problems where both the objective and constraint functions are of the black-box type. Furthermore, we assume that the nonlinear inequality constraints are non-relaxable, i.e. their values…

Optimization and Control · Mathematics 2026-01-13 Andrea Brilli , Giampaolo Liuzzi , Stefano Lucidi

This work focuses on convergence analysis of the projected gradient method for solving constrained convex minimization problem in Hilbert spaces. We show that the sequence of points generated by the method employing the Armijo linesearch…

Optimization and Control · Mathematics 2015-08-10 Jose Yunier Bello Cruz , Welington de Oliveira

We present a novel direct transcription method to solve optimization problems subject to nonlinear differential and inequality constraints. We prove convergence of our numerical method under reasonably mild assumptions: boundedness and…

Optimization and Control · Mathematics 2021-04-09 Martin P. Neuenhofen , Eric C. Kerrigan

We describe an algorithm based on a logarithmic barrier function, Newton's method, and linear conjugate gradients that obtains an approximate minimizer of a smooth function over the nonnegative orthant. We develop a bound on the complexity…

Optimization and Control · Mathematics 2019-12-05 Michael O'Neill , Stephen J. Wright

In this paper, we investigate accelerated first-order methods for smooth convex optimization problems under inexact information on the gradient of the objective. The noise in the gradient is considered to be additive with two possibilities:…

Optimization and Control · Mathematics 2023-01-10 Vasin Artem , Alexander Gasnikov , Pavel Dvurechensky , Vladimir Spokoiny

Interior-point methods offer a highly versatile framework for convex optimization that is effective in theory and practice. A key notion in their theory is that of a self-concordant barrier. We give a suitable generalization of…

Optimization and Control · Mathematics 2024-06-26 Hiroshi Hirai , Harold Nieuwboer , Michael Walter

In this paper, we describe a two-stage method for solving optimization problems with bound constraints. It combines the active-set estimate described in [Facchinei and Lucidi, 1995] with a modification of the non-monotone line search…

Optimization and Control · Mathematics 2016-11-08 Andrea Cristofari , Marianna De Santis , Stefano Lucidi , Francesco Rinaldi

The classical convergence analysis of quasi-Newton methods assumes that the function and gradients employed at each iteration are exact. In this paper, we consider the case when there are (bounded) errors in both computations and establish…

Optimization and Control · Mathematics 2019-01-29 Yuchen Xie , Richard Byrd , Jorge Nocedal