English
Related papers

Related papers: An adaptive cubic regularisation algorithm based o…

200 papers

Adaptive cubic regularization methods for solving nonconvex problems need the efficient computation of the trial step, involving the minimization of a cubic model. We propose a new approach in which this model is minimized in a low…

Optimization and Control · Mathematics 2024-12-02 Stefania Bellavia , Davide Palitta , Margherita Porcelli , Valeria Simoncini

In this paper, we develop an interior-point method for solving a class of convex optimization problems with time-varying objective and constraint functions. Using log-barrier penalty functions, we propose a continuous-time dynamical system…

Optimization and Control · Mathematics 2016-08-29 Mahyar Fazlyab , Santiago Paternain , Victor M. Preciado , Alejandro Ribeiro

Trust-region (TR) and adaptive regularization using cubics (ARC) have proven to have some very appealing theoretical properties for non-convex optimization by concurrently computing function value, gradient, and Hessian matrix to obtain the…

Machine Learning · Computer Science 2023-10-19 Liu Liu , Xuanqing Liu , Cho-Jui Hsieh , Dacheng Tao

We consider minimization problems with structured objective function and smooth constraints, and present a flexible framework that combines the beneficial regularization effects of (exact) penalty and interior-point methods. In the fully…

Optimization and Control · Mathematics 2025-08-27 Alberto De Marchi , Andreas Themelis

A novel regularization technique, AdaCubic, is proposed that adapts the weight of the cubic term. The heart of AdaCubic is an auxiliary optimization problem with cubic constraints that dynamically adjusts the weight of the cubic term in…

Machine Learning · Computer Science 2026-04-13 Ioannis Tsingalis , Constantine Kotropoulos , Corentin Briat

We analyze the convergence properties of a modified barrier method for solving bound-constrained optimization problems where evaluations of the objective function and its derivatives are affected by bounded and non-diminishing noise. The…

Optimization and Control · Mathematics 2024-05-21 Shima Dezfulian , Andreas Wächter

This paper presents a novel robust trajectory optimization method for constrained nonlinear dynamical systems subject to unknown bounded disturbances. In particular, we seek optimal control policies that remain robustly feasible with…

Systems and Control · Electrical Eng. & Systems 2025-04-08 Arshiya Taj Abdul , Augustinos D. Saravanos , Evangelos A. Theodorou

We design and analyze primal-dual, feasible interior-point algorithms (IPAs) employing full Newton steps to solve convex optimization problems in standard conic form. Unlike most nonsymmetric cone programming methods, the algorithms…

Optimization and Control · Mathematics 2025-02-25 Dávid Papp , Anita Varga

We use the concept of barrier-based smoothing approximations introduced in [ C. B. Chua and Z. Li, A barrier-based smoothing proximal point algorithm for NCPs over closed convex cones, SIOPT 23(2), 2010] to extend the non-interior…

Optimization and Control · Mathematics 2020-03-06 Le Thi Khanh Hien , Chek Beng Chua

In this paper, we establish the local superlinear convergence property of some polynomial-time interior-point methods for an important family of conic optimization problems. The main structural property used in our analysis is the…

Optimization and Control · Mathematics 2014-12-08 Yu. Nesterov , Levent Tuncel

In this paper, we consider an unconstrained optimization model where the objective is a sum of a large number of possibly nonconvex functions, though overall the objective is assumed to be smooth and convex. Our bid to solving such model…

Optimization and Control · Mathematics 2022-03-15 Xi Chen , Bo Jiang , Tianyi Lin , Shuzhong Zhang

This paper proposes novel algorithm for non-convex multimodal constrained optimisation problems. It is based on sequential solving restrictions of problem to sections of feasible set by random subspaces (in general, manifolds) of low…

Optimization and Control · Mathematics 2023-03-28 Dmitry A. Pasechnyuk , Alexander Gornov

High-order tensor methods for solving both convex and nonconvex optimization problems have generated significant research interest, leading to algorithms with optimal global rates of convergence and local rates that are faster than Newton's…

Optimization and Control · Mathematics 2023-12-25 Wenqi Zhu , Coralia Cartis

This paper considers a class of convex optimization problems where both, the objective function and the constraints, have a continuously varying dependence on time. Our goal is to develop an algorithm to track the optimal solution as it…

Optimization and Control · Mathematics 2015-10-07 Mahyar Fazlyab , Santiago Paternain , Victor M. Preciado , Alejandro Ribeiro

Interior-point methods for linear programming problems require the repeated solution of a linear system of equations. Solving these linear systems is non-trivial due to the severe ill-conditioning of the matrices towards convergence. This…

Optimization and Control · Mathematics 2021-05-05 Jeffrey Cornelis , Wim Vanroose

The cubic regularization (CR) algorithm has attracted a lot of attentions in the literature in recent years. We propose a new reformulation of the cubic regularization subproblem. The reformulation is an unconstrained convex problem that…

Optimization and Control · Mathematics 2021-12-20 Rujun Jiang , Zhishuo Zhou , Zirui Zhou

The focus in this paper is interior-point methods for bound-constrained nonlinear optimization, where the system of nonlinear equations that arise are solved with Newton's method. There is a trade-off between solving Newton systems…

Optimization and Control · Mathematics 2023-05-04 David Ek , Anders Forsgren

An algorithm for solving smooth nonconvex optimization problems is proposed that, in the worst-case, takes $\mathcal{O}(\epsilon^{-3/2})$ iterations to drive the norm of the gradient of the objective function below a prescribed positive…

Optimization and Control · Mathematics 2018-03-16 Frank E. Curtis , Daniel P. Robinson , Mohammadreza Samadi

In this paper we consider a nonconvex optimization problem with nonlinear equality constraints. We assume that both, the objective function and the functional constraints, are locally smooth. For solving this problem, we propose a…

Optimization and Control · Mathematics 2024-12-02 Lahcen El Bourkhissi , Ion Necoara

This paper addresses a class of general nonsmooth and nonconvex composite optimization problems subject to nonlinear equality constraints. We assume that a part of the objective function and the functional constraints exhibit local…

Optimization and Control · Mathematics 2025-03-04 Lahcen El Bourkhissi , Ion Necoara , Panagiotis Patrinos , Quoc Tran-Dinh