English
Related papers

Related papers: A globally convergent SQP-type method with least c…

200 papers

We study online statistical inference for the solutions of stochastic optimization problems with equality and inequality constraints. Such problems are prevalent in statistics and machine learning, encompassing constrained $M$-estimation,…

Machine Learning · Statistics 2025-12-11 Yihang Gao , Michael K. Ng , Michael W. Mahoney , Sen Na

We study nonlinear constrained optimization problems in which only function evaluations of the objective and constraints are available. Existing zeroth-order methods rely on noisy gradient and Jacobian surrogates in high dimensions, making…

Optimization and Control · Mathematics 2026-04-03 Runyu Zhang , Gioele Zardini

Bilevel optimization involves a hierarchical structure where one problem is nested within another, leading to complex interdependencies between levels. We propose a single-loop, tuning-free algorithm that guarantees anytime feasibility,…

Optimization and Control · Mathematics 2025-08-15 Sina Sharifi , Erfan Yazdandoost Hamedani , Mahyar Fazlyab

Sequential quadratic programming (SQP) methods have been remarkably successful in solving a broad range of nonlinear optimization problems. These methods iteratively construct and solve quadratic programming (QP) subproblems to compute…

Optimization and Control · Mathematics 2025-12-08 Anugrah Jo Joshy , John T. Hwang

In this paper, we propose a low-rank coordinate descent approach to structured semidefinite programming with diagonal constraints. The approach, which we call the Mixing method, is extremely simple to implement, has no free parameters, and…

Optimization and Control · Mathematics 2026-05-12 Po-Wei Wang , Wei-Cheng Chang , J. Zico Kolter

A sequential piecewise linear programming method is presented where bounded domains of non-convex functions are successively contracted about the solution of a piecewise linear program at each iteration of the algorithm. Although…

Optimization and Control · Mathematics 2020-04-21 James P. L. Tan

We propose an SQP algorithm for mathematical programs with vanishing constraints which solves at each iteration a quadratic program with linear vanishing constraints. The algorithm is based on the newly developed concept of $\mathcal…

Optimization and Control · Mathematics 2016-11-28 Matúš Benko , Helmut Gfrerer

This paper mainly concerns with the primal superlinear convergence of the quasi-Newton sequential quadratic programming (SQP) method for piecewise linear-quadratic composite optimization problems. We show that the latter primal superlinear…

Optimization and Control · Mathematics 2021-01-01 Ebrahim Sarabi

We analyze a sequential quadratic programming algorithm for solving a class of abstract optimization problems. Assuming that the initial point is in an $L^2$ neighborhood of a local solution that satisfies no-gap second-order sufficient…

Optimization and Control · Mathematics 2026-05-19 Eduardo Casas , Mariano Mateos

We propose a quantum-assisted framework for solving constrained finite-horizon nonlinear optimal control problems using a barrier Sequential Quadratic Programming (SQP) approach. Within this framework, a quantum subroutine is incorporated…

Quantum Physics · Physics 2025-10-22 Nahid Binandeh Dehaghani , Rafal Wisniewski , A. Pedro Aguiar

We extend the class of SQP methods for equality constrained optimization to the setting of differentiable manifolds. The use of retractions and stratifications allows us to pull back the involved mappings to linear spaces. We study local…

Optimization and Control · Mathematics 2020-05-15 Anton Schiela , Julian Ortiz

This paper presents the Safe Sequential Quadratically Constrained Quadratic Programming (SS-QCQP) algorithm, a first-order method for smooth inequality-constrained nonconvex optimization that guarantees feasibility at every iteration. The…

Optimization and Control · Mathematics 2025-11-26 Jiarui Wang , Mahyar Fazlyab

We propose a fast temporal decomposition procedure for solving long-horizon nonlinear dynamic programs. The core of the procedure is sequential quadratic programming (SQP) that utilizes a differentiable exact augmented Lagrangian as the…

Optimization and Control · Mathematics 2023-04-19 Sen Na , Mihai Anitescu , Mladen Kolar

We prove that a "first-order" Sequential Quadratic Programming (SQP) algorithm for equality constrained optimization has local linear convergence with rate $(1-1/\kappa_R)^k$, where $\kappa_R$ is the condition number of the Riemannian…

Optimization and Control · Mathematics 2019-02-01 Yu Bai , Song Mei

Sequential quadratic optimization algorithms are proposed for solving smooth nonlinear optimization problems with equality constraints. The main focus is an algorithm proposed for the case when the constraint functions are deterministic,…

Optimization and Control · Mathematics 2020-07-22 Albert Berahas , Frank E. Curtis , Daniel P. Robinson , Baoyu Zhou

In this paper we study a broad class of structured nonlinear programming (SNLP) problems. In particular, we first establish the first-order optimality conditions for them. Then we propose sequential convex programming (SCP) methods for…

Optimization and Control · Mathematics 2022-06-22 Zhaosong Lu

Nonlinear model predictive control~(NMPC) generally requires the solution of a non-convex optimization problem at each sampling instant under strict timing constraints, based on a set of differential equations that can often be stiff and/or…

Optimization and Control · Mathematics 2019-03-22 Pedro Hespanhol , Rien Quirynen

Spline functions are smooth piecewise polynomials widely used for interpolation and smoothing, and nonnegative spline smoothing is also studied for nonnegative data. Previous research used sufficient conditions for the nonnegativity of…

Optimization and Control · Mathematics 2026-05-06 Hiroki Arai , Daichi Kitahara

A worst-case complexity bound is proved for a sequential quadratic optimization (commonly known as SQP) algorithm that has been designed for solving optimization problems involving a stochastic objective function and deterministic nonlinear…

Optimization and Control · Mathematics 2022-01-10 Frank E. Curtis , Michael J. O'Neill , Daniel P. Robinson

Sequential Quadratic Programming (SQP) is a powerful class of algorithms for solving nonlinear optimization problems. Local convergence of SQP algorithms is guaranteed when the Hessian approximation used in each Quadratic Programming…

Optimization and Control · Mathematics 2017-04-12 Tuan T. Nguyen , Mircea Lazar , Hans Butler