English
Related papers

Related papers: Complexity of an inexact stochastic SQP algorithm …

200 papers

We develop a Sequential Quadratic Optimization (SQP) algorithm for minimizing a stochastic objective function subject to deterministic equality constraints. The method utilizes two different stepsizes, one which exclusively scales the…

Optimization and Control · Mathematics 2024-08-30 Michael J. O'Neill

A worst-case complexity bound is proved for a sequential quadratic optimization (commonly known as SQP) algorithm that has been designed for solving optimization problems involving a stochastic objective function and deterministic nonlinear…

Optimization and Control · Mathematics 2022-01-10 Frank E. Curtis , Michael J. O'Neill , Daniel P. Robinson

We study nonlinear optimization problems with a stochastic objective and deterministic equality and inequality constraints, which emerge in numerous applications including finance, manufacturing, power systems and, recently, deep neural…

Optimization and Control · Mathematics 2023-01-31 Sen Na , Mihai Anitescu , Mladen Kolar

A sequential quadratic optimization algorithm is proposed for solving smooth nonlinear equality constrained optimization problems in which the objective function is defined by an expectation of a stochastic function. The algorithmic…

Optimization and Control · Mathematics 2023-03-17 Albert S. Berahas , Frank E. Curtis , Michael J. O'Neill , Daniel P. Robinson

Sequential quadratic optimization algorithms are proposed for solving smooth nonlinear optimization problems with equality constraints. The main focus is an algorithm proposed for the case when the constraint functions are deterministic,…

Optimization and Control · Mathematics 2020-07-22 Albert Berahas , Frank E. Curtis , Daniel P. Robinson , Baoyu Zhou

We study online statistical inference for the solutions of stochastic optimization problems with equality and inequality constraints. Such problems are prevalent in statistics and machine learning, encompassing constrained $M$-estimation,…

Machine Learning · Statistics 2025-12-11 Yihang Gao , Michael K. Ng , Michael W. Mahoney , Sen Na

We consider solving nonlinear optimization problems with a stochastic objective and deterministic equality constraints. We assume for the objective that its evaluation, gradient, and Hessian are inaccessible, while one can compute their…

Optimization and Control · Mathematics 2022-06-07 Sen Na , Mihai Anitescu , Mladen Kolar

An algorithm is proposed, analyzed, and tested experimentally for solving stochastic optimization problems in which the decision variables are constrained to satisfy equations defined by deterministic, smooth, and nonlinear functions. It is…

Optimization and Control · Mathematics 2021-07-09 Frank E. Curtis , Daniel P. Robinson , Baoyu Zhou

We develop a new method for equality constrained optimization problems based on a sequential cubic programming framework. Each iteration utilizes a step decomposition based on the Jacobian of the constraints into a normal and a tangential…

Optimization and Control · Mathematics 2026-04-06 Nikos Dimou , Michael J. O'Neill

A step-search sequential quadratic programming method is proposed for solving nonlinear equality constrained stochastic optimization problems. It is assumed that constraint function values and derivatives are available, but only stochastic…

Optimization and Control · Mathematics 2024-10-08 Albert S. Berahas , Miaolan Xie , Baoyu Zhou

This paper presents a methodology for using varying sample sizes in sequential quadratic programming (SQP) methods for solving equality constrained stochastic optimization problems. The first part of the paper deals with the delicate issue…

Optimization and Control · Mathematics 2023-03-23 Albert S. Berahas , Raghu Bollapragada , Baoyu Zhou

In this article, a globally convergent sequential quadratic programming (SQP) method is developed for multi-objective optimization problems with inequality type constraints. A feasible descent direction is obtained using a linear…

Optimization and Control · Mathematics 2020-05-20 Md Abu Talhamainuddin Ansary , Geetanjali Panda

We propose a trust-region stochastic sequential quadratic programming algorithm (TR-StoSQP) to solve nonlinear optimization problems with stochastic objectives and deterministic equality constraints. We consider a fully stochastic setting,…

Optimization and Control · Mathematics 2024-01-30 Yuchen Fang , Sen Na , Michael W. Mahoney , Mladen Kolar

Stochastic convex optimization problems with nonlinear functional constraints are ubiquitous in signal processing applications including constrained least-squares, set-membership adaptive filtering, and trajectory optimization under…

Optimization and Control · Mathematics 2025-12-16 Panchajanya Sanyal , Srujan Teja Thomdapu , Ketan Rajawat

We propose a sequential quadratic programming (SQP) algorithm for inequality constrained optimization that is robust to the presence of bounded noise in function and derivative evaluations. We cover the case where constraint evaluations…

Optimization and Control · Mathematics 2026-04-17 Figen Oztoprak , Richard Byrd

We propose a novel stochastic approximation algorithm, termed PMQSopt, for solving weakly convex stochastic optimization problems involving expectation-valued functions. The algorithm is constructed by integrating the proximal method of…

Optimization and Control · Mathematics 2026-05-06 Yule Zhang , Benqi Liu , Xiantao Xiao , Liwei Zhang

A sequential quadratic optimization algorithm for minimizing an objective function defined by an expectation subject to nonlinear inequality and equality constraints is proposed, analyzed, and tested. The context of interest is when it is…

Optimization and Control · Mathematics 2023-03-01 Frank E. Curtis , Daniel P. Robinson , Baoyu Zhou

We study nonlinear constrained optimization problems in which only function evaluations of the objective and constraints are available. Existing zeroth-order methods rely on noisy gradient and Jacobian surrogates in high dimensions, making…

Optimization and Control · Mathematics 2026-04-03 Runyu Zhang , Gioele Zardini

We propose a sequential quadratic programming (SQP) method that can incorporate adaptive sampling for stochastic nonsmooth nonconvex optimization problems with upper-C^2 objectives. Upper-$\Ctwo$ functions can be viewed as…

Optimization and Control · Mathematics 2023-10-17 J. Wang , I. Aravena , C. G. Petra

In this paper, we study nonconvex constrained optimization problems with both equality and inequality constraints, covering deterministic and stochastic settings. We propose a novel first-order algorithm framework that employs a…

Optimization and Control · Mathematics 2025-11-10 Qiankun Shi , Xiao Wang
‹ Prev 1 2 3 10 Next ›