English
Related papers

Related papers: Adjoint-based SQP Method with Block-wise quasi-New…

200 papers

Sequential quadratic programming (SQP) is widely used in solving nonlinear optimization problem, with advantages of warm-starting solutions, as well as finding high-accurate solution and converging quadratically using second-order…

Optimization and Control · Mathematics 2023-10-23 Bowen Li , Michel Schanen , Kibaek Kim

The classic method for computing the spectral decomposition of a real symmetric matrix, the Jacobi algorithm, can be accelerated by using mixed precision arithmetic. The Jacobi algorithm is aiming to reduce the off-diagonal entries…

Numerical Analysis · Mathematics 2025-09-03 Zhengbo Zhou

In this paper, a novel stochastic extra-step quasi-Newton method is developed to solve a class of nonsmooth nonconvex composite optimization problems. We assume that the gradient of the smooth part of the objective function can only be…

Optimization and Control · Mathematics 2019-10-22 Minghan Yang , Andre Milzarek , Zaiwen Wen , Tong Zhang

Non-convex quadratically constrained quadratic programming (QCQP) problems have numerous applications in signal processing, machine learning, and wireless communications, albeit the general QCQP is NP-hard, and several interesting special…

Optimization and Control · Mathematics 2016-09-21 Kejun Huang , Nicholas D. Sidiropoulos

This paper proposes a control algorithm for stable implementation of asynchronous parallel quadratic programming (PQP) through dual decomposition technique. In general, distributed and parallel optimization requires synchronization of data…

Systems and Control · Electrical Eng. & Systems 2019-11-26 Kooktae Lee

A q-Gauss-Newton algorithm is an iterative procedure that solves nonlinear unconstrained optimization problems based on minimization of the sum squared errors of the objective function residuals. Main advantage of the algorithm is that it…

Optimization and Control · Mathematics 2021-05-28 Danijela Protic , Miomir Stankovic

We investigate the possibility of solving continuous non-convex optimization problems using a network of interacting quantum optical oscillators. We propose a native encoding of continuous variables in analog signals associated with the…

Quantum Physics · Physics 2023-03-10 Farhad Khosravi , Ugur Yildiz , Artur Scherer , Pooya Ronagh

We study online statistical inference for the solutions of stochastic optimization problems with equality and inequality constraints. Such problems are prevalent in statistics and machine learning, encompassing constrained $M$-estimation,…

Machine Learning · Statistics 2025-12-11 Yihang Gao , Michael K. Ng , Michael W. Mahoney , Sen Na

Although Anderson acceleration (AA) is known to speed up fixed-point iterations, it is rarely applied in constrained optimization, in particular sequential quadratic programming (SQP). We show that the local convergence behavior of a…

Optimization and Control · Mathematics 2026-04-17 Jonathan Frey , David Kiessling , Katrin Baumgärtner , Moritz Diehl

We address the problem of computing a control for a time-dependent nonlinear system to reach a target set in a minimal time. To solve this minimal time control problem, we introduce a hierarchy of linear semi-infinite programs, the values…

Optimization and Control · Mathematics 2023-07-04 Antoine Oustry , Matteo Tacchi

Maximum likelihood estimation of mixture proportions has a long history, and continues to play an important role in modern statistics, including in development of nonparametric empirical Bayes methods. Maximum likelihood of mixture…

Computation · Statistics 2020-12-10 Youngseok Kim , Peter Carbonetto , Matthew Stephens , Mihai Anitescu

Model Predictive Control (MPC) is a popular optimization-based control technique. MPC is usually formulated as sparse or dense Quadratic Programming (QP). This paper reviews two well-known methods, namely, state condensing and move…

Systems and Control · Electrical Eng. & Systems 2020-02-18 Pavel Otta , Ondrej Santin , Vladimir Havlena

In this paper, a self-triggered adaptive model predictive control (MPC) algorithm is proposed for constrained discrete-time nonlinear systems subject to parametric uncertainties and additive disturbances. To bound the parametric…

Optimization and Control · Mathematics 2019-12-17 Kunwu Zhang , Changxin Liu , Yang Shi

We establish a collection of closed-loop guarantees and propose a scalable optimization algorithm for distributionally robust model predictive control (DRMPC) applied to linear systems, convex constraints, and quadratic costs. Via standard…

Optimization and Control · Mathematics 2024-11-13 Robert D. McAllister , Peyman Mohajerin Esfahani

This paper proposes an efficient adaptive variant of a quadratic penalty accelerated inexact proximal point (QP-AIPP) method proposed earlier by the authors. Both the QP-AIPP method and its variant solve linearly set constrained nonconvex…

Optimization and Control · Mathematics 2019-12-09 Weiwei Kong , Jefferson G. Melo , Renato D. C. Monteiro

Stochastic sequential quadratic optimization (SQP) methods for solving continuous optimization problems with nonlinear equality constraints have attracted attention recently, such as for solving large-scale data-fitting problems subject to…

Optimization and Control · Mathematics 2023-08-08 Frank E. Curtis , Xin Jiang , Qi Wang

Software for computation of maximum likelihood estimates in linear structural equation models typically employs general techniques from non-linear optimization, such as quasi-Newton methods. In practice, careful tuning of initial values is…

Computation · Statistics 2016-10-12 Mathias Drton , Christopher Fox , Y. Samuel Wang

This paper addresses the challenge of developing efficient algorithms for large-scale nonconvex multiobjective optimization problems (MOPs). While quasi-Newton methods are effective, their traditional application to MOPs is computationally…

Optimization and Control · Mathematics 2025-12-23 Hua Liu

We present a numerically efficient Nonlinear Model Predictive Control (NMPC) approach, called Set Membership based NMPC (SM-NMPC). In particular, a Set Membership method is used to derive from data an approximation and tight bounds on the…

Systems and Control · Electrical Eng. & Systems 2023-02-01 Mattia Boggio , Carlo Novara , Michele Taragna

In this paper we propose a randomized primal-dual proximal block coordinate updating framework for a general multi-block convex optimization model with coupled objective function and linear constraints. Assuming mere convexity, we establish…

Optimization and Control · Mathematics 2017-01-25 Xiang Gao , Yangyang Xu , Shuzhong Zhang