English
Related papers

Related papers: Sequential Quadratic Optimization for Nonlinear Eq…

200 papers

Quadratic constrained quadratic programming problems often occur in various fields such as engineering practice, management science, and network communication. This article mainly studies a non convex quadratic programming problem with…

Optimization and Control · Mathematics 2023-12-29 Bo Zhang , YueLin Gao , Xia Liu , XiaoLi Huang

A multiscale numerical method is proposed for the solution of semi-linear elliptic stochastic partial differential equations with localized uncertainties and non-linearities, the uncertainties being modeled by a set of random parameters. It…

Numerical Analysis · Mathematics 2019-01-23 Anthony Nouy , Florent Pled

Optimization models with non-convex constraints arise in many tasks in machine learning, e.g., learning with fairness constraints or Neyman-Pearson classification with non-convex loss. Although many efficient methods have been developed…

Optimization and Control · Mathematics 2023-03-24 Runchao Ma , Qihang Lin , Tianbao Yang

Partition functions arise in a variety of settings, including conditional random fields, logistic regression, and latent gaussian models. In this paper, we consider semistochastic quadratic bound (SQB) methods for maximum likelihood…

Machine Learning · Statistics 2014-02-19 Aleksandr Y. Aravkin , Anna Choromanska , Tony Jebara , Dimitri Kanevsky

We consider solving nonlinear optimization problems with a stochastic objective and deterministic equality constraints, assuming that only zero-order information is available for both the objective and constraints, and that the objective is…

Optimization and Control · Mathematics 2025-10-28 Sen Na

In this paper we consider stochastic composite convex optimization problems with the objective function satisfying a stochastic bounded gradient condition, with or without a quadratic functional growth property. These models include the…

Optimization and Control · Mathematics 2020-03-10 Ion Necoara

Learning-based control methods for industrial processes leverage the repetitive nature of the underlying process to learn optimal inputs for the system. While many works focus on linear systems, real-world problems involve nonlinear…

Systems and Control · Electrical Eng. & Systems 2023-07-25 Samuel Balula , Efe C. Balta , Dominic Liao-McPherson , Alisa Rupenyan , John Lygeros

This paper proposes several novel optimization algorithms for minimizing a nonlinear objective function. The algorithms are enlightened by the optimal state trajectory of an optimal control problem closely related to the minimized objective…

Optimization and Control · Mathematics 2025-04-01 Hongxia Wang , Yeming Xu , Ziyuan Guo , Huanshui Zhang

Majorization-minimization schemes are a broad class of iterative methods targeting general optimization problems, including nonconvex, nonsmooth and stochastic. These algorithms minimize successively a sequence of upper bounds of the…

Optimization and Control · Mathematics 2024-01-11 Daniela Lupu , Ion Necoara

Non-convex optimization plays a key role in a growing number of machine learning applications. This motivates the identification of specialized structure that enables sharper theoretical analysis. One such identified structure is…

Optimization and Control · Mathematics 2023-06-06 Qiang Fu , Dongchu Xu , Ashia Wilson

Quadratic Unconstrained Binary Optimization models are useful for solving a diverse range of optimization problems. Constraints can be added by incorporating quadratic penalty terms into the objective, often with the introduction of slack…

Optimization and Control · Mathematics 2021-05-18 Amit Verma , Mark Lewis

This paper explores a new class of constrained difference programming problems, where the objective and constraints are formulated as differences of functions, without requiring their convexity. To investigate such problems, novel variants…

Optimization and Control · Mathematics 2026-04-21 Boris S. Mordukhovich , Yixia Song , Shangzhi Zeng , Jin Zhang

The standard quadratic optimization problem (StQP) consists of minimizing a quadratic form over the standard simplex. Without convexity or concavity of the quadratic form, the StQP is NP-hard. This problem has many relevant real-life…

Optimization and Control · Mathematics 2025-04-10 Immanuel M. Bomze , Daniel de Vicente

In this paper, we propose a parallel shooting algorithm for solving nonlinear model predictive control problems using sequential quadratic programming. This algorithm is built on a two-phase approach where we first test and assess…

Systems and Control · Electrical Eng. & Systems 2023-07-21 P. C. N. Verheijen , M. Haghi , M. Lazar , D. Goswami

This paper considers the problem of minimizing a convex expectation function with a set of inequality convex expectation constraints. We present a computable stochastic approximation type algorithm, namely the stochastic linearized proximal…

Optimization and Control · Mathematics 2022-06-16 Liwei Zhang , Yule Zhang , Jia Wu , Xiantao Xiao

This paper presents a novel stochastic gradient descent algorithm for constrained optimization. The proposed algorithm randomly samples constraints and components of the finite sum objective function and relies on a relaxed logarithmic…

Optimization and Control · Mathematics 2025-05-13 Naum Dimitrieski , Jing Cao , Christian Ebenbauer

We consider the problem of analyzing and designing gradient-based discrete-time optimization algorithms for a class of unconstrained optimization problems having strongly convex objective functions with Lipschitz continuous gradient. By…

Optimization and Control · Mathematics 2025-10-20 Simon Michalowsky , Carsten Scherer , Christian Ebenbauer

The classical method to solve a quadratic optimization problem with nonlinear equality constraints is to solve the Karush-Kuhn-Tucker (KKT) optimality conditions using Newton's method. This approach however is usually computationally…

Optimization and Control · Mathematics 2016-03-17 Tuan T. Nguyen , Mircea Lazar , Hans Butler

We propose an SQP algorithm for mathematical programs with vanishing constraints which solves at each iteration a quadratic program with linear vanishing constraints. The algorithm is based on the newly developed concept of $\mathcal…

Optimization and Control · Mathematics 2016-11-28 Matúš Benko , Helmut Gfrerer

Stochastic constraints, which incorporate both deterministic parameters and random variables, extend classical deterministic constraints by explicitly accounting for uncertainty. These constraints are increasingly prevalent in data science,…

Logic in Computer Science · Computer Science 2026-04-21 Xiakun Li , Hao Wu , Bican Xia , Tengshun Yang , Naijun Zhan