English
Related papers

Related papers: Second-order optimality conditions and Lagrange mu…

200 papers

In this paper, we employ the concept of quasi-relative interior to analyze the method of Lagrange multipliers and establish strong Lagrangian duality for nonsmooth convex optimization problems in Hilbert spaces. Then, we generalize the…

Optimization and Control · Mathematics 2026-02-17 Nguyen Mau Nam , Gary Sandine , Quoc Tran-Dinh

We consider nonlinear optimization problems with cardinality constraints. Based on a continuous reformulation we introduce second order necessary and sufficient optimality conditions. Under such a second order condition, we can guarantee…

Optimization and Control · Mathematics 2017-09-06 Max Bucher , Alexandra Schwartz

In this paper we study the worst-case complexity of an inexact Augmented Lagrangian method for nonconvex constrained problems. Assuming that the penalty parameters are bounded, we prove a complexity bound of $\mathcal{O}(|\log(\epsilon)|)$…

Optimization and Control · Mathematics 2021-05-25 Geovani N. Grapiglia , Ya-xiang Yuan

The bilevel program is an optimization problem where the constraint involves solutions to a parametric optimization problem. It is well-known that the value function reformulation provides an equivalent single-level optimization problem but…

Optimization and Control · Mathematics 2020-11-19 Kuang Bai , Jane Ye

This paper is concerned with necessary and sufficient second-order conditions for finite-dimensional and infinite-dimensional constrained optimization problems. Using a suitably defined directional curvature functional for the admissible…

Optimization and Control · Mathematics 2021-01-26 Constantin Christof , Gerd Wachsmuth

Clustering is a hard discrete optimization problem. Nonconvex approaches such as low-rank semidefinite programming (SDP) have recently demonstrated promising statistical and local algorithmic guarantees for cluster recovery. Due to the…

Machine Learning · Computer Science 2026-03-05 Peng Xu , Chun-Ying Hou , Xiaohui Chen , Richard Y. Zhang

In this paper, we analyze optimal control problems governed by semilinear parabolic equations. Box constraints for the controls are imposed and the cost functional involves the state and possibly a sparsity-promoting term, but not a…

Optimization and Control · Mathematics 2022-05-18 Eduardo Casas , Mariano Mateos

The continuous nonlinear resource allocation problem (CONRAP) has broad applications in economics, engineering, production and inventory management, and often serves as a subproblem in complex programming. Without relying on monotonicity…

Optimization and Control · Mathematics 2025-01-10 Kaixiang Hu , Caixia Kou , Jianhua Yuan

In this paper, in terms of three types of generalized second-order derivatives of a nonsmooth function, we mainly study the corresponding second-order optimality conditions in a Hilbert space and prove the equivalence among these optimality…

Optimization and Control · Mathematics 2016-07-25 Zhou Wei , Jen-Chih Yao

In this paper, we investigate second-order necessary conditions and exact penalty of mathematical programs with switching constraints (MPSC). Some new second-order constraint qualifications and second-order quasi-normality are introduced…

Optimization and Control · Mathematics 2024-07-29 Jiawei Chen , Luyu Liu , Yibing Lv , Kequan Zhao

This paper extends the SQP-approach of the well-known bundle-Newton method for nonsmooth unconstrained minimization to the nonlinearly constrained case. Instead of using a penalty function or a filter or an improvement function to deal with…

Optimization and Control · Mathematics 2015-06-29 Hannes Fendl , Hermann Schichl

In this paper, we investigate the multi-objective optimal control problem of ordinary differential equations on Riemannian manifolds. We first obtain the second-order necessary conditions for weak Pareto optimal solutions for…

Optimization and Control · Mathematics 2025-02-14 Li Deng

The paper concerns the study of criticality of Lagrange multipliers in variational systems that has been recognized in both theoretical and numerical aspects of optimization and variational analysis. In contrast to the previous developments…

Optimization and Control · Mathematics 2018-08-14 Boris Mordukhovich , Ebrahim Sarabi

This paper re-examines a continuous optimization framework dubbed NOTEARS for learning Bayesian networks. We first generalize existing algebraic characterizations of acyclicity to a class of matrix polynomials. Next, focusing on a…

Machine Learning · Computer Science 2020-10-20 Dennis Wei , Tian Gao , Yue Yu

In this paper, we derive explicit second-order necessary and sufficient optimality conditions of a local minimizer to an optimal control problem for a quasilinear second-order partial differential equation with a piecewise smooth but not…

Optimization and Control · Mathematics 2023-09-13 Christian Clason , Vu Huu Nhu , Arnd Rösch

Current state of the art preconditioners for the reduced Hessian and the Karush-Kuhn-Tucker (KKT) operator for large scale inverse problems are typically based on approximating the reduced Hessian with the regularization operator. However,…

Numerical Analysis · Mathematics 2017-08-03 Nick Alger , Umberto Villa , Tan Bui-Thanh , Omar Ghattas

In this paper, we adopt the augmented Lagrangian method (ALM) to solve convex quadratic second-order cone programming problems (SOCPs). Fruitful results on the efficiency of the ALM have been established in the literature. Recently, it has…

Optimization and Control · Mathematics 2021-10-26 Ling Liang , Defeng Sun , Kim-Chuan Toh

When the objective function is not locally Lipschitz, constraint qualifications are no longer sufficient for Karush-Kuhn-Tucker (KKT) conditions to hold at a local minimizer, let alone ensuring an exact penalization. In this paper, we…

Optimization and Control · Mathematics 2017-01-17 Lei Guo , Jane J. Ye

In this paper we study a second order dynamical system with variable coefficients in connection to the minimization problem of a smooth nonconvex function. The convergence of the trajectories generated by the dynamical system to a critical…

Optimization and Control · Mathematics 2025-10-21 Szilárd Csaba László

Variational inequalities represent a broad class of problems, including minimization and min-max problems, commonly found in machine learning. Existing second-order and high-order methods for variational inequalities require precise…