English
Related papers

Related papers: A data scalable augmented Lagrangian KKT precondit…

200 papers

We propose a variant of the classical augmented Lagrangian method for constrained optimization problems in Banach spaces. Our theoretical framework does not require any convexity or second-order assumptions and allows the treatment of…

Optimization and Control · Mathematics 2018-07-13 Christian Kanzow , Daniel Steck , Daniel Wachsmuth

We address the solution of the distributed control problem for the steady, incompressible Navier--Stokes equations. We propose an inexact Newton linearization of the optimality conditions. Upon discretization by a finite element scheme, we…

Numerical Analysis · Mathematics 2025-04-16 Santolo Leveque , Michele Benzi , Patrick E. Farrell

Second-order optimality conditions for vector nonlinear programming problems with inequality constraints are studied in this paper. We introduce a new second-order constraint qualification, which includes Mangasarian-Fromovitz constraint…

Optimization and Control · Mathematics 2019-06-11 Vsevolod I. Ivanov

Due to the possible lack of primal-dual-type error bounds, the superlinear convergence for the Karush-Kuhn-Tucker (KKT) residues of the sequence generated by augmented Lagrangian method (ALM) for solving convex composite conic programming…

Optimization and Control · Mathematics 2017-06-28 Ying Cui , Defeng Sun , Kim-Chuan Toh

We propose an algorithm for general nonlinear conic programming which does not require the knowledge of the full cone, but rather a simpler, more tractable, approximation of it. We prove that the algorithm satisfies a strong global…

Optimization and Control · Mathematics 2025-04-22 Mituhiro Fukuda , Walter Gómez , Gabriel Haeser , Leonardo Makoto Mito

Computing approximate Karush--Kuhn--Tucker (KKT) points for constrained nonconvex programs is a fundamental problem in mathematical programming. Interior-point trust-region (IPTR) methods are particularly attractive for such problems…

Data Structures and Algorithms · Computer Science 2026-04-28 Yuexin Su , Chenyi Zhang , Peiyuan Huang , Tongyang Li , Yinyu Ye

A proximal safeguarded augmented Lagrangian method for minimizing the difference of convex (DC) functions over a nonempty, closed and convex set with additional linear equality as well as convex inequality constraints is presented. Thereby,…

Optimization and Control · Mathematics 2026-04-01 Christian Kanzow , Tanja Neder

As the number of processor cores on supercomputers becomes larger and larger, algorithms with high degree of parallelism attract more attention. In this work, we propose a novel space-time coupled algorithm for solving an inverse problem…

Numerical Analysis · Computer Science 2015-08-26 Xiaomao Deng , Xiao-chuan Cai , Jun Zou

The composite $L_q~(0<q<1)$ minimization problem over a general polyhedron has received various applications in machine learning, wireless communications, image restoration, signal reconstruction, etc. This paper aims to provide a…

Optimization and Control · Mathematics 2014-07-29 Ya-Feng Liu , Shiqian Ma , Yu-Hong Dai , Shuzhong Zhang

In this paper we study a nonconvex-strongly-concave constrained minimax problem. Specifically, we propose a first-order augmented Lagrangian method for solving it, whose subproblems are nonconvex-strongly-concave unconstrained minimax…

Optimization and Control · Mathematics 2026-01-06 Zhaosong Lu , Sanyou Mei

We propose a novel preconditioned inexact primal-dual interior point method for constrained convex quadratic programming problems. The algorithm we describe invokes the preconditioned conjugate gradient method on a new reduced Schur…

Numerical Analysis · Mathematics 2021-12-28 Samah Karim , Edgar Solomonik

We present preconditioning techniques to solve linear systems of equations with a block two-by-two and three-by-three structure arising from finite element discretizations of the fictitious domain method with Lagrange multipliers. In…

Numerical Analysis · Mathematics 2026-03-09 Michele Benzi , Marco Feder , Luca Heltai , Federica Mugnaioni

Solving optimization problems with transient PDE-constraints is computationally costly due to the number of nonlinear iterations and the cost of solving large-scale KKT matrices. These matrices scale with the size of the spatial…

Numerical Analysis · Mathematics 2023-05-09 Eric C. Cyr

In the recent paper of Giorgi, Jim\'enez and Novo (J Optim Theory Appl 171:70--89, 2016), the authors introduced the so-called approximate Karush-Kuhn-Tucker (AKKT) condition for smooth multiobjective optimization problems and obtained some…

Optimization and Control · Mathematics 2018-04-16 Nguyen Van Tuyen , Jen-Chih Yao , Ching-Feng Wen

In this paper, we revisit the large-scale constrained linear regression problem and propose faster methods based on some recent developments in sketching and optimization. Our algorithms combine (accelerated) mini-batch SGD with a new…

Machine Learning · Computer Science 2018-02-12 Di Wang , Jinhui Xu

For optimization problems with linear equality constraints, we prove that the (1,1) block of the inverse KKT matrix remains unchanged when projected onto the nullspace of the constraint matrix. We develop reduced compact representations of…

Optimization and Control · Mathematics 2023-12-13 Johannes J. Brust , Roummel F. Marcia , Cosmin G. Petra , Michael A. Saunders

We consider a smooth pessimistic bilevel optimization problem, where the lower-level problem is convex and satisfies the Slater constraint qualification. These assumptions ensure that the Karush-Kuhn-Tucker (KKT) reformulation of our…

Optimization and Control · Mathematics 2025-09-15 Imane Benchouk , Lateef Jolaoso , Khadra Nachi , Alain Zemkoho

Sensor networks play a critical role in many situational awareness applications. In this paper, we study the problem of determining sensor placements to balance coverage and connectivity objectives over a target region. Leveraging algebraic…

Optimization and Control · Mathematics 2025-04-08 Mathias Bock Agerman , Ziqiao Zhang , Jong Gwang Kim , Shreyas Sundaram , Christopher Brinton

The classical method to solve a quadratic optimization problem with nonlinear equality constraints is to solve the Karush-Kuhn-Tucker (KKT) optimality conditions using Newton's method. This approach however is usually computationally…

Optimization and Control · Mathematics 2016-03-17 Tuan T. Nguyen , Mircea Lazar , Hans Butler

A novel augmented Lagrangian method for solving non-convex programs with nonlinear cost and constraint couplings in a distributed framework is presented. The proposed decomposition algorithm is made of two layers: The outer level is a…

Optimization and Control · Mathematics 2014-07-22 Jean-Hubert Hours , Colin N. Jones