English
Related papers

Related papers: Optimality condition and complexity analysis for l…

200 papers

In most machine learning applications, classification accuracy is not the primary metric of interest. Binary classifiers which face class imbalance are often evaluated by the $F_\beta$ score, area under the precision-recall curve, Precision…

Machine Learning · Computer Science 2018-03-02 Alan Mackey , Xiyang Luo , Elad Eban

Much is known about when a locally optimal solution depends in a single-valued Lipschitz continuous way on the problem's parameters, including tilt perturbations. Much less is known, however, about when that solution and a uniquely…

Optimization and Control · Mathematics 2024-01-02 Matus Benko , R. Tyrrell Rockafellar

In this paper, we study the regularity assumptions commonly adopted in bilevel optimization with constrained lower-level problems, including the linear independence constraint qualification, the strict complementary slackness condition, and…

Optimization and Control · Mathematics 2026-05-15 Xiaotian Jiang , Chang He , Mingyi Hong , Shuzhong Zhang

This paper investigates constrained nonsmooth multiobjective fractional programming problem (NMFP) in real Banach spaces. It derives a quotient calculus rule for computing the first- and second-order Clarke derivatives of fractional…

Optimization and Control · Mathematics 2024-03-18 Jiawei Chen , Luyu Liu , Yibing Lv , Debdas Ghosh , Jen-Chih Yao

Motivated by some applications in signal processing and machine learning, we consider two convex optimization problems where, given a cone $K$, a norm $\|\cdot\|$ and a smooth convex function $f$, we want either 1) to minimize the norm over…

Optimization and Control · Mathematics 2013-03-29 Zaid Harchaoui , Anatoli Juditsky , Arkadi Nemirovski

This paper focuses on optimality conditions for $C^{1,1}$ vector optimization problems with inequality constraints. By employing the limiting second-order subdifferential and the second-order tangent set, we introduce a new type of…

Optimization and Control · Mathematics 2025-03-04 Nguyen Van Tuyen

This paper re-examines a continuous optimization framework dubbed NOTEARS for learning Bayesian networks. We first generalize existing algebraic characterizations of acyclicity to a class of matrix polynomials. Next, focusing on a…

Machine Learning · Computer Science 2020-10-20 Dennis Wei , Tian Gao , Yue Yu

When dealing with general Lipschitzian optimization problems, there are many problem classes where even weak constraint qualifications fail at local minimizers. In contrast to a constraint qualification, a problem qualification does not…

Optimization and Control · Mathematics 2025-02-27 Isabella Käming , Andreas Fischer , Alain B. Zemkoho

This paper deals with the optimization of Bolza problem with a system of convex and nonconvex, discrete and differential state variable inequality constraints of second order by deriving necessary and sufficient conditions for optimality.…

Optimization and Control · Mathematics 2020-09-17 Elimhan N. Mahmudov , S. Demir Saglam

We introduce a new form of Lagrangian and propose a simple first-order algorithm for nonconvex optimization with nonlinear equality constraints. We show the algorithm generates bounded dual iterates, and establish the convergence to KKT…

Optimization and Control · Mathematics 2023-05-10 Jong Gwang Kim

In this paper, we consider the cardinality-constrained optimization problems and propose a new sequential optimality condition for the continuous relaxation reformulation which is popular recently. It is stronger than the existing results…

Optimization and Control · Mathematics 2021-10-05 Liping Pang , Menglong Xue , Na Xu

Optimization - minimization or maximization - in the lattice of subsets is a frequent operation in Artificial Intelligence tasks. Examples are subset-minimal model-based diagnosis, nonmonotonic reasoning by means of circumscription, or…

Artificial Intelligence · Computer Science 2016-12-23 Wolfgang Faber , Mauro Vallati , Federico Cerutti , Massimiliano Giacomin

Optimality conditions in the form of a variational inequality are proved for a class of constrained optimal control problems of stochastic differential equations. The cost function and the inequality constraints are functions of the…

Optimization and Control · Mathematics 2018-02-13 Laurent Pfeiffer

A worst-case complexity bound is proved for a sequential quadratic optimization (commonly known as SQP) algorithm that has been designed for solving optimization problems involving a stochastic objective function and deterministic nonlinear…

Optimization and Control · Mathematics 2022-01-10 Frank E. Curtis , Michael J. O'Neill , Daniel P. Robinson

This paper studies chance-constrained stochastic optimization problems with finite support. It presents an iterative method that solves reduced-size chance-constrained models obtained by partitioning the scenario set. Each reduced problem…

Optimization and Control · Mathematics 2024-11-26 Marius Roland , Alexandre Forel , Thibaut Vidal

We present an approach to handle Dirichlet type nonlocal boundary conditions for nonlocal diffusion models with a finite range of nonlocal interactions. Our approach utilizes a linear extrapolation of prescribed boundary data. A novelty is,…

Analysis of PDEs · Mathematics 2021-08-27 Hwi Lee , Qiang Du

Strict linear feasibility or linear separation is usually tackled using efficient approximation/stochastic algorithms (that may even run in sub-linear times in expectation). However, today state of the art for solving…

Data Structures and Algorithms · Computer Science 2026-02-17 Adrien Chan-Hon-Tong

In this paper we study the optimal control of an initial-boundary value problem for the classical nonviscous Cahn-Hilliard system with zero Neumann boundary conditions. Phase field systems of this type govern the evolution of diffusive…

Optimization and Control · Mathematics 2024-06-12 Pierluigi Colli , Jürgen Sprekels

Primal-Dual Interior-Point methods are capable of solving constrained convex optimization problems to tight tolerances in a fast and robust manner. The derivatives of the primal-dual solution with respect to the problem matrices can be…

Optimization and Control · Mathematics 2024-06-21 Kevin Tracy , Zachary Manchester

We present a derivative-based algorithm for nonlinearly constrained optimization problems that is tolerant of inaccuracies in the data. The algorithm solves a semi-smooth set of nonlinear equations that are equivalent to the first-order…

Optimization and Control · Mathematics 2017-09-21 Jason E. Hicken , Pengfei Meng , Alp Dener