English
Related papers

Related papers: Nonlinear Derivative-free Constrained Optimization…

200 papers

In this paper, we consider a nonconvex optimization problem with nonlinear equality constraints. We assume that both, the objective function and the functional constraints are locally smooth. For solving this problem, we propose a…

Optimization and Control · Mathematics 2025-05-08 Lahcen El Bourkhissi , Ion Necoara

Most inverse optimization models impute unspecified parameters of an objective function to make an observed solution optimal for a given optimization problem with a fixed feasible set. We propose two approaches to impute unspecified…

Optimization and Control · Mathematics 2019-07-19 Timothy C. Y. Chan , Neal Kaw

This paper considers the fixed point problem for a nonexpansive mapping on a real Hilbert space and proposes novel line search fixed point algorithms to accelerate the search. The termination conditions for the line search are based on the…

Optimization and Control · Mathematics 2015-09-21 Hideaki Iiduka

Solving equilibrium problems under constraints is an important problem in optimization and optimal control. In this context an important practical challenge is the efficient incorporation of constraints. We develop a continuous-time method…

Optimization and Control · Mathematics 2024-03-21 Siqi Qu , Mathias Staudigl

Stochastic nonconvex optimization problems with nonlinear constraints have a broad range of applications in intelligent transportation, cyber-security, and smart grids. In this paper, first, we propose an inexact-proximal accelerated…

Optimization and Control · Mathematics 2021-07-08 Morteza Boroun , Afrooz Jalilzadeh

In this paper we study a class of unconstrained and constrained bilevel optimization problems in which the lower level is a possibly nonsmooth convex optimization problem, while the upper level is a possibly nonconvex optimization problem.…

Optimization and Control · Mathematics 2024-03-08 Zhaosong Lu , Sanyou Mei

The magnetostatic field distribution in a nonlinear medium amounts to the unique minimizer of the magnetic coenergy over all fields that can be generated by the same current. This is a nonlinear saddlepoint problem whose numerical solution…

Numerical Analysis · Mathematics 2024-03-28 Herbert Egger , Felix Engertsberger , Klaus Roppert

Interior-point methods for linear programming problems require the repeated solution of a linear system of equations. Solving these linear systems is non-trivial due to the severe ill-conditioning of the matrices towards convergence. This…

Optimization and Control · Mathematics 2021-05-05 Jeffrey Cornelis , Wim Vanroose

In this paper, we extend a class of globally convergent evolution strategies to handle general constrained optimization problems. The proposed framework handles relaxable constraints using a merit function approach combined with a specific…

Optimization and Control · Mathematics 2018-10-18 Youssef Diouane

This paper proposes a new method for differentiating through optimal trajectories arising from non-convex, constrained discrete-time optimal control (COC) problems using the implicit function theorem (IFT). Previous works solve a…

Machine Learning · Computer Science 2023-10-25 Ming Xu , Timothy Molloy , Stephen Gould

This article presents nonlinear conjugate gradient methods for finding local weakly minimal points of set-valued optimization problems under a lower set less ordering relation. The set-valued objective function of the optimization problem…

Optimization and Control · Mathematics 2024-12-31 Debdas Ghosh , Ravi Raushan , Zai-Yun Peng , Jen-Chih Yao

In this work, we introduce a novel strategy for tackling constrained optimization problems through a modified penalty method. Conventional penalty methods convert constrained problems into unconstrained ones by incorporating constraints…

Optimization and Control · Mathematics 2024-09-05 Shilin Ma , Yukun Yue

This paper is devoted to studying the stationary solutions of a general constrained optimization problem through its associated unconstrained penalized problems. We aim to answer the question, "what do the stationary solutions of a…

Optimization and Control · Mathematics 2022-06-28 Ashkan Mohammadi

We present a focused introduction to exact penalty methods for nonlinear programs and mathematical programs with equilibrium constraints (MPECs), emphasizing their connection to modern error bound theory. The goal is twofold. First, we…

Optimization and Control · Mathematics 2026-05-04 Louis Shuo Wang

Equilibrium equations in the form of complementarity conditions often appear as constraints in optimization problems. Problems of this type are commonly referred to as mathematical programs with complementarity constraints (MPCCs). A…

Optimization and Control · Mathematics 2025-10-20 Sven Leyffer

A new universal derivative-free optimization method CDOS (Conjugate Direction with Orthogonal Shift) is proposed. The CDOS method was specially developed to solve optimization tasks where the objective function and constraints are black…

Optimization and Control · Mathematics 2011-02-08 Sergey Moiseev

In this two-part study we develop a general approach to the design and analysis of exact penalty functions for various optimal control problems, including problems with terminal and state constraints, problems involving differential…

Optimization and Control · Mathematics 2020-01-10 M. V. Dolgopolik , A. V. Fominyh

We address a problem of covariance selection, where we seek a trade-off between a high likelihood against the number of non-zero elements in the inverse covariance matrix. We solve a maximum likelihood problem with a penalty term given by…

Computational Engineering, Finance, and Science · Computer Science 2007-05-23 Onureena Banerjee , Alexandre d'Aspremont , Laurent El Ghaoui

We present a coordinate ascent method for a class of semidefinite programming problems that arise in non-convex quadratic integer optimization. These semidefinite programs are characterized by a small total number of active constraints and…

Optimization and Control · Mathematics 2020-07-13 Christoph Buchheim , Maribel Montenegro , Angelika Wiegele

In most machine learning applications, classification accuracy is not the primary metric of interest. Binary classifiers which face class imbalance are often evaluated by the $F_\beta$ score, area under the precision-recall curve, Precision…

Machine Learning · Computer Science 2018-03-02 Alan Mackey , Xiyang Luo , Elad Eban