English
Related papers

Related papers: An interior point method for nonlinear constrained…

200 papers

Derivative-free optimization algorithms are particularly useful for tackling blackbox optimization problems where the objective function arises from complex and expensive procedures that preclude the use of classical gradient-based methods.…

Optimization and Control · Mathematics 2026-03-31 El Houcine Bergou , Youssef Diouane , Vyacheslav Kungurtsev , Clément W. Royer

An important aspect in the solution process of constraint satisfaction problems is to identify exclusion boxes which are boxes that do not contain feasible points. This paper presents a certificate of infeasibility for finding such boxes by…

Optimization and Control · Mathematics 2015-06-30 Hannes Fendl , Arnold Neumaier , Hermann Schichl

Differentiating through the solution of a quadratic program (QP) is a central problem in differentiable optimization. Most existing approaches differentiate through the Karush--Kuhn--Tucker (KKT) system, but their computational cost and…

Machine Learning · Computer Science 2026-03-04 Yuxuan Linghu , Zhiyuan Liu , Qi Deng

Most linear algebra kernels in interior point methods for linear programming require the solution of linear systems of equation with the matrix $N = A^TD^{-1}A$ (or $AD^{-1}A^T$), where $A$ denotes the constraint matrix of the linear…

Numerical Analysis · Mathematics 2017-08-17 Robert Luce

Optimization models with non-convex constraints arise in many tasks in machine learning, e.g., learning with fairness constraints or Neyman-Pearson classification with non-convex loss. Although many efficient methods have been developed…

Optimization and Control · Mathematics 2023-03-24 Runchao Ma , Qihang Lin , Tianbao Yang

Motivated by the problem of tuning hyperparameters in machine learning, we present a new approach for gradually and adaptively optimizing an unknown function using estimated gradients. We validate the empirical performance of the proposed…

Machine Learning · Computer Science 2019-06-05 Weijia Shao , Christian Geißler , Fikret Sivrikaya

We investigate the performance of a deterministic GREEDY algorithm for the problem of maximizing functions under a partition matroid constraint. We consider non-monotone submodular functions and monotone subadditive functions. Even though…

Discrete Mathematics · Computer Science 2019-02-22 Tobias Friedrich , Andreas Göbel , Frank Neumann , Francesco Quinzan , Ralf Rothenberger

In this paper, we present a novel derivative-free optimization framework for solving unconstrained stochastic optimization problems. Many problems in fields ranging from simulation optimization to reinforcement learning involve settings…

Optimization and Control · Mathematics 2024-04-19 Raghu Bollapragada , Cem Karamanli , Stefan M. Wild

Traditional mathematical programming solvers require long computational times to solve constrained minimization problems of complex and large-scale physical systems. Therefore, these problems are often transformed into unconstrained ones,…

Optimization and Control · Mathematics 2024-05-06 Ksenija Stepanovic , Wendelin Böhmer , Mathijs de Weerdt

We propose a novel solution framework for inverse mixed-integer optimization based on analytic center concepts from interior point methods. We characterize the optimality gap of a given solution, provide structural results, and propose…

Optimization and Control · Mathematics 2025-04-08 Samir Elhedhli , Göksu Ece Okur

We consider the problem of optimizing a grey-box objective function, i.e., nested function composed of both black-box and white-box functions. A general formulation for such grey-box problems is given, which covers the existing grey-box…

Machine Learning · Computer Science 2023-08-03 Wenjie Xu , Yuning Jiang , Bratislav Svetozarevic , Colin N. Jones

A sequential quadratic optimization algorithm is proposed for solving smooth nonlinear equality constrained optimization problems in which the objective function is defined by an expectation of a stochastic function. The algorithmic…

Optimization and Control · Mathematics 2023-03-17 Albert S. Berahas , Frank E. Curtis , Michael J. O'Neill , Daniel P. Robinson

Constrained quasiconvex optimization problems appear in many fields, such as economics, engineering, and management science. In particular, fractional programming, which models ratio indicators such as the profit/cost ratio as fractional…

Optimization and Control · Mathematics 2019-09-02 Kazuhiro Hishinuma , Hideaki Iiduka

An adaptive regularization algorithm for unconstrained nonconvex optimization is proposed that is capable of handling inexact objective-function and derivative values, and also of providing approximate minimizer of arbitrary order. In…

Optimization and Control · Mathematics 2021-11-30 N. I. M. Gould , Ph. L. Toint

This work proposes the integration of two new constraint-handling approaches into the blackbox constrained multiobjective optimization algorithm DMulti-MADS, an extension of the Mesh Adaptive Direct Search (MADS) algorithm for…

Optimization and Control · Mathematics 2022-04-05 Jean Bigeon , Sébastien Le Digabel , Ludovic Salomon

This paper presents a piecewise convexification method for solving non-convex multi-objective optimization problems with box constraints. Based on the ideas of the $\alpha$-based Branch and Bound (${\rm \alpha BB}$) method of global…

Optimization and Control · Mathematics 2022-06-28 Q. Zhu , L. P. Tang , X. M. Yang

We provide a condition-based analysis of two interior-point methods for unconstrained geometric programs, a class of convex programs that arise naturally in applications including matrix scaling, matrix balancing, and entropy maximization.…

Optimization and Control · Mathematics 2020-08-28 Peter Bürgisser , Yinan Li , Harold Nieuwboer , Michael Walter

In this paper we consider multi-objective optimization problems over a box. The problem is very relevant and several computational approaches have been proposed in the literature. They broadly fall into two main classes: evolutionary…

Optimization and Control · Mathematics 2022-12-08 Matteo Lapucci , Pierluigi Mansueto , Fabio Schoen

Traditional methods for handling (inequality) constraints in the Quantum Approximate Optimization Ansatz (QAOA) typically rely on penalty terms and slack variables, which increase problem complexity and expand the search space. More…

Quantum Physics · Physics 2025-12-04 David Bucher , Jonas Stein , Sebastian Feld , Claudia Linnhoff-Popien

This paper investigates the problem of efficient constrained global optimization of hybrid models that are a composition of a known white-box function and an expensive multi-output black-box function subject to noisy observations, which…

Machine Learning · Statistics 2023-07-31 Congwen Lu , Joel A. Paulson