English
Related papers

Related papers: CEopt: A MATLAB Package for Non-convex Optimizatio…

200 papers

The cross-entropy method is a simple but efficient method for global optimization. In this paper we provide two online variants of the basic CEM, together with a proof of convergence.

Machine Learning · Computer Science 2008-01-15 Istvan Szita , Andras Lorincz

PENLAB is an open source software package for nonlinear optimization, linear and nonlinear semidefinite optimization and any combination of these. It is written entirely in MATLAB. PENLAB is a young brother of our code PENNON \cite{pennon}…

Optimization and Control · Mathematics 2013-11-22 Jan Fiala , Michal Kočvara , Michael Stingl

Bayesian optimization is a sample-efficient method for black-box global optimization. How- ever, the performance of a Bayesian optimization method very much depends on its exploration strategy, i.e. the choice of acquisition function, and…

Machine Learning · Statistics 2015-03-06 Bobak Shahriari , Ziyu Wang , Matthew W. Hoffman , Alexandre Bouchard-Côté , Nando de Freitas

A class of smoothing methods is proposed for solving mathematical programs with equimibrium constraints. We introduce new and very simple regularizations of the complementarity constraints. Some estimate distance to optimal solution and…

Optimization and Control · Mathematics 2010-01-14 Mounir Haddou

Nonconvex optimization refers to the process of solving problems whose objective or constraints are nonconvex. Historically, this type of problems have been very difficult to solve to global optimality, with traditional solvers often…

Optimization and Control · Mathematics 2025-08-12 Dimitris Bertsimas , Danique de Moor , Thodoris Koukouvinos , Demetrios Kriezis

In this paper, a new framework for continuous-time maximum a posteriori estimation based on the Chebyshev polynomial optimization (ChevOpt) is proposed, which transforms the nonlinear continuous-time state estimation into a problem of…

Robotics · Computer Science 2022-07-13 Maoran Zhu , Yuanxin Wu

It is well-known that accelerated gradient first-order methods possess optimal complexity estimates for the class of convex smooth minimization problems. In many practical situations it makes sense to work with inexact gradient information.…

Optimization and Control · Mathematics 2021-08-16 Ilya Kuruzov , Fedor Stonyakin

We propose an algorithm for generating explicit solutions of multiparametric mixed-integer convex programs to within a given suboptimality tolerance. The algorithm is applicable to a very general class of optimization problems, but is most…

Optimization and Control · Mathematics 2019-06-12 Danylo Malyuta , Behcet Acikmese

Chance constrained programming (CCP) is a powerful framework for addressing optimization problems under uncertainty. In this paper, we introduce a novel Gradient-Guided Diffusion-based Optimization framework, termed GGDOpt, which tackles…

Optimization and Control · Mathematics 2025-10-15 Boyang Zhang , Zhiguo Wang , Ya-Feng Liu

The Improved Cross-Entropy (ICE) method is a powerful tool for estimating failure probabilities in reliability analysis. Its core idea is to approximate the optimal importance-sampling density by minimizing the forward Kullback-Leibler…

Numerical Analysis · Mathematics 2025-09-10 Zhiwei Gao , George Karniadakis

In this workshop, we discuss several algorithms for mathematical programs with equilibrium constraints (MPECs). The unifying theme is that MPECs are optimization problems whose feasible set contains a lower-level equilibrium system, often…

Optimization and Control · Mathematics 2026-04-20 Jiguang Yu

We present a new solver for non-convex trajectory optimization problems that is specialized for robotics applications. CALIPSO, or the Conic Augmented Lagrangian Interior-Point SOlver, combines several strategies for constrained numerical…

Robotics · Computer Science 2023-01-12 Taylor A. Howell , Simon Le Cleac'h , Kevin Tracy , Zachary Manchester

We consider the chance-constrained binary knapsack problem (CKP), where the item weights are independent and normally distributed. We introduce a continuous relaxation for the CKP, represented as a non-convex optimization problem, which we…

Optimization and Control · Mathematics 2024-03-12 Junyoung Kim , Kyungsik Lee

The cross-entropy method (CE) developed by R. Rubinstein is an elegant practical principle for simulating rare events. The method approximates the probability of the rare event by means of a family of probabilistic models. The method has…

Optimization and Control · Mathematics 2007-06-13 Frederic Dambreville

This paper studies the equitable and optimal transport (EOT) problem, which has many applications such as fair division problems and optimal transport with multiple agents etc. In the discrete distributions case, the EOT problem can be…

Optimization and Control · Mathematics 2021-10-04 Minhui Huang , Shiqian Ma , Lifeng Lai

Optimizing an experimental system can be extremely challenging when each experiment is expensive, time-consuming, or difficult to perform. Existing optimizers for expensive black-box problems, such as Bayesian optimization, are typically…

Conformal prediction (CP) provides a comprehensive framework to produce statistically rigorous uncertainty sets for black-box machine learning models. To further improve the efficiency of CP, conformal correction is proposed to fine-tune or…

Machine Learning · Computer Science 2025-12-03 Senrong Xu , Tianyu Wang , Zenan Li , Yuan Yao , Taolue Chen , Feng Xu , Xiaoxing Ma

PYROBOCOP is a lightweight Python-based package for control and optimization of robotic systems described by nonlinear Differential Algebraic Equations (DAEs). In particular, the package can handle systems with contacts that are described…

Robotics · Computer Science 2021-06-08 Arvind U. Raghunathan , Devesh K. Jha , Diego Romeres

Sparsity-constrained optimization underlies many problems in signal processing, statistics, and machine learning. State-of-the-art hard-thresholding (HT) algorithms rely on an appropriately selected continuous step-size parameter to ensure…

Machine Learning · Statistics 2026-05-13 Jin Zhu , Junxian Zhu , Zezhi Wang , Borui Tang , Hongmei Lin , Xueqin Wang

We introduce BayeSQP, a novel algorithm for general black-box optimization that merges the structure of sequential quadratic programming with concepts from Bayesian optimization. BayeSQP employs second-order Gaussian process surrogates for…

Machine Learning · Computer Science 2026-02-04 Paul Brunzema , Sebastian Trimpe