English
Related papers

Related papers: Learning Objective Boundaries for Constraint Optim…

200 papers

We present a general method for obtaining strong bounds for discrete optimization problems that is based on a concept of branching duality. It can be applied when no useful integer programming model is available, and we illustrate this with…

Data Structures and Algorithms · Computer Science 2019-08-22 J. G. Benade , J. N. Hooker

The global optimization of classification trees has demonstrated considerable promise, notably in enhancing accuracy, optimizing size, and thereby improving human comprehensibility. While existing optimal classification trees substantially…

Machine Learning · Computer Science 2024-02-01 Jiancheng Tu , Wenqi Fan , Zhibin Wu

When it comes to expensive black-box optimization problems, Bayesian Optimization (BO) is a well-known and powerful solution. Many real-world applications involve a large number of dimensions, hence scaling BO to high dimension is of much…

Machine Learning · Statistics 2024-12-18 Lam Ngo , Huong Ha , Jeffrey Chan , Hongyu Zhang

Bayesian optimization (BO) is a widely-used method for optimizing expensive (to evaluate) problems. At the core of most BO methods is the modeling of the objective function using a Gaussian Process (GP) whose covariance is selected from a…

Solving tasks in Reinforcement Learning is no easy feat. As the goal of the agent is to maximize the accumulated reward, it often learns to exploit loopholes and misspecifications in the reward signal resulting in unwanted behavior. While…

Machine Learning · Computer Science 2018-12-27 Chen Tessler , Daniel J. Mankowitz , Shie Mannor

Policy Optimization (PO) is a widely used approach to address continuous control tasks. In this paper, we introduce the notion of mediator feedback that frames PO as an online learning problem over the policy space. The additional available…

Machine Learning · Computer Science 2020-12-16 Alberto Maria Metelli , Matteo Papini , Pierluca D'Oro , Marcello Restelli

While Bayesian Optimization (BO) is a very popular method for optimizing expensive black-box functions, it fails to leverage the experience of domain experts. This causes BO to waste function evaluations on bad design choices (e.g., machine…

Machine Learning · Computer Science 2021-04-20 Artur Souza , Luigi Nardi , Leonardo B. Oliveira , Kunle Olukotun , Marius Lindauer , Frank Hutter

The Binary Polynomial Optimization (BPO) problem is defined as the problem of maximizing a given polynomial function over all binary points. The main contribution of this paper is to draw a novel connection between BPO and the field of…

Optimization and Control · Mathematics 2024-11-13 Florent Capelli , Alberto Del Pia , Silvia Di Gregorio

Bayesian optimization (BO) is a typical approach to solve expensive optimization problems. In each iteration of BO, a Gaussian process(GP) model is trained using the previously evaluated solutions; then next candidate solutions for…

Neural and Evolutionary Computing · Computer Science 2022-06-23 Jixiang Chen , Fu Luo , Zhenkun Wang

Bayesian optimization is a powerful optimization tool for problems where native first-order derivatives are unavailable. Recently, constrained Bayesian optimization (CBO) has been applied to many engineering applications where constraints…

Optimization and Control · Mathematics 2024-03-21 J. Wang , C. G. Petra , J. L. Peterson

Evaluating query predicates on data samples is the only way to estimate their selectivity in certain scenarios. Finding a guaranteed optimal query plan is not a reasonable optimization goal in those cases as it might require an infinite…

Databases · Computer Science 2015-11-06 Immanuel Trummer , Christoph Koch

Machine unlearning (MU) aims to remove the influence of specific data from a trained model. However, approximate unlearning methods, often formulated as a single-objective optimization (SOO) problem, face a critical trade-off between…

Machine Learning · Computer Science 2025-10-23 Youngsik Hwang , Dong-Young Lim

We propose a novel constrained Bayesian Optimization (BO) algorithm optimizing the design process of Laterally-Diffused Metal-Oxide-Semiconductor (LDMOS) transistors while realizing a target Breakdown Voltage (BV). We convert the…

Machine Learning · Computer Science 2023-08-21 Ping-Ju Chuang , Ali Saadat , Sara Ghazvini , Hal Edwards , William G. Vandenberghe

An algorithm is proposed, analyzed, and tested for solving continuous nonlinear-equality-constrained optimization problems where the objective and constraint functions are defined by expectations or averages over large, finite numbers of…

Optimization and Control · Mathematics 2026-05-14 Frank E. Curtis , Lingjun Guo , Daniel P. Robinson

Bayesian optimization is normally performed within fixed variable bounds. In cases like hyperparameter tuning for machine learning algorithms, setting the variable bounds is not trivial. It is hard to guarantee that any fixed bounds will…

Optimization and Control · Mathematics 2020-01-15 Wei Chen , Mark Fuge

Numerous multi-objective evolutionary algorithms have been designed for constrained optimisation over past two decades. The idea behind these algorithms is to transform constrained optimisation problems into multi-objective optimisation…

Optimization and Control · Mathematics 2020-03-24 Tao Xu , Jun He , Changjing Shang

The paper is about developing a solver for maximizing a real-valued function of binary variables. The solver relies on an algorithm that estimates the optimal objective-function value of instances from the underlying distribution of…

Machine Learning · Computer Science 2025-11-05 Nimrod Megiddo , Segev Wasserkrug , Orit Davidovich , Shimrit Shtern

Predict+Optimize is a recently proposed framework which combines machine learning and constrained optimization, tackling optimization problems that contain parameters that are unknown at solving time. The goal is to predict the unknown…

Artificial Intelligence · Computer Science 2022-09-09 Xinyi Hu , Jasper C. H. Lee , Jimmy H. M. Lee

Solving constrained multi-objective optimization problems (CMOPs) is a challenging task. While many practical algorithms have been developed to tackle CMOPs, real-world scenarios often present cases where the constraint functions are…

Neural and Evolutionary Computing · Computer Science 2025-09-25 Weixiong Huang , Rui Wang , Tao Zhang , Sheng Qi , Ling Wang

Efficient motion planning algorithms are of central importance for deploying robots in the real world. Unfortunately, these algorithms often drastically reduce the dimensionality of the problem for the sake of feasibility, thereby foregoing…

Robotics · Computer Science 2022-12-02 Alex Beaudin , Hsiu-Chin Lin