English
Related papers

Related papers: Hierarchically constrained blackbox optimization

200 papers

The diverse world of machine learning applications has given rise to a plethora of algorithms and optimization methods, finely tuned to the specific regression or classification task at hand. We reduce the complexity of algorithm design for…

Optimization and Control · Mathematics 2016-05-23 Zeyuan Allen-Zhu , Elad Hazan

In real-time systems optimization, designers often face a challenging problem posed by the non-convex and non-continuous schedulability conditions, which may even lack an analytical form to understand their properties. To tackle this…

Systems and Control · Electrical Eng. & Systems 2025-03-20 Sen Wang , Dong Li , Shao-Yu Huang , Xuanliang Deng , Ashrarul H. Sifat , Changhee Jung , Ryan Williams , Haibo Zeng

Optimization of complex functions, such as the output of computer simulators, is a difficult task that has received much attention in the literature. A less studied problem is that of optimization under unknown constraints, i.e., when the…

Methodology · Statistics 2010-07-06 Robert B. Gramacy , Herbert K. H. Lee

One way to reduce the time of conducting optimization studies is to evaluate designs in parallel rather than just one-at-a-time. For expensive-to-evaluate black-boxes, batch versions of Bayesian optimization have been proposed. They work by…

Optimization and Control · Mathematics 2023-04-04 Mickael Binois , Nicholson Collier , Jonathan Ozik

The use of blackbox solvers inside neural networks is a relatively new area which aims to improve neural network performance by including proven, efficient solvers for complex problems. Existing work has created methods for learning…

Machine Learning · Computer Science 2020-06-09 T. J. Wilder

This study proposes a new constraint handling technique for assisting metaheuristic optimization algorithms to solve constrained optimization problems more effectively and efficiently. Given any two solutions of any constrained optimization…

Optimization and Control · Mathematics 2023-10-23 Ting Huang , Qiang Zhang , Witold Pedrycz , Shanlin Yang

Optimizing schedules in real-world settings often requires considering workload constraints, specially for human resources, to ensure regulatory compliance, impose rest periods, or level the workload over the working horizon. This paper…

Optimization and Control · Mathematics 2026-05-21 Tanguy Terrien , Cyrille Briand

Data-driven decision-making has drawn scrutiny from policy makers due to fears of potential discrimination, and a growing literature has begun to develop fair statistical techniques. However, these techniques are often specialized to one…

Statistics Theory · Mathematics 2021-01-01 Anil Aswani , Matt Olfat

In high-dimensional classification settings, we wish to seek a balance between high power and ensuring control over a desired loss function. In many settings, the points most likely to be misclassified are those who lie near the decision…

Machine Learning · Statistics 2017-06-06 Arun Srinivasan

An experimental comparison of two or more optimization algorithms requires the same computational resources to be assigned to each algorithm. When a maximum runtime is set as the stopping criterion, all algorithms need to be executed in the…

Performance · Computer Science 2024-02-09 Etor Arza , Josu Ceberio , Ekhiñe Irurozki , Aritz Pérez

We consider a class of optimization problems that involve determining the maximum value that a function in a particular class can attain subject to a collection of difference constraints. We show that a particular linear programming…

Data Structures and Algorithms · Computer Science 2022-11-16 Sungjin Im , Benjamin Moseley , Hung Q. Ngo , Kirk Pruhs , Alireza Samadian

This work proposes the integration of two new constraint-handling approaches into the blackbox constrained multiobjective optimization algorithm DMulti-MADS, an extension of the Mesh Adaptive Direct Search (MADS) algorithm for…

Optimization and Control · Mathematics 2022-04-05 Jean Bigeon , Sébastien Le Digabel , Ludovic Salomon

Feature-based offline algorithm selection has shown its effectiveness in a wide range of optimization problems, including the black-box optimization problem. An algorithm selection system selects the most promising optimizer from an…

Machine Learning · Computer Science 2024-05-21 Takushi Yoshikawa , Ryoji Tanabe

The aim of black-box optimization is to optimize an objective function within the constraints of a given evaluation budget. In this problem, it is generally assumed that the computational cost for evaluating a point is large; thus, it is…

Machine Learning · Statistics 2019-12-03 Masahiro Nomura , Kenshi Abe

Interpretable Machine Learning faces a recurring challenge of explaining the predictions made by opaque classifiers such as ensemble models, kernel methods, or neural networks in terms that are understandable to humans. When the model is…

Machine Learning · Computer Science 2024-11-14 Frederic Koriche , Jean-Marie Lagniez , Stefan Mengel , Chi Tran

In this paper we study a single machine scheduling problem with the objective of minimizing the sum of completion times. Each of the given jobs is either short or long. However the processing times are initially hidden to the algorithm, but…

Data Structures and Algorithms · Computer Science 2021-05-06 Fanny Dufossé , Christoph Dürr , Noël Nadal , Denis Trystram , Óscar C. Vásquez

Convex optimization problems arising in applications often have favorable objective functions and complicated constraints, thereby precluding first-order methods from being immediately applicable. We describe an approach that exchanges the…

Optimization and Control · Mathematics 2016-02-05 Aleksandr Y. Aravkin , James V. Burke , Dmitriy Drusvyatskiy , Michael P. Friedlander , Scott Roy

Many real-life optimization problems frequently contain one or more constraints or objectives for which there are no explicit formulas. If data is however available, these data can be used to learn the constraints. The benefits of this…

Machine Learning · Computer Science 2022-09-23 Adejuyigbe Fajemisin , Donato Maragno , Dick den Hertog

Multiobjective optimization problems with heterogeneous objectives are defined as those that possess significantly different types of objective function components (not just incommensurable in units or scale). For example, in a…

Neural and Evolutionary Computing · Computer Science 2021-03-30 Richard Allmendinger , Joshua Knowles

Evolutionary algorithms have been frequently applied to constrained continuous optimisation problems. We carry out feature based comparisons of different types of evolutionary algorithms such as evolution strategies, differential evolution…

Artificial Intelligence · Computer Science 2015-09-24 Shayan Poursoltan , Frank Neumann