English
Related papers

Related papers: On the Influence of the Feature Computation Budget…

200 papers

Software model optimization is the task of automatically generate design alternatives, usually to improve quality aspects of software that are quantifiable, like performance and reliability. In this context, multi-objective optimization…

Software Engineering · Computer Science 2024-01-31 Daniele Di Pompeo , Michele Tucci

Evaluating query predicates on data samples is the only way to estimate their selectivity in certain scenarios. Finding a guaranteed optimal query plan is not a reasonable optimization goal in those cases as it might require an infinite…

Databases · Computer Science 2015-11-06 Immanuel Trummer , Christoph Koch

This paper studies the fixed budget formulation of the Ranking and Selection (R&S) problem with independent normal samples, where the goal is to investigate different algorithms' convergence rate in terms of their resulting probability of…

Optimization and Control · Mathematics 2018-11-30 Di Wu , Enlu Zhou

One way to reduce the time of conducting optimization studies is to evaluate designs in parallel rather than just one-at-a-time. For expensive-to-evaluate black-boxes, batch versions of Bayesian optimization have been proposed. They work by…

Optimization and Control · Mathematics 2023-04-04 Mickael Binois , Nicholson Collier , Jonathan Ozik

Motivated by a plethora of practical examples where bias is induced by automated-decision making algorithms, there has been strong recent interest in the design of fair algorithms. However, there is often a dichotomy between fairness and…

Artificial Intelligence · Computer Science 2023-07-13 April Niu , Agnes Totschnig , Adrian Vetta

The optimization of expensive-to-evaluate black-box functions over combinatorial structures is an ubiquitous task in machine learning, engineering and the natural sciences. The combinatorial explosion of the search space and costly…

Machine Learning · Statistics 2018-10-11 Ricardo Baptista , Matthias Poloczek

We present a fully probabilistic approach for solving binary optimization problems with black-box objective functions and with budget constraints. In the probabilistic approach, the optimization variable is viewed as a random variable and…

Optimization and Control · Mathematics 2024-06-11 Ahmed Attia

This work addresses data-driven inverse optimization (IO), where the goal is to estimate unknown parameters in an optimization model from observed decisions that can be assumed to be optimal or near-optimal solutions to the optimization…

Optimization and Control · Mathematics 2024-05-29 Yen-An Lu , Wei-Shou Hu , Joel A. Paulson , Qi Zhang

A body of work has been done to automate machine learning algorithm to highlight the importance of model choice. Automating the process of choosing the best forecasting model and its corresponding parameters can result to improve a wide…

Machine Learning · Computer Science 2021-09-02 Nadhir Hassen , Irina Rish

Bayesian Optimization is the state of the art technique for the optimization of black boxes, i.e., functions where we do not have access to their analytical expression nor its gradients, they are expensive to evaluate and its evaluation is…

Artificial Intelligence · Computer Science 2021-01-13 Eduardo C. Garrido Merchán , Luis C. Jariego Pérez

Per-instance algorithm selection seeks to recommend, for a given problem instance and a given performance criterion, one or several suitable algorithms that are expected to perform well for the particular setting. The selection is…

Neural and Evolutionary Computing · Computer Science 2022-09-08 Ana Kostovska , Anja Jankovic , Diederick Vermetten , Jacob de Nobel , Hao Wang , Tome Eftimov , Carola Doerr

Bayesian optimization (BO) is a class of global optimization algorithms, suitable for minimizing an expensive objective function in as few function evaluations as possible. While BO budgets are typically given in iterations, this implicitly…

Machine Learning · Computer Science 2020-03-25 Eric Hans Lee , Valerio Perrone , Cedric Archambeau , Matthias Seeger

This paper presents the results and insights from the black-box optimization (BBO) challenge at NeurIPS 2020 which ran from July-October, 2020. The challenge emphasized the importance of evaluating derivative-free optimizers for tuning the…

Machine Learning · Computer Science 2021-09-01 Ryan Turner , David Eriksson , Michael McCourt , Juha Kiili , Eero Laaksonen , Zhen Xu , Isabelle Guyon

Performance complementarity of solvers available to tackle black-box optimization problems gives rise to the important task of algorithm selection (AS). Automated AS approaches can help replace tedious and labor-intensive manual selection,…

Neural and Evolutionary Computing · Computer Science 2023-07-03 Ana Kostovska , Anja Jankovic , Diederick Vermetten , Sašo Džeroski , Tome Eftimov , Carola Doerr

Despite all the benefits of automated hyperparameter optimization (HPO), most modern HPO algorithms are black-boxes themselves. This makes it difficult to understand the decision process which leads to the selected configuration, reduces…

Machine Learning · Computer Science 2023-02-14 Julia Moosbauer , Giuseppe Casalicchio , Marius Lindauer , Bernd Bischl

Bayesian optimization is a technique for efficiently optimizing unknown functions in a black-box manner. To handle practical settings where gathering data requires use of finite resources, it is desirable to explicitly incorporate function…

Machine Learning · Computer Science 2025-01-17 Qian Xie , Raul Astudillo , Peter I. Frazier , Ziv Scully , Alexander Terenin

Black-box optimization is often encountered for decision-making in complex systems management, where the knowledge of system is limited. Under these circumstances, it is essential to balance the utilization of new information with…

Computation · Statistics 2025-01-15 Teng Lian , Jian-Qiang Hu , Yuhang Wu , Zeyu Zheng

Data selection improves computational efficiency by choosing informative subsets of training samples. However, existing methods ignore the compute budget, treating data selection and importance evaluation independently of compute budget…

Machine Learning · Computer Science 2025-11-04 Weilin Wan , Weizhong Zhang , Cheng Jin

Colleges and universities are increasingly turning to algorithms that predict college-student success to inform various decisions, including those related to admissions, budgeting, and student-success interventions. Because predictive…

Computers and Society · Computer Science 2024-07-12 Denisa Gándara , Hadis Anahideh , Matthew P. Ison , Lorenzo Picchiarini

Benchmarking is a key aspect of research into optimization algorithms, and as such the way in which the most popular benchmark suites are designed implicitly guides some parts of algorithm design. One of these suites is the black-box…

Neural and Evolutionary Computing · Computer Science 2022-11-30 Fu Xing Long , Diederick Vermetten , Bas van Stein , Anna V. Kononova