中文
相关论文

相关论文: Unbiased Black-Box Complexities of Jump Functions

200 篇论文

Many expensive black-box optimisation problems are sensitive to their inputs. In these problems it makes more sense to locate a region of good designs, than a single-possibly fragile-optimal design. Expensive black-box functions can be…

机器学习 · 计算机科学 2021-12-16 Nicholas D. Sanders , Richard M. Everson , Jonathan E. Fieldsend , Alma A. M. Rahat

We study the problem of black-box optimization of a noisy function in the presence of low-cost approximations or fidelities, which is motivated by problems like hyper-parameter tuning. In hyper-parameter tuning evaluating the black-box…

机器学习 · 统计学 2018-10-25 Rajat Sen , Kirthevasan Kandasamy , Sanjay Shakkottai

Black-box complexity theory provides lower bounds for the runtime of black-box optimizers like evolutionary algorithms and serves as an inspiration for the design of new genetic algorithms. Several black-box models covering different…

神经与进化计算 · 计算机科学 2015-08-28 Carola Doerr , Johannes Lengler

Impactful applications such as materials discovery, hardware design, neural architecture search, or portfolio optimization require optimizing high-dimensional black-box functions with mixed and combinatorial input spaces. While Bayesian…

机器学习 · 计算机科学 2024-03-21 Leonard Papenmeier , Luigi Nardi , Matthias Poloczek

We study a constrained stochastic control problem with jumps; the jump times of the controlled process are given by a Poisson process. The cost functional comprises quadratic components for an absolutely continuous control and the…

最优化与控制 · 数学 2013-04-29 Peter Kratz

We prove that the compact genetic algorithm (cGA) with hypothetical population size $\mu = \Omega(\sqrt n \log n) \cap \text{poly}(n)$ with high probability finds the optimum of any $n$-dimensional jump function with jump size $k < \frac 1…

神经与进化计算 · 计算机科学 2019-03-27 Benjamin Doerr

We consider Bayesian optimization of an expensive-to-evaluate black-box objective function, where we also have access to cheaper approximations of the objective. In general, such approximations arise in applications such as reinforcement…

机器学习 · 统计学 2016-11-16 Matthias Poloczek , Jialei Wang , Peter I. Frazier

Black-box functions are broadly used to model complex problems that provide no explicit information but the input and output. Despite existing studies of black-box function optimization, the solution set satisfying an inequality with a…

机器学习 · 计算机科学 2022-03-28 Lihao Liu , Tianyue Feng , Xingyu Xing , Junyi Chen

We consider the problem of detecting jumps in an otherwise smoothly evolving trend whilst the covariance and higher-order structures of the system can experience both smooth and abrupt changes over time. The number of jump points is allowed…

统计方法学 · 统计学 2023-12-27 Weichi Wu , Zhou Zhou

It may seem very intuitive that for the maximization of the OneMax problem $\OM(x):=\sum_{i=1}^n{x_i}$ the best that an elitist unary unbiased search algorithm can do is to store a best so far solution, and to modify it with the operator…

神经与进化计算 · 计算机科学 2021-01-18 Nathan Buskulic , Carola Doerr

This paper is devoted to the study (common in many applications) of the black-box optimization problem, where the black-box represents a gradient-free oracle $\tilde{f} = f(x) + \xi$ providing the objective function value with some…

最优化与控制 · 数学 2024-07-08 Aleksandr Lobanov

Bayesian optimization provides an effective method to optimize expensive-to-evaluate black box functions. It has been widely applied to problems in many fields, including notably in computer science, e.g. in machine learning to optimize…

机器学习 · 计算机科学 2025-11-18 Mike Diessner , Joseph O'Connor , Andrew Wynn , Sylvain Laizet , Yu Guan , Kevin Wilson , Richard D. Whalley

A predominant topic in the theory of evolutionary algorithms and, more generally, theory of randomized black-box optimization techniques is running time analysis. Running time analysis aims at understanding the performance of a given…

神经与进化计算 · 计算机科学 2018-06-13 Carola Doerr

We extend the work of Lehre and Witt (GECCO 2010) on the unbiased black-box model by considering higher arity variation operators. In particular, we show that already for binary operators the black-box complexity of \leadingones drops from…

神经与进化计算 · 计算机科学 2010-12-07 Benjamin Doerr , Daniel Johannsen , Timo Kötzing , Per Kristian Lehre , Markus Wagner , Carola Winzen

Feature-based algorithm selection aims to automatically find the best one from a portfolio of optimization algorithms on an unseen problem based on its landscape features. Feature-based algorithm selection has recently received attention in…

神经与进化计算 · 计算机科学 2022-04-27 Ryoji Tanabe

In real-world applications, users often favor structurally diverse design choices over one high-quality solution. It is hence important to consider more solutions that decision makers can compare and further explore based on additional…

机器学习 · 计算机科学 2025-04-02 Maria Laura Santoni , Elena Raponi , Aneta Neumann , Frank Neumann , Mike Preuss , Carola Doerr

Recent works showed that simple success-based rules for self-adjusting parameters in evolutionary algorithms (EAs) can match or outperform the best fixed parameters on discrete problems. Non-elitism in a (1,$\lambda$) EA combined with a…

神经与进化计算 · 计算机科学 2022-04-13 Mario Alejandro Hevia Fajardo , Dirk Sudholt

Motivated by the problem of tuning hyperparameters in machine learning, we present a new approach for gradually and adaptively optimizing an unknown function using estimated gradients. We validate the empirical performance of the proposed…

机器学习 · 计算机科学 2019-06-05 Weijia Shao , Christian Geißler , Fikret Sivrikaya

The selection of the most appropriate algorithm to solve a given problem instance, known as algorithm selection, is driven by the potential to capitalize on the complementary performance of different algorithms across sets of problem…

机器学习 · 计算机科学 2024-06-12 Gjorgjina Cenikj , Ana Nikolikj , Gašper Petelin , Niki van Stein , Carola Doerr , Tome Eftimov

This paper presents an optimal motion planning framework to generate versatile energy-optimal quadrupedal jumping motions automatically (e.g., flips, spin). The jumping motions via the centroidal dynamics are formulated as a 12-dimensional…

机器人学 · 计算机科学 2022-07-26 Zhitao Song , Linzhu Yue , Guangli Sun , Yihu Ling , Hongshuo Wei , Linhai Gui , Yun-Hui Liu