English
Related papers

Related papers: Evolution of Benchmark: Black-Box Optimization Ben…

200 papers

Black-box optimization often relies on evolutionary and swarm algorithms whose performance is highly problem dependent. We view an optimizer as a short program over a small vocabulary of search operators and learn this operator program…

Neural and Evolutionary Computing · Computer Science 2025-12-16 Junbo Jacob Lian , Mingyang Yu , Kaichen Ouyang , Shengwei Fu , Rui Zhong , Yujun Zhang , Jun Zhang , Huiling Chen

In this paper, we present the Fast Optimizer Benchmark (FOB), a tool designed for evaluating deep learning optimizers during their development. The benchmark supports tasks from multiple domains such as computer vision, natural language…

Machine Learning · Computer Science 2024-06-28 Simon Blauth , Tobias Bürger , Zacharias Häringer , Jörg Franke , Frank Hutter

The evaluation of heuristic optimizers on test problems, better known as \emph{benchmarking}, is a cornerstone of research in multi-objective optimization. However, most test problems used in benchmarking numerical multi-objective black-box…

Optimization and Control · Mathematics 2026-01-26 Lennart Schäpermeier , Pascal Kerschke

In current benchmarks for evaluating large language models (LLMs), there are issues such as evaluation content restriction, untimely updates, and lack of optimization guidance. In this paper, we propose a new paradigm for the measurement of…

Computation and Language · Computer Science 2024-07-11 Jin Liu , Qingquan Li , Wenlong Du

Large Language Models (LLMs) possess substantial reasoning capabilities and are increasingly applied to optimization tasks, particularly in synergy with evolutionary computation. However, while recent surveys have explored specific aspects…

Neural and Evolutionary Computing · Computer Science 2026-01-08 Yisong Zhang , Ran Cheng , Guoxing Yi , Kay Chen Tan

Optimizing black-box functions is a fundamental problem in science and engineering. To solve this problem, many approaches learn a surrogate function that estimates the underlying objective from limited historical evaluations. Large…

Machine Learning · Computer Science 2025-10-23 Tung Nguyen , Aditya Grover

Evolutionary multi-objective optimization (EMO) algorithms have been demonstrated to be effective in solving multi-criteria decision-making problems. In real-world applications, analysts often employ several algorithms concurrently and…

Neural and Evolutionary Computing · Computer Science 2024-08-09 Yansong Huang , Zherui Zhang , Ao Jiao , Yuxin Ma , Ran Cheng

Benchmarking involves designing, running and disseminating rigorous performance assessments of methods, most often for data analysis and software tools, but the process can also be applied to experimental systems. Ideally, a benchmarking…

Other Quantitative Biology · Quantitative Biology 2026-02-12 Izaskun Mallona , Almut Luetge , Ben Carrillo , Daniel Incicau , Reto Gerber , Aidan Meara , Anthony Sonrel , Charlotte Soneson , Mark D. Robinson

The use of black-box optimization for the design of new biological sequences is an emerging research area with potentially revolutionary impact. The cost and latency of wet-lab experiments requires methods that find good sequences in few…

Machine Learning · Computer Science 2020-07-14 Christof Angermueller , David Belanger , Andreea Gane , Zelda Mariet , David Dohan , Kevin Murphy , Lucy Colwell , D Sculley

Offline optimization aims to maximize a black-box objective function with a static dataset and has wide applications. In addition to the objective function being black-box and expensive to evaluate, numerous complex real-world problems…

Machine Learning · Computer Science 2024-06-07 Ke Xue , Rong-Xi Tan , Xiaobin Huang , Chao Qian

Bayesian Optimization (BO) is a popular approach to optimizing expensive-to-evaluate black-box functions. Despite the success of BO, its performance may decrease exponentially as the dimensionality increases. A common framework to tackle…

Machine Learning · Computer Science 2024-12-24 Quoc-Anh Hoang Nguyen , The Hung Tran

Large language models (LLMs) are gaining increasing popularity in software engineering (SE) due to their unprecedented performance across various applications. These models are increasingly being utilized for a range of SE tasks, including…

Software Engineering · Computer Science 2025-11-05 Xing Hu , Feifei Niu , Junkai Chen , Xin Zhou , Junwei Zhang , Junda He , Xin Xia , David Lo

Recently, Meta-Black-Box Optimization with Reinforcement Learning (MetaBBO-RL) has showcased the power of leveraging RL at the meta-level to mitigate manual fine-tuning of low-level black-box optimizers. However, this field is hindered by…

Machine Learning · Computer Science 2023-10-30 Zeyuan Ma , Hongshu Guo , Jiacheng Chen , Zhenrui Li , Guojun Peng , Yue-Jiao Gong , Yining Ma , Zhiguang Cao

For a wide range of applications the structure of systems like Neural Networks or complex simulations, is unknown and approximation is costly or even impossible. Black-box optimization seeks to find optimal (hyper-) parameters for these…

Machine Learning · Computer Science 2023-09-06 Janina Schreiber , Damar Wicaksono , Michael Hecht

In the evolutionary computing community, the remarkable language-handling capabilities and reasoning power of large language models (LLMs) have significantly enhanced the functionality of evolutionary algorithms (EAs), enabling them to…

Neural and Evolutionary Computing · Computer Science 2025-09-25 Jiao Liu , Zhu Sun , Shanshan Feng , Caishun Chen , Yew-Soon Ong

Large language models (LLMs) have greatly accelerated the automation of algorithm generation and optimization. However, current methods such as EoH and FunSearch mainly rely on predefined templates and expert-specified functions that focus…

Software Engineering · Computer Science 2025-03-17 Zhe Zhao , Haibin Wen , Pengkun Wang , Ye Wei , Zaixi Zhang , Xi Lin , Fei Liu , Bo An , Hui Xiong , Yang Wang , Qingfu Zhang

Many platforms for benchmarking optimization algorithms offer users the possibility of sharing their experimental data with the purpose of promoting reproducible and reusable research. However, different platforms use different data models…

Neural and Evolutionary Computing · Computer Science 2021-04-27 Ana Kostovska , Diederick Vermetten , Carola Doerr , Sašo Džeroski , Panče Panov , Tome Eftimov

Many challenges in science and engineering, such as drug discovery and communication network design, involve optimizing complex and expensive black-box functions across vast search spaces. Thus, it is essential to leverage existing data to…

Machine Learning · Computer Science 2024-12-04 Juncheng Dong , Zihao Wu , Hamid Jafarkhani , Ali Pezeshki , Vahid Tarokh

Recent Meta-learning for Black-Box Optimization (MetaBBO) methods harness neural networks to meta-learn configurations of traditional black-box optimizers. Despite their success, they are inevitably restricted by the limitations of…

Machine Learning · Computer Science 2024-02-08 Jiacheng Chen , Zeyuan Ma , Hongshu Guo , Yining Ma , Jie Zhang , Yue-Jiao Gong

Large Language Models (LLMs) are rapidly transforming various fields, and their potential in Business Process Management (BPM) is substantial. This paper assesses the capabilities of LLMs on business process modeling using a framework for…

Databases · Computer Science 2024-12-03 Humam Kourani , Alessandro Berti , Daniel Schuster , Wil M. P. van der Aalst