English
Related papers

Related papers: MetaBox-v2: A Unified Benchmark Platform for Meta-…

200 papers

The selection of the most appropriate algorithm to solve a given problem instance, known as algorithm selection, is driven by the potential to capitalize on the complementary performance of different algorithms across sets of problem…

Machine Learning · Computer Science 2024-06-12 Gjorgjina Cenikj , Ana Nikolikj , Gašper Petelin , Niki van Stein , Carola Doerr , Tome Eftimov

The pursuit of universal black-box optimization (BBO) algorithms is a longstanding goal. However, unlike domains such as language or vision, where scaling structured data has driven generalization, progress in offline BBO remains hindered…

Machine Learning · Computer Science 2025-06-10 Rong-Xi Tan , Ming Chen , Ke Xue , Yao Wang , Yaoyuan Wang , Sheng Fu , Chao Qian

To relieve intensive human-expertise required to design optimization algorithms, recent Meta-Black-Box Optimization (MetaBBO) researches leverage generalization strength of meta-learning to train neural network-based algorithm design…

Machine Learning · Computer Science 2025-11-12 Chen Wang , Yue-Jiao Gong , Zhiguang Cao , Zeyuan Ma

The broader application of reinforcement learning (RL) is limited by challenges including data efficiency, generalization capability, and ability to learn in sparse-reward environments. Meta-learning has emerged as a promising approach to…

Machine Learning · Computer Science 2026-03-05 Octavio Pappalardo , Rodrigo Ramele , Juan Miguel Santos

Surrogate-Assisted Evolutionary Algorithms (SAEAs) are widely used for expensive Black-Box Optimization. However, their reliance on rigid, manually designed components such as infill criteria and evolutionary strategies during the search…

Neural and Evolutionary Computing · Computer Science 2025-11-20 Yukun Du , Haiyue Yu , Xiaotong Xie , Yan Zheng , Lixin Zhan , Yudong Du , Chongshuang Hu , Boxuan Wang , Jiang Jiang

Recent Meta-learning for Black-Box Optimization (MetaBBO) methods harness neural networks to meta-learn configurations of traditional black-box optimizers. Despite their success, they are inevitably restricted by the limitations of…

Machine Learning · Computer Science 2024-02-08 Jiacheng Chen , Zeyuan Ma , Hongshu Guo , Yining Ma , Jie Zhang , Yue-Jiao Gong

Black-box optimization (BBO) underpins advances in domains such as AutoML and Materials Informatics, yet implementations of algorithms and benchmarks remain fragmented across research communities. We introduce OptunaHub…

Machine Learning · Computer Science 2026-04-21 Yoshihiko Ozaki , Shuhei Watanabe , Toshihiko Yanase

Meta-learning is a powerful paradigm for tackling few-shot tasks. However, recent studies indicate that models trained with the whole-class training strategy can achieve comparable performance to those trained with meta-learning in few-shot…

Machine Learning · Computer Science 2025-09-17 Yunchuan Guan , Yu Liu , Ke Zhou , Zhiqi Shen , Jenq-Neng Hwang , Serge Belongie , Lei Li

This paper introduces a modular framework for Mixed-variable and Combinatorial Bayesian Optimization (MCBO) to address the lack of systematic benchmarking and standardized evaluation in the field. Current MCBO papers often introduce…

Machine Learning · Computer Science 2023-12-12 Kamil Dreczkowski , Antoine Grosnit , Haitham Bou Ammar

Meta-Bayesian optimisation (meta-BO) aims to improve the sample efficiency of Bayesian optimisation by leveraging data from related tasks. While previous methods successfully meta-learn either a surrogate model or an acquisition function…

Machine Learning · Computer Science 2023-12-25 Alexandre Maraval , Matthieu Zimmer , Antoine Grosnit , Haitham Bou Ammar

Bayesian optimization (BO) has for sequential optimization of expensive black-box functions demonstrated practicality and effectiveness in many real-world settings. Meta-Bayesian optimization (meta-BO) focuses on improving the sample…

This paper presents the results and insights from the black-box optimization (BBO) challenge at NeurIPS 2020 which ran from July-October, 2020. The challenge emphasized the importance of evaluating derivative-free optimizers for tuning the…

Machine Learning · Computer Science 2021-09-01 Ryan Turner , David Eriksson , Michael McCourt , Juha Kiili , Eero Laaksonen , Zhen Xu , Isabelle Guyon

Benchmark Design in Black-Box Optimization (BBO) is a fundamental yet open-ended topic. Early BBO benchmarks are predominantly human-crafted, introducing expert bias and constraining diversity. Automating this design process can relieve the…

Neural and Evolutionary Computing · Computer Science 2026-02-03 Chen Wang , Sijie Ma , Zeyuan Ma , Yue-Jiao Gong

Meta-black-box optimization has been significantly advanced through the use of large language models (LLMs), yet in fancy on constrained evolutionary optimization. In this work, AwesomeDE is proposed that leverages LLMs as the strategy of…

Neural and Evolutionary Computing · Computer Science 2026-03-11 Xu Yang , Rui Wang , Kaiwen Li , Wenhua Li , Weixiong Huang

Black-box optimization (BBO) has become increasingly relevant for tackling complex decision-making problems, especially in public policy domains such as police redistricting. However, its broader application in public policymaking is…

Machine Learning · Statistics 2025-01-23 Wenqian Xing , JungHo Lee , Chong Liu , Shixiang Zhu

Solving multimodal optimization problems (MMOP) requires finding all optimal solutions, which is challenging in limited function evaluations. Although existing works strike the balance of exploration and exploitation through hand-crafted…

Neural and Evolutionary Computing · Computer Science 2024-04-15 Hongqiao Lian , Zeyuan Ma , Hongshu Guo , Ting Huang , Yue-Jiao Gong

Black-box model-based optimization (MBO) problems, where the goal is to find a design input that maximizes an unknown objective function, are ubiquitous in a wide range of domains, such as the design of proteins, DNA sequences, aircraft,…

Machine Learning · Computer Science 2022-02-18 Brandon Trabucco , Xinyang Geng , Aviral Kumar , Sergey Levine

Data-efficient learning algorithms are essential in many practical applications for which data collection is expensive, e.g., for the optimal deployment of wireless systems in unknown propagation scenarios. Meta-learning can address this…

Machine Learning · Computer Science 2022-05-25 Ivana Nikoloska , Osvaldo Simeone

Meta-reinforcement learning algorithms can enable robots to acquire new skills much more quickly, by leveraging prior experience to learn how to learn. However, much of the current research on meta-reinforcement learning focuses on task…

Vision-Language-Action (VLA) models show promise in embodied reasoning, yet remain far from true generalists-they often require task-specific fine-tuning, incur high compute costs, and generalize poorly to unseen tasks. We propose MetaVLA,…

Artificial Intelligence · Computer Science 2026-01-29 Chen Li , Zhantao Yang , Han Zhang , Fangyi Chen , Chenchen Zhu , Anudeepsekhar Bolimera , Marios Savvides