English
Related papers

Related papers: OPAL: Operator-Programmed Algorithms for Landscape…

200 papers

In recent years, solving optimization problems involving black-box simulators has become a point of focus for the machine learning community due to their ubiquity in science and engineering. The simulators describe a forward process…

Machine Learning · Computer Science 2024-06-07 Fabio Valerio Massoli , Tim Bakker , Thomas Hehn , Tribhuvanesh Orekondy , Arash Behboodi

This work uses genetic programming to explore the design space of local optimisation algorithms. Optimisers are expressed in the Push programming language, a stack-based language with a wide range of typed primitive instructions. The…

Neural and Evolutionary Computing · Computer Science 2019-05-27 Michael Lones

An essential task of Automated Machine Learning (AutoML) is the problem of automatically finding the pipeline with the best generalization performance on a given dataset. This problem has been addressed with sophisticated black-box…

Machine Learning · Computer Science 2021-11-30 Felix Mohr , Marcel Wever

We consider offline policy optimization (OPO) in contextual bandits, where one is given a fixed dataset of logged interactions. While pessimistic regularizers are typically used to mitigate distribution shift, prior implementations thereof…

Machine Learning · Computer Science 2023-10-27 Lequn Wang , Akshay Krishnamurthy , Aleksandrs Slivkins

Occupancy prediction, aiming at predicting the occupancy status within voxelized 3D environment, is quickly gaining momentum within the autonomous driving community. Mainstream occupancy prediction works first discretize the 3D environment…

Computer Vision and Pattern Recognition · Computer Science 2024-11-01 Jiabao Wang , Zhaojiang Liu , Qiang Meng , Liujiang Yan , Ke Wang , Jie Yang , Wei Liu , Qibin Hou , Ming-Ming Cheng

On-policy reinforcement learning (RL) algorithms are widely used for their strong asymptotic performance and training stability, but they struggle to scale with larger batch sizes, as additional parallel environments yield redundant data…

Machine Learning · Computer Science 2025-11-13 Jianren Wang , Yifan Su , Abhinav Gupta , Deepak Pathak

Black-box optimizers that explore in parameter space have often been shown to outperform more sophisticated action space exploration methods developed specifically for the reinforcement learning problem. We examine these black-box methods…

Machine Learning · Computer Science 2019-02-01 Anirudh Vemula , Wen Sun , J. Andrew Bagnell

Black-box complexity theory provides lower bounds for the runtime of black-box optimizers like evolutionary algorithms and serves as an inspiration for the design of new genetic algorithms. Several black-box models covering different…

Neural and Evolutionary Computing · Computer Science 2015-08-28 Carola Doerr , Johannes Lengler

Black-box optimization refers to the optimization problem whose objective function and/or constraint sets are either unknown, inaccessible, or non-existent. In many applications, especially with the involvement of humans, the only way to…

Bayesian optimization (BO) is a successful methodology to optimize black-box functions that are expensive to evaluate. While traditional methods optimize each black-box function in isolation, there has been recent interest in speeding up BO…

Machine Learning · Statistics 2019-09-30 Valerio Perrone , Huibin Shen , Matthias Seeger , Cedric Archambeau , Rodolphe Jenatton

The evolution of programming languages from low-level assembly to high-level abstractions demonstrates a fundamental principle: by constraining how programmers express computation and enriching semantic information at the language level, we…

Programming Languages · Computer Science 2025-06-10 Jason Mars

With the demand for machine learning increasing, so does the demand for tools which make it easier to use. Automated machine learning (AutoML) tools have been developed to address this need, such as the Tree-Based Pipeline Optimization Tool…

Neural and Evolutionary Computing · Computer Science 2018-03-13 Pieter Gijsbers , Joaquin Vanschoren , Randal S. Olson

Active policy search combines the trial-and-error methodology from policy search with Bayesian optimization to actively find the optimal policy. First, policy search is a type of reinforcement learning which has become very popular for…

Robotics · Computer Science 2024-02-13 Ruben Martinez-Cantin

Environment prediction frameworks are critical for the safe navigation of autonomous vehicles (AVs) in dynamic settings. LiDAR-generated occupancy grid maps (L-OGMs) offer a robust bird's-eye view for the scene representation, enabling…

Computer Vision and Pattern Recognition · Computer Science 2025-10-20 Bernard Lange , Masha Itkina , Jiachen Li , Mykel J. Kochenderfer

In the active learning paradigm, using an oracle to label data has always been a complex and expensive task, and with the emersion of large unlabeled data pools, it would be highly beneficial If we could achieve better results without…

Machine Learning · Computer Science 2025-08-12 Hadi Khorsand , Vahid Pourahmadi

Surrogate-Assisted Evolutionary Algorithms (SAEAs) are widely used for expensive Black-Box Optimization. However, their reliance on rigid, manually designed components such as infill criteria and evolutionary strategies during the search…

Neural and Evolutionary Computing · Computer Science 2025-11-20 Yukun Du , Haiyue Yu , Xiaotong Xie , Yan Zheng , Lixin Zhan , Yudong Du , Chongshuang Hu , Boxuan Wang , Jiang Jiang

Exploratory Landscape Analysis is a powerful technique for numerically characterizing landscapes of single-objective continuous optimization problems. Landscape insights are crucial both for problem understanding as well as for assessing…

Machine Learning · Computer Science 2022-04-15 Moritz Vinzent Seiler , Raphael Patrick Prager , Pascal Kerschke , Heike Trautmann

Recent work has shown that by approximating the behaviour of a non-differentiable black-box function using a neural network, the black-box can be integrated into a differentiable training pipeline for end-to-end training. This methodology…

Computer Vision and Pattern Recognition · Computer Science 2023-06-26 Ganesh Tata , Katyani Singh , Eric Van Oeveren , Nilanjan Ray

Multi-objective optimization problems (MOPs) are ubiquitous in real-world applications, presenting a complex challenge of balancing multiple conflicting objectives. Traditional evolutionary algorithms (EAs), though effective, often rely on…

Neural and Evolutionary Computing · Computer Science 2024-07-29 Yuxiao Huang , Shenghao Wu , Wenjie Zhang , Jibin Wu , Liang Feng , Kay Chen Tan

The core challenge of high-dimensional and expensive black-box optimization (BBO) is how to obtain better performance faster with little function evaluation cost. The essence of the problem is how to design an efficient optimization…

Machine Learning · Computer Science 2023-07-26 Xiaobin Li , Kai Wu , Xiaoyu Zhang , Handing Wang , Jing Liu