English

Biobjective Performance Assessment with the COCO Platform

Neural and Evolutionary Computing 2016-05-09 v1
Authors: Dimo Brockhoff , Tea Tušar , Dejan Tušar , Tobias Wagner , Nikolaus Hansen , Anne Auger
View on arXiv ↗ PDF ↗

Abstract

This document details the rationales behind assessing the performance of numerical black-box optimizers on multi-objective problems within the COCO platform and in particular on the biobjective test suite bbob-biobj. The evaluation is based on a hypervolume of all non-dominated solutions in the archive of candidate solutions and measures the runtime until the hypervolume value succeeds prescribed target values.

Cite

@article{arxiv.1605.01746,
  title  = {Biobjective Performance Assessment with the COCO Platform},
  author = {Dimo Brockhoff and Tea Tušar and Dejan Tušar and Tobias Wagner and Nikolaus Hansen and Anne Auger},
  journal= {arXiv preprint arXiv:1605.01746},
  year   = {2016}
}

Related papers

View all related →
Neural and Evolutionary Computing · Computer Science
COCO: Performance Assessment
Nikolaus Hansen, Anne Auger, Dimo Brockhoff, Dejan Tušar +1
2016-05-12
Artificial Intelligence · Computer Science
Using Well-Understood Single-Objective Functions in Multiobjective Black-Box Optimization Test Suites
Dimo Brockhoff, Tea Tusar, Anne Auger, Nikolaus Hansen
2019-01-07
Artificial Intelligence · Computer Science
COCO: A Platform for Comparing Continuous Optimizers in a Black-Box Setting
Nikolaus Hansen, Anne Auger, Raymond Ros, Olaf Mersmann +2
2020-09-10
Optimization and Control · Mathematics
BMOBench: Black-Box Multi-Objective Optimization Benchmarking Platform
Abdullah Al-Dujaili, S. Suresh
2017-07-04
Neural and Evolutionary Computing · Computer Science
Anytime Bi-Objective Optimization with a Hybrid Multi-Objective CMA-ES (HMO-CMA-ES)
Ilya Loshchilov, Tobias Glasmachers
2016-05-10
Optimization and Control · Mathematics
COCO: The Large Scale Black-Box Optimization Benchmarking (bbob-largescale) Test Suite
Ouassim Elhara, Konstantinos Varelas, Duc Nguyen, Tea Tusar +3
2019-03-29
Neural and Evolutionary Computing · Computer Science
Characterization of Constrained Continuous Multiobjective Optimization Problems: A Performance Space Perspective
Aljoša Vodopija, Tea Tušar, Bogdan Filipič
2023-02-07
Optimization and Control · Mathematics
BONO-Bench: A Comprehensive Test Suite for Bi-objective Numerical Optimization with Traceable Pareto Sets
Lennart Schäpermeier, Pascal Kerschke
2026-01-26
Artificial Intelligence · Computer Science
COCOpf: An Algorithm Portfolio Framework
Petr Baudiš
2014-05-16
Mathematical Software · Computer Science
Blackbox: A procedure for parallel optimization of expensive black-box functions
Paul Knysh, Yannis Korkolis
2016-05-04
Machine Learning · Computer Science
MA-BBOB: Many-Affine Combinations of BBOB Functions for Evaluating AutoML Approaches in Noiseless Numerical Black-Box Optimization Contexts
Diederick Vermetten, Furong Ye, Thomas Bäck, Carola Doerr
2023-06-21
Artificial Intelligence · Computer Science
COCO: The Experimental Procedure
Nikolaus Hansen, Tea Tusar, Olaf Mersmann, Anne Auger +1
2016-05-20
Machine Learning · Computer Science
Offline Stochastic Optimization of Black-Box Objective Functions
Juncheng Dong, Zihao Wu, Hamid Jafarkhani, Ali Pezeshki +1
2024-12-04
Machine Learning · Statistics
Many Objective Bayesian Optimization
Lucia Asencio Martín, Eduardo C. Garrido-Merchán
2021-07-12
Machine Learning · Computer Science
OpenBox: A Generalized Black-box Optimization Service
Yang Li, Yu Shen, Wentao Zhang, Yuanwei Chen +8
2021-11-05
Machine Learning · Computer Science
Black-Box Optimization Revisited: Improving Algorithm Selection Wizards through Massive Benchmarking
Laurent Meunier, Herilalaina Rakotoarison, Pak Kan Wong, Baptiste Roziere +4
2021-02-24
Computation · Statistics
Black-box Optimization with Simultaneous Statistical Inference for Optimal Performance
Teng Lian, Jian-Qiang Hu, Yuhang Wu, Zeyu Zheng
2025-01-15
Machine Learning · Computer Science
A Survey of Meta-features Used for Automated Selection of Algorithms for Black-box Single-objective Continuous Optimization
Gjorgjina Cenikj, Ana Nikolikj, Gašper Petelin, Niki van Stein +2
2024-06-12
Data Structures and Algorithms · Computer Science
The Hypervolume Indicator: Problems and Algorithms
Andreia P. Guerreiro, Carlos M. Fonseca, Luís Paquete
2022-04-14
Machine Learning · Computer Science
Black Box Optimization Using QUBO and the Cross Entropy Method
Jonas Nüßlein, Christoph Roch, Thomas Gabor, Jonas Stein +2
2023-02-10
Neural and Evolutionary Computing · Computer Science
How Sequential Algorithm Portfolios can benefit Black Box Optimization
Catalin-Viorel Dinu, Diederick Vermetten, Carola Doerr
2026-01-26
Neural and Evolutionary Computing · Computer Science
Non-elitist Evolutionary Multi-objective Optimizers Revisited
Ryoji Tanabe, Hisao Ishibuchi
2020-10-01
Machine Learning · Computer Science
B2Opt: Learning to Optimize Black-box Optimization with Little Budget
Xiaobin Li, Kai Wu, Xiaoyu Zhang, Handing Wang +1
2023-07-26
Neural and Evolutionary Computing · Computer Science
Towards a Theory-Guided Benchmarking Suite for Discrete Black-Box Optimization Heuristics: Profiling $(1+\lambda)$ EA Variants on OneMax and LeadingOnes
Carola Doerr, Furong Ye, Sander van Rijn, Hao Wang +1
2018-08-20
Machine Learning · Computer Science
BOFormer: Learning to Solve Multi-Objective Bayesian Optimization via Non-Markovian RL
Yu-Heng Hung, Kai-Jie Lin, Yu-Heng Lin, Chien-Yi Wang +2
2025-05-30
R2 v1 2026-06-22T13:54:16.770Z