English
Related papers

Related papers: Toward an ImageNet Library of Functions for Global…

200 papers

Fooling deep neural networks (DNNs) with the black-box optimization has become a popular adversarial attack fashion, as the structural prior knowledge of DNNs is always unknown. Nevertheless, recent black-box adversarial attacks may…

Computer Vision and Pattern Recognition · Computer Science 2022-01-14 Jie Wang , Zhaoxia Yin , Jing Jiang , Yang Du

Because of its sample efficiency, Bayesian optimization (BO) has become a popular approach dealing with expensive black-box optimization problems, such as hyperparameter optimization (HPO). Recent empirical experiments showed that the loss…

Machine Learning · Computer Science 2021-11-11 Difan Deng , Marius Lindauer

In this paper we propose an approach for learning low dimensional optimized feature space with minimum intra-class variance and maximum inter-class variance. We address the problem of high-dimensionality of feature vectors extracted from…

Image and Video Processing · Electrical Eng. & Systems 2020-01-31 Abin Jose , Erik Stefan Ottlik , Christian Rohlfing , Jens-Rainer Ohm

Benchmarking is essential for developing and evaluating black-box optimization algorithms, providing a structured means to analyze their search behavior. Its effectiveness relies on carefully selected problem sets used for evaluation. To…

Neural and Evolutionary Computing · Computer Science 2025-11-17 Iván Olarte Rodríguez , Maria Laura Santoni , Fabian Duddeck , Carola Doerr , Thomas Bäck , Elena Raponi

Fitness landscape analysis investigates features with a high influence on the performance of optimization algorithms, aiming to take advantage of the addressed problem characteristics. In this work, a fitness landscape analysis using…

Artificial Intelligence · Computer Science 2018-06-27 Marcella S. R. Martins , Mohamed El Yafrani , Roberto Santana , Myriam Delgado , Ricardo Lüders , Belaïd Ahiod

This article presents an efficient end-to-end method to perform instance-level recognition employed to the task of labeling and ranking landmark images. In a first step, we embed images in a high dimensional feature space using…

Computer Vision and Pattern Recognition · Computer Science 2020-10-06 Christof Henkel , Philipp Singer

Accurately predicting the performance of different optimization algorithms for previously unseen problem instances is crucial for high-performing algorithm selection and configuration techniques. In the context of numerical optimization,…

Neural and Evolutionary Computing · Computer Science 2021-04-23 Tome Eftimov , Anja Jankovic , Gorjan Popovski , Carola Doerr , Peter Korošec

Feature visualization has gained substantial popularity, particularly after the influential work by Olah et al. in 2017, which established it as a crucial tool for explainability. However, its widespread adoption has been limited due to a…

Computer Vision and Pattern Recognition · Computer Science 2024-12-11 Thomas Fel , Thibaut Boissin , Victor Boutin , Agustin Picard , Paul Novello , Julien Colin , Drew Linsley , Tom Rousseau , Rémi Cadène , Lore Goetschalckx , Laurent Gardes , Thomas Serre

Image classifiers should be used with caution in the real world. Performance evaluated on a validation set may not reflect performance in the real world. In particular, classifiers may perform well for conditions that are frequently…

Computer Vision and Pattern Recognition · Computer Science 2024-09-30 Adrien LeCoz , Houssem Ouertatani , Stéphane Herbin , Faouzi Adjed

Feature-based algorithm selection aims to automatically find the best one from a portfolio of optimization algorithms on an unseen problem based on its landscape features. Feature-based algorithm selection has recently received attention in…

Neural and Evolutionary Computing · Computer Science 2022-04-27 Ryoji Tanabe

We present an analysis of landscape features for predicting the performance of multi-objective combinatorial optimization algorithms. We consider features from the recently proposed compressed Pareto Local Optimal Solutions Networks…

Neural and Evolutionary Computing · Computer Science 2025-07-03 Ana Nikolikj , Gabriela Ochoa , Tome Eftimov

Exploratory Landscape Analysis (ELA) provides numerical features for characterizing black-box optimization problems. In high-dimensional settings, however, ELA suffers from sparsity effects, high estimator variance, and the prohibitive cost…

Machine Learning · Computer Science 2026-04-16 Iván Olarte Rodríguez , Anja Jankovic , Thomas Bäck , Elena Raponi

Several fundamental problems in science and engineering consist of global optimization tasks involving unknown high-dimensional (black-box) functions that map a set of controllable variables to the outcomes of an expensive experiment.…

Machine Learning · Computer Science 2023-09-15 Mohamed Aziz Bhouri , Michael Joly , Robert Yu , Soumalya Sarkar , Paris Perdikaris

Automatic Machine Learning (Auto-ML) systems tackle the problem of automating the design of prediction models or pipelines for data science. In this paper, we present Lifelong Bayesian Optimization (LBO), an online, multitask Bayesian…

Machine Learning · Statistics 2019-06-24 Yao Zhang , James Jordon , Ahmed M. Alaa , Mihaela van der Schaar

Existing studies in black-box optimization for machine learning suffer from low generalizability, caused by a typically selective choice of problem instances used for training and testing different optimization algorithms. Among other…

Appearance-based gaze estimation frequently relies on deep Convolutional Neural Networks (CNNs). These models are accurate, but computationally expensive and act as "black boxes", offering little interpretability. Geometric methods based on…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Daniele Agostinelli , Thomas Agostinelli , Andrea Generosi , Maura Mengoni

In this work, we introduce LEAD, an approach to discover landmarks from an unannotated collection of category-specific images. Existing works in self-supervised landmark detection are based on learning dense (pixel-level) feature…

Computer Vision and Pattern Recognition · Computer Science 2022-04-07 Tejan Karmali , Abhinav Atrishi , Sai Sree Harsha , Susmit Agrawal , Varun Jampani , R. Venkatesh Babu

Despite the increasing interest in constrained multiobjective optimization in recent years, constrained multiobjective optimization problems (CMOPs) are still unsatisfactory understood and characterized. For this reason, the selection of…

Neural and Evolutionary Computing · Computer Science 2022-06-15 Aljoša Vodopija , Tea Tušar , Bogdan Filipič

Many problems in science and engineering involve optimizing an expensive black-box function over a high-dimensional space. For such black-box optimization (BBO) problems, we typically assume a small budget for online function evaluations,…

Machine Learning · Computer Science 2023-08-22 Siddarth Krishnamoorthy , Satvik Mehul Mashkaria , Aditya Grover

Bayesian optimisation is a powerful method for optimising black-box functions, popular in settings where the true function is expensive to evaluate and no gradient information is available. Bayesian optimisation can improve responses to…

Machine Learning · Computer Science 2025-05-27 Sigrid Passano Hellan , Christopher G. Lucas , Nigel H. Goddard