English
Related papers

Related papers: Explainable Landscape-Aware Optimization Performan…

200 papers

Learned dynamics models combined with both planning and policy learning algorithms have shown promise in enabling artificial agents to learn to perform many diverse tasks with limited supervision. However, one of the fundamental challenges…

Machine Learning · Computer Science 2020-08-12 Suraj Nair , Silvio Savarese , Chelsea Finn

Knowledge of search-landscape features of BlackBox Optimization (BBO) problems offers valuable information in light of the Algorithm Selection and/or Configuration problems. Exploratory Landscape Analysis (ELA) models have gained success in…

Artificial Intelligence · Computer Science 2022-06-29 Boris Yazmir , Ofer M. Shir

Using Large Language Models (LLMs) in an evolutionary or other iterative search framework have demonstrated significant potential in automated algorithm design. However, the underlying fitness landscape, which is critical for understanding…

Artificial Intelligence · Computer Science 2025-08-28 Fei Liu , Qingfu Zhang , Jialong Shi , Xialiang Tong , Kun Mao , Mingxuan Yuan

Fitness landscape analysis investigates features with a high influence on the performance of optimization algorithms, aiming to take advantage of the addressed problem characteristics. In this work, a fitness landscape analysis using…

Artificial Intelligence · Computer Science 2018-06-27 Marcella S. R. Martins , Mohamed El Yafrani , Roberto Santana , Myriam Delgado , Ricardo Lüders , Belaïd Ahiod

Automated algorithm performance prediction in numerical blackbox optimization often relies on problem characterizations, such as exploratory landscape analysis features. These features are typically used as inputs to machine learning models…

Artificial Intelligence · Computer Science 2025-06-23 Ana Kostovska , Carola Doerr , Sašo Džeroski , Panče Panov , Tome Eftimov

In this paper, we propose a method to perform empirical analysis of the loss landscape of machine learning (ML) models. The method is applied to two ML models for scientific sensing, which necessitates quantization to be deployed and are…

Machine Learning · Computer Science 2025-02-17 Tommaso Baldi , Javier Campos , Olivia Weng , Caleb Geniesse , Nhan Tran , Ryan Kastner , Alessandro Biondi

Advanced machine learning models have recently achieved high predictive accuracy for weather and climate prediction. However, these complex models often lack inherent transparency and interpretability, acting as "black boxes" that impede…

Atmospheric and Oceanic Physics · Physics 2024-03-29 Ruyi Yang , Jingyu Hu , Zihao Li , Jianli Mu , Tingzhao Yu , Jiangjiang Xia , Xuhong Li , Aritra Dasgupta , Haoyi Xiong

Black-box optimization often relies on evolutionary and swarm algorithms whose performance is highly problem dependent. We view an optimizer as a short program over a small vocabulary of search operators and learn this operator program…

Neural and Evolutionary Computing · Computer Science 2025-12-16 Junbo Jacob Lian , Mingyang Yu , Kaichen Ouyang , Shengwei Fu , Rui Zhong , Yujun Zhang , Jun Zhang , Huiling Chen

LLMs are increasingly used to support qualitative research, yet existing systems produce outputs that vary widely--from trace-faithful summaries to theory-mediated explanations and system models. To make these differences explicit, we…

Computation and Language · Computer Science 2026-01-21 Xinyu Pi , Qisen Yang , Chuong Nguyen , Hua Shen

The trade-off between accuracy and interpretability has long been a challenge in machine learning (ML). This tension is particularly significant for emerging interpretable-by-design methods, which aim to redesign ML algorithms for…

Machine Learning · Computer Science 2025-05-28 Geyu Liang , Senne Michielssen , Salar Fattahi

Benchmarking heuristic algorithms is vital to understand under which conditions and on what kind of problems certain algorithms perform well. In most current research into heuristic optimization algorithms, only a very limited number of…

Neural and Evolutionary Computing · Computer Science 2024-02-26 Niki van Stein , Diederick Vermetten , Anna V. Kononova , Thomas Bäck

Machine-learning algorithms have gained popularity in recent years in the field of ecological modeling due to their promising results in predictive performance of classification problems. While the application of such algorithms has been…

Machine Learning · Statistics 2019-10-07 Patrick Schratz , Jannes Muenchow , Eugenia Iturritxa , Jakob Richter , Alexander Brenning

This study proposed an exhaustive stable/reproducible rule-mining algorithm combined to a classifier to generate both accurate and interpretable models. Our method first extracts rules (i.e., a conjunction of conditions about the values of…

Machine Learning · Computer Science 2017-07-03 Margaux Luck , Nicolas Pallet , Cecilia Damon

This study examines the generalization ability of algorithm performance prediction models across various benchmark suites. Comparing the statistical similarity between the problem collections with the accuracy of performance prediction…

Machine Learning · Computer Science 2024-05-22 Ana Nikolikj , Ana Kostovska , Gjorgjina Cenikj , Carola Doerr , Tome Eftimov

Machine learning (ML) algorithms can often differ in performance across domains. Understanding $\textit{why}$ their performance differs is crucial for determining what types of interventions (e.g., algorithmic or operational) are most…

Machine Learning · Computer Science 2024-02-23 Jean Feng , Harvineet Singh , Fan Xia , Adarsh Subbaswamy , Alexej Gossmann

Landscape-aware algorithm selection approaches have so far mostly been relying on landscape feature extraction as a preprocessing step, independent of the execution of optimization algorithms in the portfolio. This introduces a significant…

Neural and Evolutionary Computing · Computer Science 2022-06-08 Anja Jankovic , Diederick Vermetten , Ana Kostovska , Jacob de Nobel , Tome Eftimov , Carola Doerr

Benchmarking plays a major role in the development and analysis of optimization algorithms. As such, the way in which the used benchmark problems are defined significantly affects the insights that can be gained from any given benchmark…

Neural and Evolutionary Computing · Computer Science 2023-03-09 Diederick Vermetten , Furong Ye , Carola Doerr

Interpretable machine learning offers insights into what factors drive a certain prediction of a black-box system. A large number of interpreting methods focus on identifying explanatory input features, which generally fall into two main…

Machine Learning · Computer Science 2023-06-02 Vy Vo , Van Nguyen , Trung Le , Quan Hung Tran , Gholamreza Haffari , Seyit Camtepe , Dinh Phung

In many recent works, the potential of Exploratory Landscape Analysis (ELA) features to numerically characterize, in particular, single-objective continuous optimization problems has been demonstrated. These numerical features provide the…

Machine Learning · Computer Science 2024-07-30 Moritz Vinzent Seiler , Pascal Kerschke , Heike Trautmann

Sub-seasonal climate forecasting (SSF) focuses on predicting key climate variables such as temperature and precipitation in the 2-week to 2-month time scales. Skillful SSF would have immense societal value, in areas such as agricultural…

Machine Learning · Computer Science 2020-06-25 Sijie He , Xinyan Li , Timothy DelSole , Pradeep Ravikumar , Arindam Banerjee