English
Related papers

Related papers: Efficient Benchmarking of Algorithm Configuration …

200 papers

Agent-based modeling (ABM) is a powerful computational approach for studying complex biological and biomedical systems, yet its widespread use remains limited by significant computational demands. As models become increasingly…

Quantitative Methods · Quantitative Biology 2025-04-17 Kerri-Ann Norton , Daniel Bergman , Harsh Vardhan Jain , Trachette Jackson

Heuristic optimisation algorithms explore the search space by sampling solutions, evaluating their fitness, and biasing the search in the direction of promising solutions. However, in many cases, this fitness function involves executing…

Neural and Evolutionary Computing · Computer Science 2024-10-07 Pablo S. Naharro , Pablo Toharia , Antonio LaTorre , José-María Peña

It is not uncommon that meta-heuristic algorithms contain some intrinsic parameters, the optimal configuration of which is crucial for achieving their peak performance. However, evaluating the effectiveness of a configuration is expensive,…

Neural and Evolutionary Computing · Computer Science 2019-02-01 Ke Li , Zilin Xiang , Kay Chen Tan

The optimization of large-scale multibody systems is a numerically challenging task, in particular when considering multiple conflicting criteria at the same time. In this situation, we need to approximate the Pareto set of optimal…

Optimization and Control · Mathematics 2024-12-20 Augustina C. Amakor , Manuel B. Berkemeier , Meike Wohlleben , Walter Sextro , Sebastian Peitz

AI-assisted molecular optimization is a very active research field as it is expected to provide the next-generation drugs and molecular materials. An important difficulty is that the properties to be optimized rely on costly evaluations.…

Machine Learning · Computer Science 2025-05-19 Jules Leguy , Thomas Cauchy , Beatrice Duval , Benoit Da Mota

Performing reliability analysis on complex systems is often computationally expensive. In particular, when dealing with systems having high input dimensionality, reliability estimation becomes a daunting task. A popular approach to overcome…

Machine Learning · Statistics 2021-12-22 Navaneeth N. , Souvik Chakraborty

We study the interplay between surrogate methods for structured prediction and techniques from multitask learning designed to leverage relationships between surrogate outputs. We propose an efficient algorithm based on trace norm…

Machine Learning · Computer Science 2019-03-05 Giulia Luise , Dimitris Stamos , Massimiliano Pontil , Carlo Ciliberto

Surrogates, models that mimic the behavior of programs, form the basis of a variety of development workflows. We study three surrogate-based design patterns, evaluating each in case studies on a large-scale CPU simulator. With surrogate…

Programming Languages · Computer Science 2021-12-14 Alex Renda , Yi Ding , Michael Carbin

Inferring parameter distributions of complex industrial systems from noisy time series data requires methods to deal with the uncertainty of the underlying data and the used simulation model. Bayesian inference is well suited for these…

Applications · Statistics 2021-06-18 David N. John , Livia Stohrer , Claudia Schillings , Michael Schick , Vincent Heuveline

When developing and analyzing new hyperparameter optimization methods, it is vital to empirically evaluate and compare them on well-curated benchmark suites. In this work, we propose a new set of challenging and relevant benchmark problems…

Machine Learning · Computer Science 2022-08-02 Florian Pfisterer , Lennart Schneider , Julia Moosbauer , Martin Binder , Bernd Bischl

Optimizing the hyperparameters and architecture of a neural network is a long yet necessary phase in the development of any new application. This consuming process can benefit from the elaboration of strategies designed to quickly discard…

Optimization and Control · Mathematics 2021-03-16 Dounia Lakhmiri , Sébastien Le Digabel

Hyperparameter optimization (HPO) is generally treated as a bi-level optimization problem that involves fitting a (probabilistic) surrogate model to a set of observed hyperparameter responses, e.g. validation loss, and consequently…

Machine Learning · Computer Science 2021-10-18 Hadi S. Jomaa , Jonas Falkner , Lars Schmidt-Thieme

It has been shown that cooperative coevolution (CC) can effectively deal with large scale optimization problems (LSOPs) through a divide-and-conquer strategy. However, its performance is severely restricted by the current…

Neural and Evolutionary Computing · Computer Science 2018-03-05 Bei Pang , Zhigang Ren , Yongsheng Liang , An Chen

Solving optimization problems with unknown parameters often requires learning a predictive model to predict the values of the unknown parameters and then solving the problem using these values. Recent work has shown that including the…

Machine Learning · Computer Science 2020-10-23 Kai Wang , Bryan Wilder , Andrew Perrault , Milind Tambe

Surrogate-assisted evolutionary algorithms have been widely developed to solve complex and computationally expensive multi-objective optimization problems in recent years. However, when dealing with high-dimensional optimization problems,…

Neural and Evolutionary Computing · Computer Science 2024-03-19 Guodong Chen , Jiu Jimmy Jiao , Xiaoming Xue , Zhongzheng Wang

Global optimization of large-scale, complex systems such as multi-physics black-box simulations and real-world industrial systems is important but challenging. This work presents a novel Surrogate-Based Optimization framework based on…

Machine Learning · Computer Science 2026-01-13 Maaz Ahmad , Iftekhar A. Karimi

Machine learning methods are increasingly used to build computationally inexpensive surrogates for complex physical models. The predictive capability of these surrogates suffers when data are noisy, sparse, or time-dependent. As we are…

Machine Learning · Computer Science 2024-05-20 A. Diaw , M. McKerns , I. Sagert , L. G. Stanton , M. S. Murillo

The central task in modeling complex dynamical systems is parameter estimation. This task involves numerous evaluations of a computationally expensive objective function. Surrogate-based optimization introduces a computationally efficient…

Machine Learning · Computer Science 2019-12-19 Žiga Lukšič , Jovan Tanevski , Sašo Džeroski , Ljupčo Todorovski

In this paper, we focus on developing efficient sensitivity analysis methods for a computationally expensive objective function $f(x)$ in the case that the minimization of it has just been performed. Here "computationally expensive" means…

Machine Learning · Statistics 2015-02-24 Yilun Wang , Christine A. Shoemaker

In a task where many similar inverse problems must be solved, evaluating costly simulations is impractical. Therefore, replacing the model $y$ with a surrogate model $y_s$ that can be evaluated quickly leads to a significant speedup. The…

Numerical Analysis · Mathematics 2024-05-15 Phillip Semler , Martin Weiser