English
Related papers

Related papers: ParamILS: An Automatic Algorithm Configuration Fra…

200 papers

We consider the problem of configuring general-purpose solvers to run efficiently on problem instances drawn from an unknown distribution. The goal of the configurator is to find a configuration that runs fast on average on most instances,…

Machine Learning · Computer Science 2018-07-03 Gellért Weisz , András György , Csaba Szepesvári

A formulation for the automated generation of algorithms via mathematical programming (optimization) is proposed. The formulation is based on the concept of optimizing within a parameterized family of algorithms, or equivalently a family of…

Optimization and Control · Mathematics 2018-02-14 Alexander Mitsos , Jaromił Najman , Ioannis G. Kevrekidis

Modern software systems are often equipped with hundreds to thousands of configuration options, many of which greatly affect performance. Unfortunately, properly setting these configurations is challenging for developers due to the complex…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-10-23 Shu Wang , Chi Li , William Sentosa , Henry Hoffmann , Shan Lu

This paper presents a powerful automated framework for making complex systems resilient under failures, by optimized adaptive distribution and replication of interdependent software components across heterogeneous hardware components with…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-06-13 Scott D. Stoller , Balaji Jayasankar , Yanhong A. Liu

Defect prediction models---classifiers that identify defect-prone software modules---have configurable parameters that control their characteristics (e.g., the number of trees in a random forest). Recent studies show that these classifiers…

Software Engineering · Computer Science 2018-02-01 Chakkrit Tantithamthavorn , Shane McIntosh , Ahmed E. Hassan , Kenichi Matsumoto

Utilitarian algorithm configuration is a general-purpose technique for automatically searching the parameter space of a given algorithm to optimize its performance, as measured by a given utility function, on a given set of inputs. Recently…

Artificial Intelligence · Computer Science 2025-02-18 Devon Graham , Kevin Leyton-Brown

This study proposes a framework for the automated hyperparameter optimization of a bearing fault detection pipeline for permanent magnet synchronous motors (PMSMs) without the need of external sensors. A automated machine learning (AutoML)…

Signal Processing · Electrical Eng. & Systems 2023-06-21 Tobias Wagner , Alexander Gepperth , Elmar Engels

Algorithm configuration methods optimize the performance of a parameterized heuristic algorithm on a given distribution of problem instances. Recent work introduced an algorithm configuration procedure ("Structured Procrastination") that…

Artificial Intelligence · Computer Science 2019-11-11 Robert Kleinberg , Kevin Leyton-Brown , Brendan Lucier , Devon Graham

A key challenge in the application of evolutionary algorithms in practice is the selection of an algorithm instance that best suits the problem at hand. What complicates this decision further is that different algorithms may be best suited…

Neural and Evolutionary Computing · Computer Science 2021-02-15 Furong Ye , Carola Doerr , Thomas Bäck

Recently it has been proved that a simple algorithm configurator called ParamRLS can efficiently identify the optimal neighbourhood size to be used by stochastic local search to optimise two standard benchmark problem classes. In this paper…

Neural and Evolutionary Computing · Computer Science 2020-04-10 George T. Hall , Pietro Simone Oliveto , Dirk Sudholt

The automatic configuration of Mixed-Integer Programming (MIP) optimizers has become increasingly critical as the large number of configurations can significantly affect solver performance. Yet the lack of standardized evaluation frameworks…

Optimization and Control · Mathematics 2025-09-30 Hongpei Li , Ziyan He , Yufei Wang , Wenting Tu , Shanwen Pu , Qi Deng , Dongdong Ge

Software systems usually provide numerous configuration options that can affect performance metrics such as execution time, memory usage, binary size, or bitrate. On the one hand, making informed decisions is challenging and requires domain…

The paper combines research approaches that traditionally have been disjoint: 1) model checking as used in formal verification of programs, and 2) auto-tuning as often used in high-performance computing. Auto-tuning frameworks optimize…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-05-17 Natalia Garanina , Sergey Staroletov , Sergei Gorlatch

The performance of many hard combinatorial problem solvers depends strongly on their parameter settings, and since manual parameter tuning is both tedious and suboptimal the AI community has recently developed several algorithm…

Artificial Intelligence · Computer Science 2017-11-29 Marius Lindauer , Frank Hutter

Efficient and automated design of optimizers plays a crucial role in full-stack AutoML systems. However, prior methods in optimizer search are often limited by their scalability, generability, or sample efficiency. With the goal of…

Machine Learning · Computer Science 2022-09-29 Ruochen Wang , Yuanhao Xiong , Minhao Cheng , Cho-Jui Hsieh

This paper presents an asynchronous incremental aggregated gradient algorithm and its implementation in a parameter server framework for solving regularized optimization problems. The algorithm can handle both general convex (possibly…

Optimization and Control · Mathematics 2016-10-19 Arda Aytekin , Hamid Reza Feyzmahdavian , Mikael Johansson

Modern supervised machine learning algorithms involve hyperparameters that have to be set before running them. Options for setting hyperparameters are default values from the software package, manual configuration by the user or configuring…

Machine Learning · Statistics 2018-10-23 Philipp Probst , Bernd Bischl , Anne-Laure Boulesteix

Algorithm configurators are automated methods to optimise the parameters of an algorithm for a class of problems. We evaluate the performance of a simple random local search configurator (ParamRLS) for tuning the neighbourhood size $k$ of…

Neural and Evolutionary Computing · Computer Science 2019-05-22 George T. Hall , Pietro S. Oliveto , Dirk Sudholt

We propose a new method to design adaptation algorithms that guarantee a certain prescribed level of performance and are applicable to systems with nonconvex parameterization. The main idea behind the method is, given the desired…

Optimization and Control · Mathematics 2007-05-23 I. Y. Tyukin , D. V. Prokhorov , Cees van Leeuwen

This paper proposes a new framework for providing approximation guarantees of local search algorithms. Local search is a basic algorithm design technique and is widely used for various combinatorial optimization problems. To analyze local…

Data Structures and Algorithms · Computer Science 2020-06-03 Kaito Fujii