English
Related papers

Related papers: ParamILS: An Automatic Algorithm Configuration Fra…

200 papers

Automatically tuning software configuration for optimizing a single performance attribute (e.g., minimizing latency) is not trivial, due to the nature of the configuration systems (e.g., complex landscape and expensive measurement). To deal…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-06-03 Tao Chen , Miqing Li

Automatic machine learning (AutoML) is a key enabler of the mass deployment of the next generation of machine learning systems. A key desideratum for future ML systems is the automatic selection of models and hyperparameters. We present a…

Machine Learning · Computer Science 2022-02-22 Moe Kayali , Chi Wang

Automated hyperparameter optimization (HPO) has gained great popularity and is an important ingredient of most automated machine learning frameworks. The process of designing HPO algorithms, however, is still an unsystematic and manual…

Learning and predicting the performance of given software configurations are of high importance to many software engineering activities. While configurable software systems will almost certainly face diverse running environments (e.g.,…

Software Engineering · Computer Science 2024-02-06 Jingzhi Gong , Tao Chen

Parameter tuning is recognized today as a crucial ingredient when tackling an optimization problem. Several meta-optimization methods have been proposed to find the best parameter set for a given optimization algorithm and (set of) problem…

Artificial Intelligence · Computer Science 2013-05-13 Mostepha Redouane Khouadjia , Marc Schoenauer , Vincent Vidal , Johann Dréo , Pierre Savéant

The increasing complexity of modern configurable systems makes it critical to improve the level of automation in the process of system configuration. Such automation can also improve the agility of the development cycle, allowing for rapid…

Formal Languages and Automata Theory · Computer Science 2021-08-20 Nestan Tsiskaridze , Maxwell Strange , Makai Mann , Kavya Sreedhar , Qiaoyi Liu , Mark Horowitz , Clark Barrett

We present a new method for scaling automatic configuration of computer networks. The key idea is to relax the computationally hard search problem of finding a configuration that satisfies a given specification into an approximate objective…

Networking and Internet Architecture · Computer Science 2022-11-04 Luca Beurer-Kellner , Martin Vechev , Laurent Vanbever , Petar Veličković

Programmable data planes allow for sophisticated applications that give operators the power to customize the functionality of their networks. Deploying these applications, however, often requires tedious and burdensome optimization of their…

Networking and Internet Architecture · Computer Science 2024-02-20 Mary Hogan , Devon Loehr , John Sonchack , Shir Landau Feibish , Jennifer Rexford , David Walker

We discuss the issue of finding a good mathematical programming solver configuration for a particular instance of a given problem, and we propose a two-phase approach to solve it. In the first phase we learn the relationships between the…

Optimization and Control · Mathematics 2024-01-11 Gabriele Iommazzo , Claudia D'Ambrosio , Antonio Frangioni , Leo Liberti

Incorporating a non-Euclidean variable metric to first-order algorithms is known to bring enhancement. However, due to the lack of an optimal choice, such an enhancement appears significantly underestimated. In this work, we establish a…

Optimization and Control · Mathematics 2023-11-21 Yifan Ran

It has long been observed that the performance of evolutionary algorithms and other randomized search heuristics can benefit from a non-static choice of the parameters that steer their optimization behavior. Mechanisms that identify…

Neural and Evolutionary Computing · Computer Science 2022-04-18 André Biedenkapp , Nguyen Dang , Martin S. Krejca , Frank Hutter , Carola Doerr

Most machine learning algorithms are configured by one or several hyperparameters that must be carefully chosen and often considerably impact performance. To avoid a time consuming and unreproducible manual trial-and-error process to find…

The performance of many algorithms in the fields of hard combinatorial problem solving, machine learning or AI in general depends on tuned hyperparameter configurations. Automated methods have been proposed to alleviate users from the…

Machine Learning · Computer Science 2019-08-23 André Biedenkapp , H. Furkan Bozkurt , Frank Hutter , Marius Lindauer

Many practitioners in robotics regularly depend on classic, hand-designed algorithms. Often the performance of these algorithms is tuned across a dataset of annotated examples which represent typical deployment conditions. Automatic tuning…

Artificial Intelligence · Computer Science 2023-03-15 Leonid Keselman , Martial Hebert

Finding optimal hyperparameters for the machine learning algorithm can often significantly improve its performance. But how to choose them in a time-efficient way? In this paper we present the protocol of generating benchmark data…

Machine Learning · Computer Science 2020-09-01 Wojciech Kretowicz , Przemysław Biecek

Programs with high levels of complexity often face challenges in adjusting execution parameters, particularly when these parameters vary based on the execution context. These dynamic parameters significantly impact the program's…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-06-18 Joao B. Fernandes , Felipe H. S. da Silva , Samuel Xavier-de-Souza , Italo A. S. Assis

As the demand for computational power grows, optimizing code through compilers becomes increasingly crucial. In this context, we focus on fully automatic code optimization techniques that automate the process of selecting and applying code…

Programming Languages · Computer Science 2025-11-11 Yacine Hakimi , Riyadh Baghdadi

The problem of parameterization is often central to the effective deployment of nature-inspired algorithms. However, finding the optimal set of parameter values for a combination of problem instance and solution method is highly…

Neural and Evolutionary Computing · Computer Science 2014-06-26 Matthew Crossley , Andy Nisbet , Martyn Amos

Local search is a fundamental optimization technique that is both widely used in practice and deeply studied in theory, yet its computational complexity remains poorly understood. The traditional frameworks, PLS and the standard algorithm…

Computational Complexity · Computer Science 2026-01-05 Robert Ganian , Hung P. Hoang , Christian Komusiewicz , Nils Morawietz