English
Related papers

Related papers: carps: A Framework for Comparing N Hyperparameter …

200 papers

Hyperparameter optimization constitutes a large part of typical modern machine learning workflows. This arises from the fact that machine learning methods and corresponding preprocessing steps often only yield optimal performance when…

Efficient and automated design of optimizers plays a crucial role in full-stack AutoML systems. However, prior methods in optimizer search are often limited by their scalability, generability, or sample efficiency. With the goal of…

Machine Learning · Computer Science 2022-09-29 Ruochen Wang , Yuanhao Xiong , Minhao Cheng , Cho-Jui Hsieh

Hyperparameter optimization (HPO) is generally treated as a bi-level optimization problem that involves fitting a (probabilistic) surrogate model to a set of observed hyperparameter responses, e.g. validation loss, and consequently…

Machine Learning · Computer Science 2021-10-18 Hadi S. Jomaa , Jonas Falkner , Lars Schmidt-Thieme

We present a model-agnostic framework for jointly optimizing the predictive performance and interpretability of supervised machine learning models for tabular data. Interpretability is quantified via three measures: feature sparsity,…

Machine Learning · Computer Science 2023-07-18 Lennart Schneider , Bernd Bischl , Janek Thomas

While Weighted Lasso sparse regression has appealing statistical guarantees that would entail a major real-world impact in finance, genomics, and brain imaging applications, it is typically scarcely adopted due to its complex…

Machine Learning · Computer Science 2022-06-13 Kenan Šehić , Alexandre Gramfort , Joseph Salmon , Luigi Nardi

Deep learning algorithms vary depending on the underlying connection mechanism of nodes of them. They have various hyperparameters that are either set via specific algorithms or randomly chosen. Meanwhile, hyperparameters of deep learning…

Machine Learning · Computer Science 2020-11-20 M. M. Ozturk

Sherpa is a hyperparameter optimization library for machine learning models. It is specifically designed for problems with computationally expensive, iterative function evaluations, such as the hyperparameter tuning of deep neural networks.…

Machine Learning · Computer Science 2020-05-11 Lars Hertel , Julian Collado , Peter Sadowski , Jordan Ott , Pierre Baldi

Hyperparameter optimization (HPO) is crucial for strong performance of deep learning algorithms and real-world applications often impose some constraints, such as memory usage, or latency on top of the performance requirement. In this work,…

Machine Learning · Computer Science 2023-05-29 Shuhei Watanabe , Frank Hutter

HyperParameter Optimization (HPO) aims at finding the best HyperParameters (HPs) of learning models, such as neural networks, in the fastest and most efficient way possible. Most recent HPO algorithms try to optimize HPs regardless of the…

Machine Learning · Computer Science 2023-04-11 Antoine Scardigli , Paul Fournier , Matteo Vilucchio , David Naccache

We present HIghly Parallelisable Pareto Optimisation (HIPPO) -- a batch acquisition function that enables multi-objective Bayesian optimisation methods to efficiently exploit parallel processing resources. Multi-Objective Bayesian…

Machine Learning · Computer Science 2022-06-28 Andrei Paleyes , Henry B. Moss , Victor Picheny , Piotr Zulawski , Felix Newman

While deep neural networks excel in solving visual recognition tasks, they require significant effort to find hyperparameters that make them work optimally. Hyperparameter Optimization (HPO) approaches have automated the process of finding…

Computer Vision and Pattern Recognition · Computer Science 2020-05-22 Gaurav Mittal , Chang Liu , Nikolaos Karianakis , Victor Fragoso , Mei Chen , Yun Fu

While deep learning has celebrated many successes, its results often hinge on the meticulous selection of hyperparameters (HPs). However, the time-consuming nature of deep learning training makes HP optimization (HPO) a costly endeavor,…

Artificial Intelligence · Computer Science 2024-08-20 Shuhei Watanabe , Neeratyoy Mallik , Edward Bergman , Frank Hutter

Hyperparameter optimization (HPO) is increasingly used to automatically tune the predictive performance (e.g., accuracy) of machine learning models. However, in a plethora of real-world applications, accuracy is only one of the multiple --…

Machine Learning · Statistics 2021-06-25 Robin Schmucker , Michele Donini , Muhammad Bilal Zafar , David Salinas , Cédric Archambeau

Hyperparameter optimization (HPO) aims to identify an optimal hyperparameter configuration (HPC) such that the resulting model generalizes well to unseen data. As the expected generalization error cannot be optimized directly, it is…

Machine Learning · Computer Science 2025-06-25 Lennart Schneider , Bernd Bischl , Matthias Feurer

Hyperparameter optimization (HPO) plays a central role in the automated machine learning (AutoML). It is a challenging task as the response surfaces of hyperparameters are generally unknown, hence essentially a global optimization problem.…

Machine Learning · Computer Science 2021-06-18 Zebin Yang , Aijun Zhang

There is a consensus that focusing only on accuracy in searching for optimal machine learning models amplifies biases contained in the data, leading to unfair predictions and decision supports. Recently, multi-objective hyperparameter…

Machine Learning · Computer Science 2022-05-19 Antonio Candelieri , Andrea Ponti , Francesco Archetti

While Deep Learning (DL) experts often have prior knowledge about which hyperparameter settings yield strong performance, only few Hyperparameter Optimization (HPO) algorithms can leverage such prior knowledge and none incorporate priors…

Machine Learning · Computer Science 2025-11-12 Soham Basu , Frank Hutter , Danny Stoll

Hyperparameter tuning is a fundamental aspect of machine learning research. Setting up the infrastructure for systematic optimization of hyperparameters can take a significant amount of time. Here, we present PyHopper, a black-box…

Machine Learning · Computer Science 2022-10-11 Mathias Lechner , Ramin Hasani , Philipp Neubauer , Sophie Neubauer , Daniela Rus

This paper presents the Firefighter Optimization (FFO) algorithm as a new hybrid metaheuristic for optimization problems. This algorithm stems inspiration from the collaborative strategies often deployed by firefighters in firefighting…

Neural and Evolutionary Computing · Computer Science 2024-06-04 M. Z. Naser , A. Z. Naser

Direct Preference Optimization (DPO) is an effective framework for aligning large language models with human preferences, but it struggles with complex reasoning tasks. DPO optimizes for the likelihood of generating preferred over…

Artificial Intelligence · Computer Science 2026-04-23 Darsh Kachroo , Adriana Caraeni , Arjun Prasaath Anbazhagan , Brennan Lagasse , Kevin Zhu