English
Related papers

Related papers: Enhancing Machine Learning Model Performance with …

200 papers

This paper explores the use of foundational large language models (LLMs) in hyperparameter optimization (HPO). Hyperparameters are critical in determining the effectiveness of machine learning models, yet their optimization often relies on…

Machine Learning · Computer Science 2024-11-12 Michael R. Zhang , Nishkrit Desai , Juhan Bae , Jonathan Lorraine , Jimmy Ba

Hyperparameter Optimization (HPO) of Deep Learning-based models tends to be a compute resource intensive process as it usually requires to train the target model with many different hyperparameter configurations. We show that integrating…

Machine Learning · Computer Science 2023-11-30 Juan Pablo García Amboage , Eric Wulff , Maria Girone , Tomás F. Pena

A great deal of research has been conducted in the consideration of meta-heuristic optimisation methods that are able to find global optima in settings that gradient based optimisers have traditionally struggled. Of these, so-called…

Neural and Evolutionary Computing · Computer Science 2023-05-01 Max D. Champneys , Timothy J. Rogers

Machine learning has achieved remarkable success over the past couple of decades, often attributed to a combination of algorithmic innovations and the availability of high-quality data available at scale. However, a third critical component…

Hyperparameters are configuration variables controlling the behavior of machine learning algorithms. They are ubiquitous in machine learning and artificial intelligence and the choice of their values determines the effectiveness of systems…

Reinforcement learning algorithms can show strong variation in performance between training runs with different random seeds. In this paper we explore how this affects hyperparameter optimization when the goal is to find hyperparameter…

Machine Learning · Computer Science 2020-07-31 Lars Hertel , Pierre Baldi , Daniel L. Gillen

Generality is one of the main advantages of heuristic algorithms, as such, multiple parameters are exposed to the user with the objective of allowing them to shape the algorithms to their specific needs. Parameter selection, therefore,…

Neural and Evolutionary Computing · Computer Science 2017-05-22 Carlos Garcia Cordero

Machine learning is a powerful method for modeling in different fields such as education. Its capability to accurately predict students' success makes it an ideal tool for decision-making tasks related to higher education. The accuracy of…

Machine Learning · Computer Science 2021-05-03 Leila Zahedi , Farid Ghareh Mohammadi , Shabnam Rezapour , Matthew W. Ohland , M. Hadi Amini

Weather forecasting plays a vital role in numerous sectors, but accurately capturing the complex dynamics of weather systems remains a challenge for traditional statistical models. Apart from Auto Regressive time forecasting models like…

Neural and Evolutionary Computing · Computer Science 2023-11-27 Anuvab Sen , Arul Rhik Mazumder , Dibyarup Dutta , Udayon Sen , Pathikrit Syam , Sandipan Dhar

Hyperparameter optimization (HPO) is generally treated as a bi-level optimization problem that involves fitting a (probabilistic) surrogate model to a set of observed hyperparameter responses, e.g. validation loss, and consequently…

Machine Learning · Computer Science 2021-10-18 Hadi S. Jomaa , Jonas Falkner , Lars Schmidt-Thieme

Model-based Reinforcement Learning (MBRL) is a promising framework for learning control in a data-efficient manner. MBRL algorithms can be fairly complex due to the separate dynamics modeling and the subsequent planning algorithm, and as a…

Machine Learning · Computer Science 2021-03-01 Baohe Zhang , Raghu Rajan , Luis Pineda , Nathan Lambert , André Biedenkapp , Kurtland Chua , Frank Hutter , Roberto Calandra

The task of hyper-parameter optimization (HPO) is burdened with heavy computational costs due to the intractability of optimizing both a model's weights and its hyper-parameters simultaneously. In this work, we introduce a new class of HPO…

Machine Learning · Computer Science 2021-12-14 Mathieu Tuli , Mahdi S. Hosseini , Konstantinos N. Plataniotis

Zero-shot hyperparameter optimization (HPO) is a simple yet effective use of transfer learning for constructing a small list of hyperparameter (HP) configurations that complement each other. That is to say, for any given dataset, at least…

Machine Learning · Statistics 2020-07-28 Fela Winkelmolen , Nikita Ivkin , H. Furkan Bozkurt , Zohar Karnin

Recent empirical work shows that inconsistent results based on choice of hyperparameter optimization (HPO) configuration are a widespread problem in ML research. When comparing two algorithms J and K searching one subspace can yield the…

Machine Learning · Computer Science 2022-02-18 A. Feder Cooper , Yucheng Lu , Jessica Zosa Forde , Christopher De Sa

Automated machine learning aims to automate the whole process of machine learning, including model configuration. In this paper, we focus on automated hyperparameter optimization (HPO) based on sequential model-based optimization (SMBO).…

Machine Learning · Computer Science 2019-09-11 Ying Wei , Peilin Zhao , Huaxiu Yao , Junzhou Huang

Designing search algorithms for finding global optima is one of the most active research fields, recently. These algorithms consist of two main categories, i.e., classic mathematical and metaheuristic algorithms. This article proposes a…

Neural and Evolutionary Computing · Computer Science 2018-09-26 Benyamin Ghojogh , Saeed Sharifian , Hoda Mohammadzade

The increasing demand for democratizing machine learning algorithms calls for hyperparameter optimization (HPO) solutions at low cost. Many machine learning algorithms have hyperparameters which can cause a large variation in the training…

Machine Learning · Computer Science 2020-12-24 Qingyun Wu , Chi Wang , Silu Huang

Training and Hyperparameter Optimization (HPO) of deep learning-based AI models are often compute resource intensive and calls for the use of large-scale distributed resources as well as scalable and resource efficient hyperparameter search…

Data Analysis, Statistics and Probability · Physics 2023-03-28 Eric Wulff , Maria Girone , David Southwick , Juan Pablo García Amboage , Eduard Cuba

Despite the recent progress in hyperparameter optimization (HPO), available benchmarks that resemble real-world scenarios consist of a few and very large problem instances that are expensive to solve. This blocks researchers and…

Machine Learning · Computer Science 2019-11-26 Aaron Klein , Zhenwen Dai , Frank Hutter , Neil Lawrence , Javier Gonzalez

Multi-fidelity (gray-box) hyperparameter optimization techniques (HPO) have recently emerged as a promising direction for tuning Deep Learning methods. However, existing methods suffer from a sub-optimal allocation of the HPO budget to the…

Machine Learning · Computer Science 2023-06-02 Martin Wistuba , Arlind Kadra , Josif Grabocka