English
Related papers

Related papers: Tuning Mixed Input Hyperparameters on the Fly for …

200 papers

We study a budgeted hyper-parameter tuning problem, where we optimize the tuning result under a hard resource constraint. We propose to solve it as a sequential decision making problem, such that we can use the partial training progress of…

Machine Learning · Computer Science 2019-02-05 Zhiyun Lu , Chao-Kai Chiang , Fei Sha

Automated algorithm selection and hyperparameter tuning facilitates the application of machine learning. Traditional multi-armed bandit strategies look to the history of observed rewards to identify the most promising arms for optimizing…

Machine Learning · Computer Science 2020-05-29 Mischa Schmidt , Julia Gastinger , Sébastien Nicolas , Anett Schülke

Reinforcement Learning (RL) algorithms suffer from the dependency on accurately engineered reward functions to properly guide the learning agents to do the required tasks. Preference-based reinforcement learning (PbRL) addresses that by…

Artificial Intelligence · Computer Science 2024-08-23 Youssef Abdelkareem , Shady Shehata , Fakhri Karray

The rapid advancement in large language models (LLMs) has brought forth a diverse range of models with varying capabilities that excel in different tasks and domains. However, selecting the optimal LLM for user queries often involves a…

Machine Learning · Computer Science 2025-02-06 Yang Li

Reinforcement learning (RL)-based quadrotor control policies have achieved impressive performance in tasks such as fast navigation in cluttered environments and drone racing, where the focus is on speed and agility. However, in several…

Many optimizers have been proposed for training deep neural networks, and they often have multiple hyperparameters, which make it tricky to benchmark their performance. In this work, we propose a new benchmarking protocol to evaluate both…

Machine Learning · Computer Science 2020-10-21 Yuanhao Xiong , Xuanqing Liu , Li-Cheng Lan , Yang You , Si Si , Cho-Jui Hsieh

Deep neural networks have seen great success in recent years; however, training a deep model is often challenging as its performance heavily depends on the hyper-parameters used. In addition, finding the optimal hyper-parameter…

We study human-in-the-loop reinforcement learning (RL) with trajectory preferences, where instead of receiving a numeric reward at each step, the agent only receives preferences over trajectory pairs from a human overseer. The goal of the…

Machine Learning · Computer Science 2022-05-25 Xiaoyu Chen , Han Zhong , Zhuoran Yang , Zhaoran Wang , Liwei Wang

This paper explores the combination of Reinforcement Learning (RL) and search-based path planners to speed up the optimization of flight paths for airliners, where in case of emergency a fast route re-calculation can be crucial. The…

Artificial Intelligence · Computer Science 2026-02-13 Alberto Luise , Michele Lombardi , Florent Teichteil Koenigsbuch

Varying data augmentation policies and regularization over the course of optimization has led to performance improvements over using fixed values. We show that population based training is a useful tool to continuously search those…

Computation and Language · Computer Science 2020-10-09 Daniel Haziza , Jérémy Rapin , Gabriel Synnaeve

Reinforcement learning (RL) shows great potential in sequential decision-making. At present, mainstream RL algorithms are data-driven, which usually yield better asymptotic performance but much slower convergence compared with model-driven…

Machine Learning · Computer Science 2024-02-27 Yang Guan , Jingliang Duan , Shengbo Eben Li , Jie Li , Jianyu Chen , Bo Cheng

Meta-learning models, or models that learn to learn, have been a long-desired target for their ability to quickly solve new tasks. Traditional meta-learning methods can require expensive inner and outer loops, thus there is demand for…

Neural and Evolutionary Computing · Computer Science 2021-03-12 Kevin Frans , Olaf Witkowski

To integrate into human-centered environments, autonomous agents must learn from and adapt to humans in their native settings. Preference-based reinforcement learning (PbRL) can enable this by learning reward functions from human…

There has been significant progress in deep reinforcement learning (RL) in recent years. Nevertheless, finding suitable hyperparameter configurations and reward functions remains challenging even for experts, and performance heavily relies…

Machine Learning · Computer Science 2024-10-10 Julian Dierkes , Emma Cramer , Holger H. Hoos , Sebastian Trimpe

Computational efficiency is an important consideration for deploying machine learning models for time series prediction in an online setting. Machine learning algorithms adjust model parameters automatically based on the data, but often…

Machine Learning · Computer Science 2018-11-05 Hongyuan Zhan , Gabriel Gomes , Xiaoye S. Li , Kamesh Madduri , Kesheng Wu

We develop a hyperparameter optimisation algorithm, Automated Budget Constrained Training (AutoBCT), which balances the quality of a model with the computational cost required to tune it. The relationship between hyperparameters, model…

Machine Learning · Statistics 2024-02-06 Lukas Cironis , Jan Palczewski , Georgios Aivaliotis

Reinforcement Learning and, recently, Deep Reinforcement Learning are popular methods for solving sequential decision-making problems modeled as Markov Decision Processes. RL modeling of a problem and selecting algorithms and…

Machine Learning · Computer Science 2026-03-10 Reza Refaei Afshar , Joaquin Vanschoren , Uzay Kaymak , Rui Zhang , Yaoxin Wu , Wen Song , Yingqian Zhang

Offline reinforcement learning (RL) algorithms are applied to learn performant, well-generalizing policies when provided with a static dataset of interactions. Many recent approaches to offline RL have seen substantial success, but with one…

Machine Learning · Computer Science 2024-07-30 Padmanaba Srinivasan , William Knottenbelt

Hyperparameter tuning is an omnipresent problem in machine learning as it is an integral aspect of obtaining the state-of-the-art performance for any model. Most often, hyperparameters are optimized just by training a model on a grid of…

Machine Learning · Computer Science 2019-06-28 Hadi S. Jomaa , Josif Grabocka , Lars Schmidt-Thieme

Reinforcement learning (RL) algorithms for real-world robotic applications need a data-efficient learning process and the ability to handle complex, unknown dynamical systems. These requirements are handled well by model-based and…

Robotics · Computer Science 2017-06-20 Yevgen Chebotar , Karol Hausman , Marvin Zhang , Gaurav Sukhatme , Stefan Schaal , Sergey Levine