English
Related papers

Related papers: Fast Population-Based Reinforcement Learning on a …

200 papers

Neural networks dominate the modern machine learning landscape, but their training and success still suffer from sensitivity to empirical choices of hyperparameters such as model architecture, loss function, and optimisation algorithm. In…

The successful training of neural networks typically involves careful and time consuming hyperparameter tuning. Population Based Training (PBT) has recently been proposed to automate this process. PBT trains a population of neural networks…

Neural and Evolutionary Computing · Computer Science 2021-09-29 Valentin Dalibard , Max Jaderberg

Hyperparameter optimization plays a key role in the machine learning domain. Its significance is especially pronounced in reinforcement learning (RL), where agents continuously interact with and adapt to their environments, requiring…

Machine Learning · Computer Science 2024-04-24 Hui Bai , Ran Cheng

Reinforcement learning (RL) offers the potential for training generally capable agents that can interact autonomously in the real world. However, one key limitation is the brittleness of RL algorithms to core hyperparameters and network…

Machine Learning · Computer Science 2022-07-20 Xingchen Wan , Cong Lu , Jack Parker-Holder , Philip J. Ball , Vu Nguyen , Binxin Ru , Michael A. Osborne

We present a simple, sample-efficient algorithm for introducing large but directed learning steps in reinforcement learning (RL), through the use of evolutionary operators. The methodology uses a population of RL agents training with a…

Neural and Evolutionary Computing · Computer Science 2023-05-15 Harshad Khadilkar

Despite a series of recent successes in reinforcement learning (RL), many RL algorithms remain sensitive to hyperparameters. As such, there has recently been interest in the field of AutoRL, which seeks to automate design decisions to…

Machine Learning · Computer Science 2021-07-01 Jack Parker-Holder , Vu Nguyen , Shaan Desai , Stephen Roberts

Population-based learning paradigms, including evolutionary strategies, Population-Based Training (PBT), and recent model-merging methods, combine fast within-model optimisation with slower population-level adaptation. Despite their…

Machine Learning · Computer Science 2026-03-26 Giacomo Borghi , Hyesung Im , Lorenzo Pareschi

We consider the problem of efficiently simulating population protocols. In the population model, we are given a distributed system of $n$ agents modeled as identical finite-state machines. In each time step, a pair of agents is selected…

Data Structures and Algorithms · Computer Science 2020-05-08 Petra Berenbrink , David Hammer , Dominik Kaaser , Ulrich Meyer , Manuel Penschuck , Hung Tran

Reinforcement Learning (RL) is an effective tool for controller design but can struggle with issues of robustness, failing catastrophically when the underlying system dynamics are perturbed. The Robust RL formulation tackles this by adding…

Machine Learning · Computer Science 2020-09-24 Eugene Vinitsky , Yuqing Du , Kanaad Parvate , Kathy Jang , Pieter Abbeel , Alexandre Bayen

Recent advances in machine learning are consistently enabled by increasing amounts of computation. Reinforcement learning (RL) and population-based methods in particular pose unique challenges for efficiency and flexibility to the…

Machine Learning · Computer Science 2020-03-26 Jiale Zhi , Rui Wang , Jeff Clune , Kenneth O. Stanley

The tuning of hyperparameters in reinforcement learning (RL) is critical, as these parameters significantly impact an agent's performance and learning efficiency. Dynamic adjustment of hyperparameters during the training process can…

Machine Learning · Computer Science 2024-09-05 Felix Pfeiffer , Shahram Eivazi

Population Based Training (PBT) is a recent approach that jointly optimizes neural network weights and hyperparameters which periodically copies weights of the best performers and mutates hyperparameters during training. Previous PBT…

Artificial Intelligence · Computer Science 2022-02-01 Ang Li , Aleksandra Spyra , Sagi Perel , Valentin Dalibard , Max Jaderberg , Chenjie Gu , David Budden , Tim Harley , Pramod Gupta

In recent years, deep reinforcement learning (RL) has shown its effectiveness in solving complex continuous control tasks. However, this comes at the cost of an enormous amount of experience required for training, exacerbated by the…

Applying reinforcement learning (RL) to combinatorial optimization problems is attractive as it removes the need for expert knowledge or pre-solved instances. However, it is unrealistic to expect an agent to solve these (often NP-)hard…

Artificial Intelligence · Computer Science 2023-11-15 Nathan Grinsztajn , Daniel Furelos-Blanco , Shikha Surana , Clément Bonnet , Thomas D. Barrett

Many of the recent triumphs in machine learning are dependent on well-tuned hyperparameters. This is particularly prominent in reinforcement learning (RL) where a small change in the configuration can lead to failure. Despite the importance…

Machine Learning · Computer Science 2021-06-07 Jack Parker-Holder , Vu Nguyen , Stephen Roberts

Reinforcement Learning's high sensitivity to hyperparameters is a source of instability and inefficiency, creating significant challenges for practitioners. Hyperparameter Optimization (HPO) algorithms have been developed to address this…

Machine Learning · Computer Science 2025-07-18 Waël Doulazmi , Auguste Lehuger , Marin Toromanoff , Valentin Charraut , Thibault Buhet , Fabien Moutarde

We present a rapid design methodology that combines automated hyper-parameter tuning with semi-supervised training to build highly accurate and robust models for voice commands classification. Proposed approach allows quick evaluation of…

Audio and Speech Processing · Electrical Eng. & Systems 2019-05-13 Oguz H. Elibol , Gokce Keskin , Anil Thomas

Reinforcement learning is able to solve complex sequential decision-making tasks but is currently limited by sample efficiency and required computation. To improve sample efficiency, recent work focuses on model-based RL which interleaves…

Machine Learning · Computer Science 2023-06-19 Yi Zhao , Wenshuai Zhao , Rinu Boney , Juho Kannala , Joni Pajarinen

While off-policy reinforcement learning (RL) algorithms are sample efficient due to gradient-based updates and data reuse in the replay buffer, they struggle with convergence to local optima due to limited exploration. On the other hand,…

Machine Learning · Computer Science 2023-05-05 Bowen Zheng , Ran Cheng

We study the problem of training a Reinforcement Learning (RL) agent that is collaborative with humans without using any human data. Although such agents can be obtained through self-play training, they can suffer significantly from…

Artificial Intelligence · Computer Science 2022-06-28 Rui Zhao , Jinming Song , Yufeng Yuan , Hu Haifeng , Yang Gao , Yi Wu , Zhongqian Sun , Yang Wei
‹ Prev 1 2 3 10 Next ›