English
Related papers

Related papers: Hyperparameters in Contextual RL are Highly Situat…

200 papers

The aim of my Ph.D. thesis concerns Reasoning in Highly Reactive Environments. As reasoning in highly reactive environments, we identify the setting in which a knowledge-based agent, with given goals, is deployed in an environment subject…

Artificial Intelligence · Computer Science 2019-09-19 Francesco Pacenza

Optimal setting of several hyper-parameters in machine learning algorithms is key to make the most of available data. To this aim, several methods such as evolutionary strategies, random search, Bayesian optimization and heuristic rules of…

Machine Learning · Computer Science 2021-12-16 Juan Cruz Barsce , Jorge A. Palombarini , Ernesto C. Martínez

Reinforcement Learning and, recently, Deep Reinforcement Learning are popular methods for solving sequential decision-making problems modeled as Markov Decision Processes. RL modeling of a problem and selecting algorithms and…

Machine Learning · Computer Science 2026-03-10 Reza Refaei Afshar , Joaquin Vanschoren , Uzay Kaymak , Rui Zhang , Yaoxin Wu , Wen Song , Yingqian Zhang

Real-world reinforcement learning (RL) environments, whether in robotics or industrial settings, often involve non-visual observations and require not only efficient but also reliable and thus interpretable and flexible RL approaches. To…

Machine Learning · Computer Science 2024-02-19 Moritz Lange , Noah Krystiniak , Raphael C. Engelhardt , Wolfgang Konen , Laurenz Wiskott

Hyperparameter sensitivity in Deep Reinforcement Learning (RL) is often accepted as unavoidable. However, it remains unclear whether it is intrinsic to the RL problem or exacerbated by specific training mechanisms. We investigate this…

Machine Learning · Computer Science 2026-02-06 Jan Malte Töpperwien , Aditya Mohan , Marius Lindauer

Hyperparameter optimization (HPO) plays a critical role in improving model performance. Transformer-based HPO methods have shown great potential; however, existing approaches rely heavily on large-scale historical optimization trajectories…

Machine Learning · Computer Science 2025-09-23 Haoxin Guo , Jiawen Pan , Weixin Zhai

While reinforcement learning algorithms can learn effective policies for complex tasks, these policies are often brittle to even minor task variations, especially when variations are not explicitly provided during training. One natural…

Machine Learning · Computer Science 2020-12-09 Saurabh Kumar , Aviral Kumar , Sergey Levine , Chelsea Finn

Robust reinforcement learning (RL) aims to learn policies that remain effective despite uncertainties in its environment, which frequently arise in real-world applications due to variations in environment dynamics. The robust RL methods…

Machine Learning · Computer Science 2025-05-30 Linh Le Pham Van , Minh Hoang Nguyen , Hung Le , Hung The Tran , Sunil Gupta

Reinforcement learning (RL) algorithms have proven transformative in a range of domains. To tackle real-world domains, these systems often use neural networks to learn policies directly from pixels or other high-dimensional sensory input.…

Machine Learning · Computer Science 2025-10-02 Nishil Patel , Sebastian Lee , Stefano Sarao Mannelli , Sebastian Goldt , Andrew Saxe

We propose a novel approach to address one aspect of the non-stationarity problem in multi-agent reinforcement learning (RL), where the other agents may alter their policies due to environment changes during execution. This violates the…

Machine Learning · Computer Science 2019-12-03 Yixiang Wang , Feng Wu

Reliable real-world deployment of reinforcement learning (RL) methods requires a nuanced understanding of their strengths and weaknesses and how they compare to those of humans. Human-machine systems are becoming more prevalent and the…

Artificial Intelligence · Computer Science 2024-05-21 Eric Pulick , Vladimir Menkov , Yonatan Mintz , Paul Kantor , Vicki Bier

Reinforcement learning (RL) has been used in a range of simulated real-world tasks, e.g., sensor coordination, traffic light control, and on-demand mobility services. However, real world deployments are rare, as RL struggles with dynamic…

Machine Learning · Computer Science 2021-12-02 Alberto Castagna , Ivana Dusparic

Several applications in the scientific simulation of physical systems can be formulated as control/optimization problems. The computational models for such systems generally contain hyperparameters, which control solution fidelity and…

Computational Physics · Physics 2020-12-09 Suraj Pawar , Romit Maulik

Hyperparameter selection in continual learning scenarios is a challenging and underexplored aspect, especially in practical non-stationary environments. Traditional approaches, such as grid searches with held-out validation data from all…

Machine Learning · Computer Science 2024-06-21 Rudy Semola , Julio Hurtado , Vincenzo Lomonaco , Davide Bacciu

Unlike reinforcement learning (RL) agents, humans remain capable multitaskers in changing environments. In spite of only experiencing the world through their own observations and interactions, people know how to balance focusing on tasks…

Artificial Intelligence · Computer Science 2024-07-02 Rishav Bhagat , Jonathan Balloch , Zhiyu Lin , Julia Kim , Mark Riedl

Reinforcement learning (RL) studies how an agent comes to achieve reward in an environment through interactions over time. Recent advances in machine RL have surpassed human expertise at the world's oldest board games and many classic video…

Artificial Intelligence · Computer Science 2021-07-28 Pedro A. Tsividis , Joao Loula , Jake Burga , Nathan Foss , Andres Campero , Thomas Pouncy , Samuel J. Gershman , Joshua B. Tenenbaum

Reinforcement learning (RL) methods have been shown to be capable of learning intelligent behavior in rich domains. However, this has largely been done in simulated domains without adequate focus on the process of building the simulator. In…

Machine Learning · Computer Science 2019-10-24 Aditya Modi , Nan Jiang , Ambuj Tewari , Satinder Singh

Deep reinforcement learning (deep RL) has achieved tremendous success on various domains through a combination of algorithmic design and careful selection of hyper-parameters. Algorithmic improvements are often the result of iterative…

Machine Learning · Computer Science 2024-12-02 Johan Obando-Ceron , João G. M. Araújo , Aaron Courville , Pablo Samuel Castro

In recent years, on-policy reinforcement learning (RL) has been successfully applied to many different continuous control tasks. While RL algorithms are often conceptually simple, their state-of-the-art implementations take numerous low-…

Adapting a Reinforcement Learning (RL) agent to an unseen environment is a difficult task due to typical over-fitting on the training environment. RL agents are often capable of solving environments very close to the trained environment,…

Artificial Intelligence · Computer Science 2022-07-04 Olivier Moulin , Vincent Francois-Lavet , Paul Elbers , Mark Hoogendoorn