English
Related papers

Related papers: Meta Reinforcement Learning with Distribution of E…

200 papers

Deep Reinforcement Learning (DRL) algorithms have been successfully applied to a range of challenging control tasks. However, these methods typically suffer from three core difficulties: temporal credit assignment with sparse rewards, lack…

Machine Learning · Computer Science 2018-10-30 Shauharda Khadka , Kagan Tumer

Policy gradient reinforcement learning (RL) algorithms have achieved impressive performance in challenging learning tasks such as continuous control, but suffer from high sample complexity. Experience replay is a commonly used approach to…

Machine Learning · Statistics 2020-02-19 Saad Mohamad , Giovanni Montana

How to learn an effective reinforcement learning-based model for control tasks from high-level visual observations is a practical and challenging problem. A key to solving this problem is to learn low-dimensional state representations from…

Machine Learning · Computer Science 2022-12-27 Jianda Chen , Sinno Jialin Pan

Evolution Strategies (ES) have emerged as a scalable gradient-free alternative to reinforcement learning based LLM fine-tuning, but it remains unclear whether comparable task performance implies comparable solutions in parameter space. We…

Machine Learning · Computer Science 2026-04-03 William Hoy , Binxu Wang , Xu Pan

Reinforcement learning (RL) has been successfully applied to solve the problem of finding obstacle-free paths for autonomous agents operating in stochastic and uncertain environments. However, when the underlying stochastic dynamics of the…

Machine Learning · Computer Science 2024-10-29 Sheryl Paul , Jyotirmoy V. Deshmukh

Evolution Strategies (ES) have recently been demonstrated to be a viable alternative to reinforcement learning (RL) algorithms on a set of challenging deep RL problems, including Atari games and MuJoCo humanoid locomotion benchmarks. While…

Neural and Evolutionary Computing · Computer Science 2018-02-27 Patryk Chrabaszcz , Ilya Loshchilov , Frank Hutter

Model-free reinforcement learning algorithms can compute policy gradients given sampled environment transitions, but require large amounts of data. In contrast, model-based methods can use the learned model to generate new data, but model…

Machine Learning · Computer Science 2022-03-04 Lukas P. Fröhlich , Maksym Lefarov , Melanie N. Zeilinger , Felix Berkenkamp

Bayesian meta-learning enables robust and fast adaptation to new tasks with uncertainty assessment. The key idea behind Bayesian meta-learning is empirical Bayes inference of hierarchical model. In this work, we extend this framework to…

Machine Learning · Computer Science 2020-11-19 Yayi Zou , Xiaoqi Lu

We explore the capability of evolution strategies to train an agent with a policy based on a transformer architecture in a reinforcement learning setting. We performed experiments using OpenAI's highly parallelizable evolution strategy to…

Machine Learning · Computer Science 2025-07-31 Matyáš Lorenc , Roman Neruda

In addition to their undisputed success in solving classical optimization problems, neuroevolutionary and population-based algorithms have become an alternative to standard reinforcement learning methods. However, evolutionary methods often…

Neural and Evolutionary Computing · Computer Science 2021-05-18 Jörg Stork , Martin Zaefferer , Nils Eisler , Patrick Tichelmann , Thomas Bartz-Beielstein , A. E. Eiben

Meta reinforcement learning (meta-RL) extracts knowledge from previous tasks and achieves fast adaptation to new tasks. Despite recent progress, efficient exploration in meta-RL remains a key challenge in sparse-reward tasks, as it requires…

Artificial Intelligence · Computer Science 2021-11-15 Jin Zhang , Jianhao Wang , Hao Hu , Tong Chen , Yingfeng Chen , Changjie Fan , Chongjie Zhang

The policy gradient approach is a flexible and powerful reinforcement learning method particularly for problems with continuous actions such as robot control. A common challenge in this scenario is how to reduce the variance of policy…

Machine Learning · Computer Science 2013-01-18 Tingting Zhao , Hirotaka Hachiya , Voot Tangkaratt , Jun Morimoto , Masashi Sugiyama

Meta-reinforcement learning (meta-RL) aims to quickly solve new tasks by leveraging knowledge from prior tasks. However, previous studies often assume a single mode homogeneous task distribution, ignoring possible structured heterogeneity…

Machine Learning · Computer Science 2023-02-17 Zhendong Chu , Hongning Wang

Improving competent robot policies with on-policy RL is often hampered by noisy, low-signal gradients. We revisit Evolution Strategies (ES) as a policy-gradient proxy and localize exploration with bounded, antithetic triangular…

Machine Learning · Computer Science 2025-11-17 Ethan Hirschowitz , Fabio Ramos

In this paper, we try to improve exploration in Blackbox methods, particularly Evolution strategies (ES), when applied to Reinforcement Learning (RL) problems where intermediate waypoints/subgoals are available. Since Evolutionary…

Robotics · Computer Science 2023-07-04 Kiran Lekkala , Laurent Itti

Meta-reinforcement learning trains a single reinforcement learning agent on a distribution of tasks to quickly generalize to new tasks outside of the training set at test time. From a Bayesian perspective, one can interpret this as…

Machine Learning · Computer Science 2025-11-20 Joery A. de Vries , Jinke He , Mathijs M. de Weerdt , Matthijs T. J. Spaan

Modern machine learning uses more and more advanced optimization techniques to find optimal hyper parameters. Whenever the objective function is non-convex, non continuous and with potentially multiple local minima, standard gradient…

Machine Learning · Computer Science 2019-02-13 Eric Benhamou , Jamal Atif , Rida Laraki

With the rapid development of quantum computers, several applications are being proposed for them. Quantum simulations, simulation of chemical reactions, solution of optimization problems and quantum neural networks (QNNs) are some…

Quantum Physics · Physics 2023-03-02 Lucas Friedrich , Jonas Maziero

We consider reinforcement learning in input-driven environments, where an exogenous, stochastic input process affects the dynamics of the system. Input processes arise in many applications, including queuing systems, robotics control with…

Machine Learning · Computer Science 2019-02-28 Hongzi Mao , Shaileshh Bojja Venkatakrishnan , Malte Schwarzkopf , Mohammad Alizadeh

Exploration is a fundamental challenge in reinforcement learning (RL). Many of the current exploration methods for deep RL use task-agnostic objectives, such as information gain or bonuses based on state visitation. However, many practical…

Machine Learning · Computer Science 2018-02-21 Abhishek Gupta , Russell Mendonca , YuXuan Liu , Pieter Abbeel , Sergey Levine