中文
相关论文

相关论文: EX2: Exploration with Exemplar Models for Deep Rei…

200 篇论文

Incorporating prior knowledge in reinforcement learning algorithms is mainly an open question. Even when insights about the environment dynamics are available, reinforcement learning is traditionally used in a tabula rasa setting and must…

机器学习 · 计算机科学 2021-11-09 Toby Johnstone , Nathan Grinsztajn , Johan Ferret , Philippe Preux

Partial observability is a common challenge in many reinforcement learning applications, which requires an agent to maintain memory, infer latent states, and integrate this past information into exploration. This challenge leads to a number…

机器学习 · 计算机科学 2020-10-27 Chi Jin , Sham M. Kakade , Akshay Krishnamurthy , Qinghua Liu

Exploration is critical for deep reinforcement learning in complex environments with high-dimensional observations and sparse rewards. To address this problem, recent approaches proposed to leverage intrinsic rewards to improve exploration,…

机器学习 · 计算机科学 2022-11-11 Mingqi Yuan , Bo Li , Xin Jin , Wenjun Zeng

Exploration is widely regarded as one of the most challenging aspects of reinforcement learning (RL), with many naive approaches succumbing to exponential sample complexity. To isolate the challenges of exploration, we propose a new…

机器学习 · 计算机科学 2020-02-10 Chi Jin , Akshay Krishnamurthy , Max Simchowitz , Tiancheng Yu

One of the remaining challenges in reinforcement learning is to develop agents that can generalise to novel scenarios they might encounter once deployed. This challenge is often framed in a multi-task setting where agents train on a fixed…

机器学习 · 计算机科学 2024-09-19 Max Weltevrede , Felix Kaubek , Matthijs T. J. Spaan , Wendelin Böhmer

Exploration remains a critical challenge in online reinforcement learning, as an agent must effectively explore unknown environments to achieve high returns. Currently, the main exploration algorithms are primarily count-based methods and…

机器学习 · 计算机科学 2025-05-19 Zhirui Fang , Kai Yang , Jian Tao , Jiafei Lyu , Lusong Li , Li Shen , Xiu Li

Current approaches to novelty or anomaly detection are based on deep neural networks. Despite their effectiveness, neural networks are also vulnerable to imperceptible deformations of the input data. This is a serious issue in critical…

计算机视觉与模式识别 · 计算机科学 2023-06-07 Ranya Almohsen , Shivang Patel , Donald A. Adjeroh , Gianfranco Doretto

In actor-critic-based reinforcement learning algorithms such as Twin Delayed Deep Deterministic policy gradient (TD3), insufficient exploration of the spatial space can result in suboptimal policies when controlling 7-DOF robotic arms. To…

机器人学 · 计算机科学 2024-08-27 Wen-Han Hsieh , Jen-Yuan Chang

Evolutionary Computation (EC) has been shown to be able to quickly train Deep Artificial Neural Networks (DNNs) to solve Reinforcement Learning (RL) problems. While a Genetic Algorithm (GA) is well-suited for exploiting reward functions…

神经与进化计算 · 计算机科学 2022-09-09 Eyal Segal , Moshe Sipper

Traditional models of category learning in psychology focus on representation at the category level as opposed to the stimulus level, even though the two are likely to interact. The stimulus representations employed in such models are…

计算机视觉与模式识别 · 计算机科学 2020-07-20 Pulkit Singh , Joshua C. Peterson , Ruairidh M. Battleday , Thomas L. Griffiths

This work presents a case study of a learning-based approach for target driven map-less navigation. The underlying navigation model is an end-to-end neural network which is trained using a combination of expert demonstrations, imitation…

机器人学 · 计算机科学 2018-09-03 Mark Pfeiffer , Samarth Shukla , Matteo Turchetta , Cesar Cadena , Andreas Krause , Roland Siegwart , Juan Nieto

Solving sparse reward tasks through exploration is one of the major challenges in deep reinforcement learning, especially in three-dimensional, partially-observable environments. Critically, the algorithm proposed in this article uses a…

人工智能 · 计算机科学 2021-06-18 Gabriele Libardi , Gianni De Fabritiis

We study the problem of sample efficient reinforcement learning, where prior data such as demonstrations are provided for initialization in lieu of a dense reward signal. A natural approach is to incorporate an imitation learning objective,…

机器学习 · 计算机科学 2025-06-10 Perry Dong , Alec M. Lessing , Annie S. Chen , Chelsea Finn

Count-based exploration algorithms are known to perform near-optimally when used in conjunction with tabular reinforcement learning (RL) methods for solving small discrete Markov decision processes (MDPs). It is generally thought that…

人工智能 · 计算机科学 2017-12-06 Haoran Tang , Rein Houthooft , Davis Foote , Adam Stooke , Xi Chen , Yan Duan , John Schulman , Filip De Turck , Pieter Abbeel

Exploration is a key problem in reinforcement learning, since agents can only learn from data they acquire in the environment. With that in mind, maintaining a population of agents is an attractive method, as it allows data be collected…

机器学习 · 计算机科学 2020-10-08 Jack Parker-Holder , Aldo Pacchiano , Krzysztof Choromanski , Stephen Roberts

In this work we consider partially observable environments with sparse rewards. We present a self-supervised representation learning method for image-based observations, which arranges embeddings respecting temporal distance of…

机器学习 · 计算机科学 2020-10-07 Aleksandr Ermolov , Nicu Sebe

Actor-critic (AC) algorithms are a class of model-free deep reinforcement learning algorithms, which have proven their efficacy in diverse domains, especially in solving continuous control problems. Improvement of exploration (action…

机器学习 · 计算机科学 2022-10-04 Chayan Banerjee , Zhiyong Chen , Nasimul Noman

Evolutionary algorithms, such as Differential Evolution, excel in solving real-parameter optimization challenges. However, the effectiveness of a single algorithm varies across different problem instances, necessitating considerable efforts…

神经与进化计算 · 计算机科学 2024-03-08 Hongshu Guo , Yining Ma , Zeyuan Ma , Jiacheng Chen , Xinglin Zhang , Zhiguang Cao , Jun Zhang , Yue-Jiao Gong

We present a modular approach to reinforcement learning that uses a Bayesian representation of the uncertainty over models. The approach, BOSS (Best of Sampled Set), drives exploration by sampling multiple models from the posterior and…

机器学习 · 计算机科学 2012-05-14 John Asmuth , Lihong Li , Michael L. Littman , Ali Nouri , David Wingate

The infamous exploration-exploitation dilemma is one of the oldest and most important problems in reinforcement learning (RL). Deliberate and effective exploration is necessary for RL agents to succeed in most environments. However, until…

人工智能 · 计算机科学 2017-10-09 Suraj Narayanan Sasikumar