中文
相关论文

相关论文: EX2: Exploration with Exemplar Models for Deep Rei…

200 篇论文

Robotics grasping refers to the task of making a robotic system pick an object by applying forces and torques on its surface. Despite the recent advances in data-driven approaches, grasping remains an unsolved problem. Most of the works on…

机器人学 · 计算机科学 2024-04-18 Johann Huber , Oumar Sane , Alex Coninx , Faiz Ben Amar , Stephane Doncieux

Efficient exploration is one of the key challenges for reinforcement learning (RL) algorithms. Most traditional sample efficiency bounds require strategic exploration. Recently many deep RL algorithms with simple heuristic exploration…

机器学习 · 计算机科学 2019-04-19 Yao Liu , Emma Brunskill

Model-based reinforcement learning (RL) is appealing because (i) it enables planning and thus more strategic exploration, and (ii) by decoupling dynamics from rewards, it enables fast transfer to new reward functions. However, learning an…

Exploration is critical for solving real-world decision-making problems such as scientific discovery, where the objective is to generate truly novel designs rather than mimic existing data distributions. In this work, we address the…

机器学习 · 计算机科学 2025-06-19 Riccardo De Santi , Marin Vlastelica , Ya-Ping Hsieh , Zebang Shen , Niao He , Andreas Krause

We study reinforcement learning from human feedback in general Markov decision processes, where agents learn from trajectory-level preference comparisons. A central challenge in this setting is to design algorithms that select informative…

机器学习 · 计算机科学 2025-12-05 Andreas Schlaginhaufen , Reda Ouhamma , Maryam Kamgarpour

Model-free continuous control for robot navigation tasks using Deep Reinforcement Learning (DRL) that relies on noisy policies for exploration is sensitive to the density of rewards. In practice, robots are usually deployed in cluttered…

机器人学 · 计算机科学 2023-02-24 Mingyu Cai , Erfan Aasi , Calin Belta , Cristian-Ioan Vasile

Exploration in reinforcement learning is a challenging problem: in the worst case, the agent must search for high-reward states that could be hidden anywhere in the state space. Can we define a more tractable class of RL problems, where the…

机器学习 · 计算机科学 2021-07-20 Kevin Li , Abhishek Gupta , Ashwin Reddy , Vitchyr Pong , Aurick Zhou , Justin Yu , Sergey Levine

Mastering deep reinforcement learning (DRL) proves challenging in tasks featuring scant rewards. These limited rewards merely signify whether the task is partially or entirely accomplished, necessitating various exploration actions before…

机器学习 · 计算机科学 2024-04-11 Guojian Wang , Faguo Wu , Xiao Zhang

Reinforcement learning algorithms typically consider discrete-time dynamics, even though the underlying systems are often continuous in time. In this paper, we introduce a model-based reinforcement learning algorithm that represents…

机器学习 · 计算机科学 2023-11-01 Lenart Treven , Jonas Hübotter , Bhavya Sukhija , Florian Dörfler , Andreas Krause

Deep model-based reinforcement learning methods offer a conceptually simple approach to the decision-making and control problem: use learning for the purpose of estimating an approximate dynamics model, and offload the rest of the work to…

机器学习 · 计算机科学 2023-07-13 Michael Janner

We introduce Robust Exploration via Clustering-based Online Density Estimation (RECODE), a non-parametric method for novelty-based exploration that estimates visitation counts for clusters of states based on their similarity in a chosen…

Acquiring abilities in the absence of a task-oriented reward function is at the frontier of reinforcement learning research. This problem has been studied through the lens of empowerment, which draws a connection between option discovery…

机器学习 · 计算机科学 2020-08-04 Víctor Campos , Alexander Trott , Caiming Xiong , Richard Socher , Xavier Giro-i-Nieto , Jordi Torres

In deep reinforcement learning (RL) tasks, an efficient exploration mechanism should be able to encourage an agent to take actions that lead to less frequent states which may yield higher accumulative future return. However, both knowing…

机器学习 · 计算机科学 2018-04-30 Haiyan Yin , Jianda Chen , Sinno Jialin Pan

We propose a general and model-free approach for Reinforcement Learning (RL) on real robotics with sparse rewards. We build upon the Deep Deterministic Policy Gradient (DDPG) algorithm to use demonstrations. Both demonstrations and actual…

Reinforcement learning provides an automated framework for learning behaviors from high-level reward specifications, but in practice the choice of reward function can be crucial for good results -- while in principle the reward only needs…

机器学习 · 计算机科学 2022-10-19 Abhishek Gupta , Aldo Pacchiano , Yuexiang Zhai , Sham M. Kakade , Sergey Levine

We tackle object category discovery, which is the problem of discovering and localizing novel objects in a large unlabeled dataset. While existing methods show results on datasets with less cluttered scenes and fewer object instances per…

计算机视觉与模式识别 · 计算机科学 2021-09-17 Sai Saketh Rambhatla , Rama Chellappa , Abhinav Shrivastava

One of the most critical challenges in deep reinforcement learning is to maintain the long-term exploration capability of the agent. To tackle this problem, it has been recently proposed to provide intrinsic rewards for the agent to…

机器学习 · 计算机科学 2022-06-02 Mingqi Yuan , Man-on Pun , Dong Wang

Most of the existing learning models, particularly deep neural networks, are reliant on large datasets whose hand-labeling is expensive and time demanding. A current trend is to make the learning of these models frugal and less dependent on…

计算机视觉与模式识别 · 计算机科学 2022-12-12 Sebastien Deschamps , Hichem Sahbi

Deep learning models frequently make incorrect predictions with high confidence when presented with test examples that are not well represented in their training dataset. We propose a novel and straightforward approach to estimate…

机器学习 · 计算机科学 2019-10-04 Tiago Ramalho , Miguel Miranda

Consider learning a policy purely on the basis of demonstrated behavior -- that is, with no access to reinforcement signals, no knowledge of transition dynamics, and no further interaction with the environment. This *strictly batch…

机器学习 · 统计学 2021-01-15 Daniel Jarrett , Ioana Bica , Mihaela van der Schaar