English
Related papers

Related papers: Remember to be Curious: Episodic Context and Persi…

200 papers

Model-based Reinforcement Learning approaches have the promise of being sample efficient. Much of the progress in learning dynamics models in RL has been made by learning models via supervised learning. But traditional model-based…

Machine Learning · Computer Science 2019-06-12 Shagun Sodhani , Anirudh Goyal , Tristan Deleu , Yoshua Bengio , Sergey Levine , Jian Tang

Exploration in high-dimensional, continuous spaces with sparse rewards is an open problem in reinforcement learning. Artificial curiosity algorithms address this by creating rewards that lead to exploration. Given a reinforcement learning…

Machine Learning · Computer Science 2023-11-08 Alexander Nedergaard , Matthew Cook

Despite groundbreaking progress in reinforcement learning for robotics, gameplay, and other complex domains, major challenges remain in applying reinforcement learning to the evolving, open-world problems often found in critical application…

Exploration in environments with sparse rewards is difficult for artificial agents. Curiosity driven learning -- using feed-forward prediction errors as intrinsic rewards -- has achieved some success in these scenarios, but fails when faced…

Machine Learning · Computer Science 2024-07-08 Augustine N. Mavor-Parker , Kimberly A. Young , Caswell Barry , Lewis D. Griffin

Efficient exploration in deep cooperative multi-agent reinforcement learning (MARL) still remains challenging in complex coordination problems. In this paper, we introduce a novel Episodic Multi-agent reinforcement learning with…

Machine Learning · Computer Science 2021-11-23 Lulu Zheng , Jiarui Chen , Jianhao Wang , Jiamin He , Yujing Hu , Yingfeng Chen , Changjie Fan , Yang Gao , Chongjie Zhang

We consider the problem of reinforcement learning under safety requirements, in which an agent is trained to complete a given task, typically formalized as the maximization of a reward signal over time, while concurrently avoiding…

Machine Learning · Computer Science 2018-09-25 Tu-Hoa Pham , Giovanni De Magistris , Don Joven Agravante , Subhajit Chaudhury , Asim Munawar , Ryuki Tachibana

Learning to navigate unknown environments from scratch is a challenging problem. This work presents a system that integrates world models with curiosity-driven exploration for autonomous navigation in new environments. We evaluate…

Robotics · Computer Science 2023-09-19 Daria de Tinguy , Sven Remmery , Pietro Mazzaglia , Tim Verbelen , Bart Dhoedt

We are witnessing significant progress on perception models, specifically those trained on large-scale internet images. However, efficiently generalizing these perception models to unseen embodied tasks is insufficiently studied, which will…

Robotics · Computer Science 2023-03-21 Ya Jing , Tao Kong

Reinforcement Learning (RL) agents often struggle with inefficient exploration, particularly in environments with sparse rewards. Traditional exploration strategies can lead to slow learning and suboptimal performance because agents fail to…

Machine Learning · Computer Science 2026-03-31 Gaurav Chaudhary , Laxmidhar Behera , Washim Uddin Mondal

As robotics continues to advance, the need for adaptive and continuously-learning embodied agents increases, particularly in the realm of assistance robotics. Quick adaptability and long-term information retention are essential to operate…

Computer Vision and Pattern Recognition · Computer Science 2024-06-05 Paolo Cudrano , Xiaoyu Luo , Matteo Matteucci

Teaching an agent to navigate in an unseen 3D environment is a challenging task, even in the event of simulated environments. To generalize to unseen environments, an agent needs to be robust to low-level variations (e.g. color, texture,…

Machine Learning · Computer Science 2018-04-10 Yi Wu , Yuxin Wu , Georgia Gkioxari , Yuandong Tian

Reinforcement learning with sparse rewards is challenging because an agent can rarely obtain non-zero rewards and hence, gradient-based optimization of parameterized policies can be incremental and slow. Recent work demonstrated that using…

Machine Learning · Computer Science 2021-02-16 Yijie Guo , Jongwook Choi , Marcin Moczulski , Shengyu Feng , Samy Bengio , Mohammad Norouzi , Honglak Lee

An agent learning through interactions should balance its action selection process between probing the environment to discover new rewards and using the information acquired in the past to adopt useful behaviour. This trade-off is usually…

Machine Learning · Computer Science 2019-07-02 Lucas Beyer , Damien Vincent , Olivier Teboul , Sylvain Gelly , Matthieu Geist , Olivier Pietquin

When deployed, AI agents will encounter problems that are beyond their autonomous problem-solving capabilities. Leveraging human assistance can help agents overcome their inherent limitations and robustly cope with unfamiliar situations. We…

Machine Learning · Computer Science 2022-06-24 Khanh Nguyen , Yonatan Bisk , Hal Daumé

Efficient exploration is an unsolved problem in Reinforcement Learning which is usually addressed by reactively rewarding the agent for fortuitously encountering novel situations. This paper introduces an efficient active exploration…

Machine Learning · Computer Science 2019-06-17 Pranav Shyam , Wojciech Jaśkowski , Faustino Gomez

While offline reinforcement learning provides reliable policies for real-world deployment, its inherent pessimism severely restricts an agent's ability to explore and collect novel data online. Drawing inspiration from safe reinforcement…

Machine Learning · Computer Science 2026-03-20 Amirhossein Roknilamouki , Arnob Ghosh , Eylem Ekici , Ness B. Shroff

Episodic memory is a psychology term which refers to the ability to recall specific events from the past. We suggest one advantage of this particular type of memory is the ability to easily assign credit to a specific state when remembered…

Machine Learning · Computer Science 2018-06-05 Kenny J. Young , Richard S. Sutton , Shuo Yang

Episodic self-imitation learning, a novel self-imitation algorithm with a trajectory selection module and an adaptive loss function, is proposed to speed up reinforcement learning. Compared to the original self-imitation learning algorithm,…

Artificial Intelligence · Computer Science 2020-11-30 Tianhong Dai , Hengyan Liu , Anil Anthony Bharath

Spatial reasoning requires both location-bound computation and location-invariant structure: agents must make local moves while preserving route, object, or constraint-level plans. We propose interaction locality, a task-geometry-aware…

Artificial Intelligence · Computer Science 2026-05-21 Yosuke Miyanishi , Tetsuro Morimura

One effective approach for equipping artificial agents with sensorimotor skills is to use self-exploration. To do this efficiently is critical, as time and data collection are costly. In this study, we propose an exploration mechanism that…

Robotics · Computer Science 2021-02-18 Melisa Sener , Yukie Nagai , Erhan Oztop , Emre Ugur