English
Related papers

Related papers: Go Beyond Imagination: Maximizing Episodic Reachab…

200 papers

We address the problem of efficient exploration for transition model learning in the relational model-based reinforcement learning setting without extrinsic goals or rewards. Inspired by human curiosity, we propose goal-literal babbling…

Artificial Intelligence · Computer Science 2020-12-10 Rohan Chitnis , Tom Silver , Joshua Tenenbaum , Leslie Pack Kaelbling , Tomas Lozano-Perez

Under sparse extrinsic reward settings, reinforcement learning has remained challenging, despite surging interests in this field. Previous attempts suggest that intrinsic reward can alleviate the issue caused by sparsity. In this article,…

Machine Learning · Computer Science 2023-06-28 Zijian Gao , Kele Xu , Yuanzhao Zhai , Dawei Feng , Bo Ding , XinJun Mao , Huaimin Wang

Sample efficiency has been one of the major challenges for deep reinforcement learning. Recently, model-based reinforcement learning has been proposed to address this challenge by performing planning on imaginary trajectories with a learned…

Machine Learning · Computer Science 2020-10-26 Guangxiang Zhu , Minghao Zhang , Honglak Lee , Chongjie Zhang

A new interpretable experiential learning model based on state history and global feedback is presented. It is capable of learning a behavioral model represented by a transition graph between sets of states, with transitions attributed with…

Machine Learning · Computer Science 2026-05-05 Anton Kolonin

When there exists an unlearnable source of randomness (noisy-TV) in the environment, a naively intrinsic reward driven exploring agent gets stuck at that source of randomness and fails at exploration. Intrinsic reward based on uncertainty…

Machine Learning · Computer Science 2026-04-06 Zhibo Hou , Zhiyu An , Wan Du

Interactive-Grounded Learning (IGL) [Xie et al., 2021] is a powerful framework in which a learner aims at maximizing unobservable rewards through interacting with an environment and observing reward-dependent feedback on the taken actions.…

Machine Learning · Computer Science 2024-06-03 Mengxiao Zhang , Yuheng Zhang , Haipeng Luo , Paul Mineiro

A promising technique for exploration is to maximize the entropy of visited state distribution, i.e., state entropy, by encouraging uniform coverage of visited state space. While it has been effective for an unsupervised setup, it tends to…

Machine Learning · Computer Science 2024-08-12 Dongyoung Kim , Jinwoo Shin , Pieter Abbeel , Younggyo Seo

Large reasoning models that use long chain-of-thought excel at problem-solving yet waste compute on redundant checks. Curbing this overthinking is hard: training-time length penalties can cripple ability, while inference-time early-exit…

Artificial Intelligence · Computer Science 2026-04-21 Benteng Chen , Weida Wang , Shufei Zhang , Mingbao Lin , Min Zhang

Maximum entropy reinforcement learning integrates exploration into policy learning by providing additional intrinsic rewards proportional to the entropy of some distribution. In this paper, we propose a novel approach in which the intrinsic…

Machine Learning · Computer Science 2025-09-30 Adrien Bolland , Gaspard Lambrechts , Damien Ernst

Exploration in environments with sparse rewards has been a persistent problem in reinforcement learning (RL). Many tasks are natural to specify with a sparse reward, and manually shaping a reward function can result in suboptimal…

Machine Learning · Computer Science 2018-02-27 Ashvin Nair , Bob McGrew , Marcin Andrychowicz , Wojciech Zaremba , Pieter Abbeel

Models capable of "thinking with images" by dynamically grounding their reasoning in visual evidence represent a major leap in multimodal AI. However, replicating and advancing this ability is non-trivial, with current methods often trapped…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Zhaoyang Wei , Wenchao Ding , Yanchao Hao , Xi Chen

Unsupervised skill learning objectives (Gregor et al., 2016, Eysenbach et al., 2018) allow agents to learn rich repertoires of behavior in the absence of extrinsic rewards. They work by simultaneously training a policy to produce…

Machine Learning · Computer Science 2022-05-13 DJ Strouse , Kate Baumli , David Warde-Farley , Vlad Mnih , Steven Hansen

One principled approach for provably efficient exploration is incorporating the upper confidence bound (UCB) into the value function as a bonus. However, UCB is specified to deal with linear and tabular settings and is incompatible with…

Machine Learning · Computer Science 2021-05-18 Chenjia Bai , Lingxiao Wang , Lei Han , Jianye Hao , Animesh Garg , Peng Liu , Zhaoran Wang

World model based planning has significantly improved decision-making in complex environments by enabling agents to simulate future states and make informed choices. This computational burden is particularly restrictive in robotics, where…

Robotics · Computer Science 2026-02-27 Junha Chun , Youngjoon Jeong , Taesup Kim

Recent advancements in deep reinforcement learning (RL) have demonstrated notable progress in sample efficiency, spanning both model-based and model-free paradigms. Despite the identification and mitigation of specific bottlenecks in prior…

Machine Learning · Computer Science 2024-04-02 Yibo Wang , Jiang Zhao

Episodic rewards present a significant challenge in reinforcement learning. While intrinsic reward methods have demonstrated effectiveness in single-agent rein-forcement learning scenarios, their application to multi-agent reinforcement…

Artificial Intelligence · Computer Science 2025-11-24 Kesheng Chen , Wenjian Luo , Bang Zhang , Zeping Yin , Zipeng Ye

This work in the field of developmental cognitive robotics aims to devise a new domain bridging between reinforcement learning and imitation learning, with a model of the intrinsic motivation for learning agents to learn with guidance from…

Artificial Intelligence · Computer Science 2024-12-31 Sao Mai Nguyen

The reinforcement learning research area contains a wide range of methods for solving the problems of intelligent agent control. Despite the progress that has been made, the task of creating a highly autonomous agent is still a significant…

Machine Learning · Computer Science 2023-01-25 Artem Latyshev , Aleksandr I. Panov

Efficient exploration remains one of the longstanding problems of deep reinforcement learning. Instead of depending solely on extrinsic rewards from the environments, existing methods use intrinsic rewards to enhance exploration. However,…

Machine Learning · Computer Science 2024-12-09 SuMin Oh , WanSoo Kim , HyunJin Kim

Deep reinforcement learning has achieved great strides in solving challenging motion control tasks. Recently, there has been significant work on methods for exploiting the data gathered during training, but there has been less work on how…

Artificial Intelligence · Computer Science 2018-04-13 Glen Berseth , Michiel van de Panne