English
Related papers

Related papers: Automatic Intrinsic Reward Shaping for Exploration…

200 papers

Conveying complex objectives to reinforcement learning (RL) agents often requires meticulous reward engineering. Preference-based RL methods are able to learn a more flexible reward model based on human preferences by actively incorporating…

Machine Learning · Computer Science 2022-05-26 Xinran Liang , Katherine Shu , Kimin Lee , Pieter Abbeel

Humans integrate multiple sensory modalities (e.g. visual and audio) to build a causal understanding of the physical world. In this work, we propose a novel type of intrinsic motivation for Reinforcement Learning (RL) that encourages the…

Computer Vision and Pattern Recognition · Computer Science 2020-07-28 Chuang Gan , Xiaoyu Chen , Phillip Isola , Antonio Torralba , Joshua B. Tenenbaum

Teaching agents to follow complex written instructions has been an important yet elusive goal. One technique for enhancing learning efficiency is language reward shaping (LRS). Within a reinforcement learning (RL) framework, LRS involves…

Artificial Intelligence · Computer Science 2023-08-21 Sukai Huang , Nir Lipovetzky , Trevor Cohn

At an early age, human infants are able to learn and build a model of the world very quickly by constantly observing and interacting with objects around them. One of the most fundamental intuitions human infants acquire is intuitive…

Machine Learning · Computer Science 2019-07-09 JaeWon Choi , Sung-eui Yoon

Search-augmented large language models (LLMs) trained with reinforcement learning (RL) have achieved strong results on open-domain question answering (QA), but training still remains a significant challenge. The optimization is often…

Computation and Language · Computer Science 2026-03-25 Yutao Xie , Nathaniel Thomas , Nicklas Hansen , Yang Fu , Li Erran Li , Xiaolong Wang

We introduce Random Latent Exploration (RLE), a simple yet effective exploration strategy in reinforcement learning (RL). On average, RLE outperforms noise-based methods, which perturb the agent's actions, and bonus-based exploration, which…

Machine Learning · Computer Science 2025-02-28 Srinath Mahankali , Zhang-Wei Hong , Ayush Sekhari , Alexander Rakhlin , Pulkit Agrawal

We introduce Air Learning, an open-source simulator, and a gym environment for deep reinforcement learning research on resource-constrained aerial robots. Equipped with domain randomization, Air Learning exposes a UAV agent to a diverse set…

Robotics · Computer Science 2022-11-15 Srivatsan Krishnan , Behzad Boroujerdian , William Fu , Aleksandra Faust , Vijay Janapa Reddi

The electromagnetic inverse problem has long been a research hotspot. This study aims to reverse radar view angles in synthetic aperture radar (SAR) images given a target model. Nonetheless, the scarcity of SAR data, combined with the…

Machine Learning · Computer Science 2024-01-03 Yanni Wang , Hecheng Jia , Shilei Fu , Huiping Lin , Feng Xu

Aligning large language models with human objectives is paramount, yet common approaches including RLHF suffer from unstable and resource-intensive training. In response to this challenge, we introduce ARGS, Alignment as Reward-Guided…

Computation and Language · Computer Science 2024-02-06 Maxim Khanov , Jirayu Burapacheep , Yixuan Li

Deep reinforcement learning achieves superhuman performance in a range of video game environments, but requires that a designer manually specify a reward function. It is often easier to provide demonstrations of a target behavior than to…

Machine Learning · Computer Science 2018-10-26 Aaron Tucker , Adam Gleave , Stuart Russell

Deep Reinforcement Learning achieves very good results in domains where reward functions can be manually engineered. At the same time, there is growing interest within the community in using games based on Procedurally Content Generation…

Machine Learning · Computer Science 2020-12-07 Alessandro Sestini , Alexander Kuhnle , Andrew D. Bagdanov

Exploration is a fundamental challenge in reinforcement learning (RL). Many of the current exploration methods for deep RL use task-agnostic objectives, such as information gain or bonuses based on state visitation. However, many practical…

Machine Learning · Computer Science 2018-02-21 Abhishek Gupta , Russell Mendonca , YuXuan Liu , Pieter Abbeel , Sergey Levine

Efficient and effective learning is one of the ultimate goals of the deep reinforcement learning (DRL), although the compromise has been made in most of the time, especially for the application of robot manipulations. Learning is always…

Machine Learning · Computer Science 2020-03-06 Yongle Luo , Kun Dong , Lili Zhao , Zhiyong Sun , Chao Zhou , Bo Song

Reinforcement Learning with Verifiable Rewards (RLVR) has significantly improved LLM reasoning, but its sparse, outcome-based reward provides no guidance for intermediate steps, slowing exploration. We propose Progressively Ascending…

Artificial Intelligence · Computer Science 2025-10-28 Eunseop Yoon , Hee Suk Yoon , Jaehyun Jang , SooHwan Eom , Qi Dai , Chong Luo , Mark A. Hasegawa-Johnson , Chang D. Yoo

The Inverse Reinforcement Learning (\textit{IRL}) problem has seen rapid evolution in the past few years, with important applications in domains like robotics, cognition, and health. In this work, we explore the inefficacy of current IRL…

Machine Learning · Computer Science 2022-09-28 Raeid Saqur

In many real-world scenarios, reward signal for agents are exceedingly sparse, making it challenging to learn an effective reward function for reward shaping. To address this issue, the proposed approach in this paper performs reward…

Machine Learning · Computer Science 2026-05-18 Wenyun Li , Wenjie Huang , Chen Sun

In high-dimensional state spaces, the usefulness of Reinforcement Learning (RL) is limited by the problem of exploration. This issue has been addressed using potential-based reward shaping (PB-RS) previously. In the present work, we…

Artificial Intelligence · Computer Science 2021-07-15 Ingmar Schubert , Ozgur S. Oguz , Marc Toussaint

In this paper we address the challenge of exploration in deep reinforcement learning for robotic manipulation tasks. In sparse goal settings, an agent does not receive any positive feedback until randomly achieving the goal, which becomes…

Robotics · Computer Science 2021-02-23 Nikola Vulin , Sammy Christen , Stefan Stevsic , Otmar Hilliges

Reinforcement learning has been successful in training autonomous agents to accomplish goals in complex environments. Although this has been adapted to multiple settings, including robotics and computer games, human players often find it…

Artificial Intelligence · Computer Science 2020-01-22 Baicen Xiao , Qifan Lu , Bhaskar Ramasubramanian , Andrew Clark , Linda Bushnell , Radha Poovendran

Exploration under sparse reward is a long-standing challenge of model-free reinforcement learning. The state-of-the-art methods address this challenge by introducing intrinsic rewards to encourage exploration in novel states or uncertain…

Machine Learning · Computer Science 2021-02-05 Daochen Zha , Wenye Ma , Lei Yuan , Xia Hu , Ji Liu