English
Related papers

Related papers: Temporal Video-Language Alignment Network for Rewa…

200 papers

Reward functions are central in reinforcement learning (RL), guiding agents towards optimal decision-making. The complexity of RL tasks requires meticulously designed reward functions that effectively drive learning while avoiding…

Machine Learning · Computer Science 2025-03-31 Rati Devidze

Despite significant advances in the field of deep Reinforcement Learning (RL), today's algorithms still fail to learn human-level policies consistently over a set of diverse tasks such as Atari 2600 games. We identify three key challenges…

Recent advances in reinforcement learning (RL) have renewed interest in reward design for shaping agent behavior, but manually crafting reward functions is tedious and error-prone. A principled alternative is to specify behavioral…

Artificial Intelligence · Computer Science 2026-03-23 Milad Kazemi , Mateo Perez , Fabio Somenzi , Sadegh Soudjani , Ashutosh Trivedi , Alvaro Velasquez

Reinforcement learning (RL) is an effective approach to motion planning in autonomous driving, where an optimal driving policy can be automatically learned using the interaction data with the environment. Nevertheless, the reward function…

Robotics · Computer Science 2023-08-28 Lin-Chi Wu , Zengjie Zhang , Sofie Haesaert , Zhiqiang Ma , Zhiyong Sun

Hierarchical Reinforcement Learning (HRL) exploits temporally extended actions, or options, to make decisions from a higher-dimensional perspective to alleviate the sparse reward problem, one of the most challenging problems in…

Machine Learning · Computer Science 2019-05-15 Libo Xing

Reward learning enables the application of reinforcement learning (RL) to tasks where reward is defined by human judgment, building a model of reward by asking humans questions. Most work on reward learning has used simulated environments,…

Computation and Language · Computer Science 2020-01-10 Daniel M. Ziegler , Nisan Stiennon , Jeffrey Wu , Tom B. Brown , Alec Radford , Dario Amodei , Paul Christiano , Geoffrey Irving

Reinforcement learning is concerned with identifying reward-maximizing behaviour policies in environments that are initially unknown. State-of-the-art reinforcement learning approaches, such as deep Q-networks, are model-free and learn to…

Artificial Intelligence · Computer Science 2017-08-18 Felix Leibfried , Nate Kushman , Katja Hofmann

Recent advancements in Large Language Models (LLMs) and Visual Language Models (VLMs) have significantly impacted robotics, enabling high-level semantic motion planning applications. Reinforcement Learning (RL), a complementary paradigm,…

While deep reinforcement learning techniques have led to agents that are successfully able to learn to perform a number of tasks that had been previously unlearnable, these techniques are still susceptible to the longstanding problem of…

Multimedia · Computer Science 2019-06-07 Nicholas Waytowich , Sean L. Barton , Vernon Lawhern , Ethan Stump , Garrett Warnell

In reinforcement learning (RL), the ability to utilize prior knowledge from previously solved tasks can allow agents to quickly solve new problems. In some cases, these new problems may be approximately solved by composing the solutions of…

Machine Learning · Computer Science 2023-01-02 Jacob Adamczyk , Argenis Arriojas , Stas Tiomkin , Rahul V. Kulkarni

Reinforcement learning (RL) has shown to be a valuable tool in training neural networks for autonomous motion planning. The application of RL to a specific problem is dependent on a reward signal to quantify how good or bad a certain action…

Robotics · Computer Science 2024-10-28 Benjamin Evans , Herman A. Engelbrecht , Hendrik W. Jordaan

Statistical spoken dialogue systems have the attractive property of being able to be optimised from data via interactions with real users. However in the reinforcement learning paradigm the dialogue manager (agent) often requires…

Machine Learning · Computer Science 2015-08-19 Pei-Hao Su , David Vandyke , Milica Gasic , Nikola Mrksic , Tsung-Hsien Wen , Steve Young

Reward shaping allows reinforcement learning (RL) agents to accelerate learning by receiving additional reward signals. However, these signals can be difficult to design manually, especially for complex RL tasks. We propose a simple and…

Artificial Intelligence · Computer Science 2018-06-11 Niels Justesen , Sebastian Risi

High sample complexity has long been a challenge for RL. On the other hand, humans learn to perform tasks not only from interaction or demonstrations, but also by reading unstructured text documents, e.g., instruction manuals. Instruction…

Machine Learning · Computer Science 2024-07-23 Yue Wu , Yewen Fan , Paul Pu Liang , Amos Azaria , Yuanzhi Li , Tom M. Mitchell

In this work, we investigate how to leverage pre-trained visual-language models (VLM) for online Reinforcement Learning (RL). In particular, we focus on sparse reward tasks with pre-defined textual task descriptions. We first identify the…

Machine Learning · Computer Science 2024-06-06 Yuwei Fu , Haichao Zhang , Di Wu , Wei Xu , Benoit Boulet

Reinforcement learning (RL) studies how an agent comes to achieve reward in an environment through interactions over time. Recent advances in machine RL have surpassed human expertise at the world's oldest board games and many classic video…

Artificial Intelligence · Computer Science 2021-07-28 Pedro A. Tsividis , Joao Loula , Jake Burga , Nathan Foss , Andres Campero , Thomas Pouncy , Samuel J. Gershman , Joshua B. Tenenbaum

To solve complex real-world problems with reinforcement learning, we cannot rely on manually specified reward functions. Instead, we can have humans communicate an objective to the agent directly. In this work, we combine two approaches to…

Machine Learning · Computer Science 2018-11-16 Borja Ibarz , Jan Leike , Tobias Pohlen , Geoffrey Irving , Shane Legg , Dario Amodei

Training agents using Reinforcement Learning in games with sparse rewards is a challenging problem, since large amounts of exploration are required to retrieve even the first reward. To tackle this problem, a common approach is to use…

Machine Learning · Computer Science 2020-10-09 Shengyi Huang , Santiago Ontañón

Reward shaping is an effective technique for incorporating domain knowledge into reinforcement learning (RL). Existing approaches such as potential-based reward shaping normally make full use of a given shaping reward function. However,…

Machine Learning · Computer Science 2020-11-06 Yujing Hu , Weixun Wang , Hangtian Jia , Yixiang Wang , Yingfeng Chen , Jianye Hao , Feng Wu , Changjie Fan

Designing reward functions is a longstanding challenge in reinforcement learning (RL); it requires specialized knowledge or domain data, leading to high costs for development. To address this, we introduce Text2Reward, a data-free framework…

Machine Learning · Computer Science 2024-05-28 Tianbao Xie , Siheng Zhao , Chen Henry Wu , Yitao Liu , Qian Luo , Victor Zhong , Yanchao Yang , Tao Yu