中文
相关论文

相关论文: Occupancy Reward Shaping: Improving Credit Assignm…

200 篇论文

We propose a reinforcement learning based approach to query object localization, for which an agent is trained to localize objects of interest specified by a small exemplary set. We learn a transferable reward signal formulated using the…

计算机视觉与模式识别 · 计算机科学 2022-03-16 Tingfeng Li , Shaobo Han , Martin Renqiang Min , Dimitris N. Metaxas

World models envision potential future states based on various ego actions. They embed extensive knowledge about the driving environment, facilitating safe and scalable autonomous driving. Most existing methods primarily focus on either…

计算机视觉与模式识别 · 计算机科学 2025-01-20 Yu Yang , Jianbiao Mei , Yukai Ma , Siliang Du , Wenqing Chen , Yijie Qian , Yuxiang Feng , Yong Liu

We introduce Self-supervised Online Reward Shaping (SORS), which aims to improve the sample efficiency of any RL algorithm in sparse-reward environments by automatically densifying rewards. The proposed framework alternates between…

机器学习 · 计算机科学 2021-07-27 Farzan Memarian , Wonjoon Goo , Rudolf Lioutikov , Scott Niekum , Ufuk Topcu

Learning auxiliary tasks, such as multiple predictions about the world, can provide many benefits to reinforcement learning systems. A variety of off-policy learning algorithms have been developed to learn such predictions, but as yet there…

While offline reinforcement learning provides reliable policies for real-world deployment, its inherent pessimism severely restricts an agent's ability to explore and collect novel data online. Drawing inspiration from safe reinforcement…

机器学习 · 计算机科学 2026-03-20 Amirhossein Roknilamouki , Arnob Ghosh , Eylem Ekici , Ness B. Shroff

This paper addresses the problem of learning instantaneous occupancy levels of dynamic environments and predicting future occupancy levels. Due to the complexity of most real-world environments, such as urban streets or crowded areas, the…

机器人学 · 计算机科学 2019-12-05 Vitor Guizilini , Ransalu Senanayake , Fabio Ramos

Sequential decision-making agents struggle with long horizon tasks, since solving them requires multi-step reasoning. Most reinforcement learning (RL) algorithms address this challenge by improved credit assignment, introducing memory…

机器学习 · 计算机科学 2023-04-04 Bogdan Mazoure , Jake Bruce , Doina Precup , Rob Fergus , Ankit Anand

Multi-agent reinforcement learning involves multiple agents interacting with each other and a shared environment to complete tasks. When rewards provided by the environment are sparse, agents may not receive immediate feedback on the…

机器学习 · 计算机科学 2021-03-31 Baicen Xiao , Bhaskar Ramasubramanian , Radha Poovendran

We consider the problem of reinforcement learning under safety requirements, in which an agent is trained to complete a given task, typically formalized as the maximization of a reward signal over time, while concurrently avoiding…

Reward shaping (RS) is a powerful method in reinforcement learning (RL) for overcoming the problem of sparse or uninformative rewards. However, RS typically relies on manually engineered shaping-reward functions whose construction is…

Reinforcement learning (RL) algorithms struggle with learning optimal policies for tasks where reward feedback is sparse and depends on a complex sequence of events in the environment. Probabilistic reward machines (PRMs) are finite-state…

机器学习 · 计算机科学 2025-10-20 Jan Corazza , Hadi Partovi Aria , Daniel Neider , Zhe Xu

Training agents using Reinforcement Learning in games with sparse rewards is a challenging problem, since large amounts of exploration are required to retrieve even the first reward. To tackle this problem, a common approach is to use…

机器学习 · 计算机科学 2020-10-09 Shengyi Huang , Santiago Ontañón

Reward shaping has been applied widely to accelerate Reinforcement Learning (RL) agents' training. However, a principled way of designing effective reward shaping functions, especially for complex continuous control problems, remains…

机器学习 · 计算机科学 2026-02-12 Mateo Juliani , Mingxuan Li , Elias Bareinboim

In this paper, we propose an optimization based SLAM approach to simultaneously optimize the robot trajectory and the occupancy map using 2D laser scans (and odometry) information. The key novelty is that the robot poses and the occupancy…

机器人学 · 计算机科学 2024-05-20 Liang Zhao , Yingyu Wang , Shoudong Huang

Training offline RL models using visual inputs poses two significant challenges, i.e., the overfitting problem in representation learning and the overestimation bias for expected future rewards. Recent work has attempted to alleviate the…

机器学习 · 计算机科学 2024-10-30 Qi Wang , Junming Yang , Yunbo Wang , Xin Jin , Wenjun Zeng , Xiaokang Yang

The comprehensive representation and understanding of the driving environment is crucial to improve the safety and reliability of autonomous vehicles. In this paper, we present a new approach to establish an environment model containing a…

机器人学 · 计算机科学 2018-05-24 Nico Engel , Stefan Hoermann , Philipp Henzler , Klaus Dietmayer

In high-dimensional state spaces, the usefulness of Reinforcement Learning (RL) is limited by the problem of exploration. This issue has been addressed using potential-based reward shaping (PB-RS) previously. In the present work, we…

人工智能 · 计算机科学 2021-07-15 Ingmar Schubert , Ozgur S. Oguz , Marc Toussaint

Reinforcement learning (RL) in long horizon and sparse reward tasks is notoriously difficult and requires a lot of training steps. A standard solution to speed up the process is to leverage additional reward signals, shaping it to better…

计算与语言 · 计算机科学 2022-10-14 Thomas Carta , Pierre-Yves Oudeyer , Olivier Sigaud , Sylvain Lamprier

Offline meta-reinforcement learning seeks to learn policies that generalize across related tasks from fixed datasets. Context-based methods infer a task representation from transition histories, but learning effective task representations…

机器学习 · 计算机科学 2026-03-04 Mohammadreza Nakheai , Aidan Scannell , Kevin Luck , Joni Pajarinen

Social navigation has been gaining attentions with the growth in machine intelligence. Since reinforcement learning can select an action in the prediction phase at a low computational cost, it has been formulated in a social navigation…

机器人学 · 计算机科学 2021-04-15 Takato Okudo , Seiji Yamada