English
Related papers

Related papers: Reward Signal Design for Autonomous Racing

200 papers

Reinforcement Learning (RL) has progressed from simple control tasks to complex real-world challenges with large state spaces. While RL excels in these tasks, training time remains a limitation. Reward shaping is a popular solution, but…

One of the fundamental challenges in reinforcement learning (RL) is the one of data efficiency: modern algorithms require a very large number of training samples, especially compared to humans, for solving environments with high-dimensional…

Machine Learning · Computer Science 2021-05-10 Hlynur Davíð Hlynsson , Laurenz Wiskott

In Formula One, teams compete to develop their cars and achieve the highest possible finishing position in each race. During a race, however, teams are unable to alter the car, so they must improve their cars' finishing positions via race…

Developing an autonomous vehicle control strategy for signalised intersections (SI) is one of the challenging tasks due to its inherently complex decision-making process. This study proposes a Deep Reinforcement Learning (DRL) based…

Artificial Intelligence · Computer Science 2025-05-15 Pankaj Kumar , Aditya Mishra , Pranamesh Chakraborty , Subrahmanya Swamy Peruru

General-purpose planning algorithms for automated driving combine mission, behavior, and local motion planning. Such planning algorithms map features of the environment and driving kinematics into complex reward functions. To achieve this,…

Robotics · Computer Science 2020-09-17 Sascha Rosbach , Vinit James , Simon Großjohann , Silviu Homoceanu , Xing Li , Stefan Roth

Inverse Reinforcement Learning (IRL) aims to recover a reward function from expert demonstrations. Recently, Optimal Transport (OT) methods have been successfully deployed to align trajectories and infer rewards. While OT-based methods have…

Machine Learning · Computer Science 2025-06-10 Zixuan Dong , Yumi Omori , Keith Ross

Preference-based Reinforcement Learning (PbRL) provides a way to learn high-performance policies in environments where the reward signal is hard to specify, avoiding heuristic and time-consuming reward design. However, PbRL can suffer from…

Machine Learning · Computer Science 2025-07-02 Chenyang Cao , Miguel Rogel-García , Mohamed Nabail , Xueqian Wang , Nicholas Rhinehart

There has been significant progress in deep reinforcement learning (RL) in recent years. Nevertheless, finding suitable hyperparameter configurations and reward functions remains challenging even for experts, and performance heavily relies…

Machine Learning · Computer Science 2024-10-10 Julian Dierkes , Emma Cramer , Holger H. Hoos , Sebastian Trimpe

Despite the numerous advances, reinforcement learning remains away from widespread acceptance for autonomous controller design as compared to classical methods due to lack of ability to effectively tackle the reality gap. The reliance on…

Machine Learning · Computer Science 2024-09-23 Narendra Patwardhan , Zequn Wang

Reinforcement learning (RL) has emerged as a promising strategy for finetuning small language models (SLMs) to solve targeted tasks such as math and coding. However, RL algorithms tend to be resource-intensive, taking a significant amount…

Machine Learning · Computer Science 2025-10-07 Lianghuan Huang , Sagnik Anupam , Insup Lee , Shuo Li , Osbert Bastani

Reward shaping is an effective technique for incorporating domain knowledge into reinforcement learning (RL). Existing approaches such as potential-based reward shaping normally make full use of a given shaping reward function. However,…

Machine Learning · Computer Science 2020-11-06 Yujing Hu , Weixun Wang , Hangtian Jia , Yixiang Wang , Yingfeng Chen , Jianye Hao , Feng Wu , Changjie Fan

Reinforcement learning (RL), particularly in sparse reward settings, often requires prohibitively large numbers of interactions with the environment, thereby limiting its applicability to complex problems. To address this, several prior…

Machine Learning · Computer Science 2020-11-20 Prasoon Goyal , Scott Niekum , Raymond J. Mooney

In recent years, reinforcement learning (RL)-based methods for learning driving policies have gained increasing attention in the autonomous driving community and have achieved remarkable progress in various driving scenarios. However,…

Robotics · Computer Science 2024-12-23 Zilin Huang , Zihao Sheng , Yansong Qu , Junwei You , Sikai Chen

In the backdrop of an increasingly pressing need for effective urban and highway transportation systems, this work explores the synergy between model-based and learning-based strategies to enhance traffic flow management by use of an…

Systems and Control · Electrical Eng. & Systems 2025-02-04 Filippo Airaldi , Bart De Schutter , Azita Dabiri

Success in racing requires a unique combination of vehicle setup, understanding of the racetrack, and human expertise. Since building and testing many different vehicle configurations in the real world is prohibitively expensive,…

Robotics · Computer Science 2024-12-06 John Subosits , Jenna Lee , Shawn Manuel , Paul Tylkin , Avinash Balachandran

Increasingly available city data and advanced learning techniques have empowered people to improve the efficiency of our city functions. Among them, improving the urban transportation efficiency is one of the most prominent topics. Recent…

Machine Learning · Computer Science 2019-05-14 Guanjie Zheng , Yuanhao Xiong , Xinshi Zang , Jie Feng , Hua Wei , Huichu Zhang , Yong Li , Kai Xu , Zhenhui Li

Electric motors are crucial in many applications, but traditional control methods struggle with nonlinearities, parameter uncertainties, and external disturbances. Reinforcement Learning (RL) offers a promising solution as a data-driven…

Systems and Control · Electrical Eng. & Systems 2024-12-25 Danial Kazemikia

In this paper, we address the issue of increasing the performance of reinforcement learning (RL) solutions for autonomous racing cars when navigating under conditions where practical vehicle modelling errors (commonly known as \emph{model…

Robotics · Computer Science 2024-08-06 Andrew Murdoch , Johannes Cornelius Schoeman , Hendrik Willem Jordaan

The problem of reinforcement learning is considered where the environment or the model undergoes a change. An algorithm is proposed that an agent can apply in such a problem to achieve the optimal long-time discounted reward. The algorithm…

Systems and Control · Electrical Eng. & Systems 2023-04-25 Wuxia Chen , Taposh Banerjee , Jemin George , Carl Busart

Chip placement is a critical step in physical design. While reinforcement learning (RL)-based methods have recently emerged, their training primarily focuses on wirelength optimization, and therefore often fail to achieve expert-quality…

Hardware Architecture · Computer Science 2026-04-29 Ruo-Tong Chen , Ke Xue , Chengrui Gao , Yunqi Shi , Tian Xu , Peng Xie , Siyuan Xu , Mingxuan Yuan , Chao Qian , Zhi-Hua Zhou