English
Related papers

Related papers: F1tenth Autonomous Racing With Offline Reinforceme…

200 papers

The development of vehicle controllers for autonomous racing is challenging because racing cars operate at their physical driving limit. Prompted by the demand for improved performance, autonomous racing research has seen the proliferation…

Robotics · Computer Science 2023-06-01 Raphael Trumpp , Denis Hoornaert , Marco Caccamo

Map-based methods for autonomous racing estimate the vehicle's location, which is used to follow a high-level plan. While map-based optimisation methods demonstrate high-performance results, they are limited by requiring a map of the…

Robotics · Computer Science 2024-02-01 Benjamin David Evans , Hendrik Willem Jordaan , Herman Arnold Engelbrecht

This paper addresses the problem of online inverse reinforcement learning for systems with limited data and uncertain dynamics. In the developed approach, the state and control trajectories are recorded online by observing an agent perform…

Systems and Control · Electrical Eng. & Systems 2020-08-21 Ryan Self , S M Nahid Mahmud , Katrine Hareland , Rushikesh Kamalapurkar

Recent advances in batch (offline) reinforcement learning have shown promising results in learning from available offline data and proved offline reinforcement learning to be an essential toolkit in learning control policies in a model-free…

Machine Learning · Computer Science 2022-12-19 Ashish Kumar , Ilya Kuzovkin

The ability of an AI agent to assist other agents, such as humans, is an important and challenging goal, which requires the assisting agent to reason about the behavior and infer the goals of the assisted agent. Training such an ability by…

Artificial Intelligence · Computer Science 2021-10-05 Antti Keurulainen , Isak Westerlund , Samuel Kaski , Alexander Ilin

Success in racing requires a unique combination of vehicle setup, understanding of the racetrack, and human expertise. Since building and testing many different vehicle configurations in the real world is prohibitively expensive,…

Robotics · Computer Science 2024-12-06 John Subosits , Jenna Lee , Shawn Manuel , Paul Tylkin , Avinash Balachandran

The classical method of autonomous racing uses real-time localisation to follow a precalculated optimal trajectory. In contrast, end-to-end deep reinforcement learning (DRL) can train agents to race using only raw LiDAR scans. While…

Robotics · Computer Science 2023-06-13 Benjamin David Evans , Herman Arnold Engelbrecht , Hendrik Willem Jordaan

Existing approaches in reinforcement learning train an agent to learn desired optimal behavior in an environment with rule based surrounding agents. In safety critical applications such as autonomous driving it is crucial that the rule…

Computer Vision and Pattern Recognition · Computer Science 2025-08-22 Arjun Srinivasan , Anubhav Paras , Aniket Bera

Head-to-head autonomous racing is a challenging problem, as the vehicle needs to operate at the friction or handling limits in order to achieve minimum lap times while also actively looking for strategies to overtake/stay ahead of the…

Robotics · Computer Science 2023-08-28 Dvij Kalaria , Qin Lin , John M. Dolan

Autonomous Mobility-on-Demand (AMoD) systems are an evolving mode of transportation in which a centrally coordinated fleet of self-driving vehicles dynamically serves travel requests. The control of these systems is typically formulated as…

Systems and Control · Electrical Eng. & Systems 2023-08-28 Carolin Schmidt , Daniele Gammelli , Francisco Camara Pereira , Filipe Rodrigues

We present a control approach for autonomous vehicles based on deep reinforcement learning. A neural network agent is trained to map its estimated state to acceleration and steering commands given the objective of reaching a specific target…

Robotics · Computer Science 2020-03-16 Andreas Folkers , Matthias Rick , Christof Büskens

Autonomous racing with scaled race cars has gained increasing attention as an effective approach for developing perception, planning and control algorithms for safe autonomous driving at the limits of the vehicle's handling. To train agile…

Robotics · Computer Science 2023-05-30 Xiatao Sun , Mingyan Zhou , Zhijun Zhuang , Shuo Yang , Johannes Betz , Rahul Mangharam

Learning policies from previously recorded data is a promising direction for real-world robotics tasks, as online learning is often infeasible. Dexterous manipulation in particular remains an open problem in its general form. The…

In the field of Autonomous Driving, the system controlling the vehicle can be seen as an agent acting in a complex environment and thus naturally fits into the modern framework of Reinforcement Learning. However, learning to drive can be a…

Artificial Intelligence · Computer Science 2018-11-26 Patrick Klose , Rudolf Mester

Reinforcement learning (RL) has shown to be a valuable tool in training neural networks for autonomous motion planning. The application of RL to a specific problem is dependent on a reward signal to quantify how good or bad a certain action…

Robotics · Computer Science 2024-10-28 Benjamin Evans , Herman A. Engelbrecht , Hendrik W. Jordaan

Offline Reinforcement Learning (ORL) is a promising approach to reduce the high sample complexity of traditional Reinforcement Learning (RL) by eliminating the need for continuous environmental interactions. ORL exploits a dataset of…

Artificial Intelligence · Computer Science 2024-07-15 Girolamo Macaluso , Alessandro Sestini , Andrew D. Bagdanov

In this work, we present a rigorous end-to-end control strategy for autonomous vehicles aimed at minimizing lap times in a time attack racing event. We also introduce AutoRACE Simulator developed as a part of this research project, which…

Robotics · Computer Science 2022-11-29 Chinmay Vilas Samak , Tanmay Vilas Samak , Sivanathan Kandhasamy

The interactive decision-making in multi-agent autonomous racing offers insights valuable beyond the domain of self-driving cars. Mapless online path planning is particularly of practical appeal but poses a challenge for safely overtaking…

Robotics · Computer Science 2024-09-17 Raphael Trumpp , Ehsan Javanmardi , Jin Nakazato , Manabu Tsukada , Marco Caccamo

In this article, we explore the feasibility of applying proximal policy optimization, a state-of-the-art deep reinforcement learning algorithm for continuous control tasks, on the dual-objective problem of controlling an underactuated…

Machine Learning · Computer Science 2019-12-20 Eivind Meyer , Haakon Robinson , Adil Rasheed , Omer San

Applying reinforcement learning to robotic systems poses a number of challenging problems. A key requirement is the ability to handle continuous state and action spaces while remaining within a limited time and resource budget.…

Machine Learning · Computer Science 2020-06-29 Benjamin van Niekerk , Andreas Damianou , Benjamin Rosman