English
Related papers

Related papers: Towards Learning-Based Formula 1 Race Strategies

200 papers

In this paper we present a Learning Model Predictive Controller (LMPC) for autonomous racing. We model the autonomous racing problem as a minimum time iterative control task, where an iteration corresponds to a lap. In the proposed approach…

Systems and Control · Electrical Eng. & Systems 2024-12-20 Ugo Rosolia , Francesco Borrelli

Understanding a \textit{reinforcement learning} policy, which guides state-to-action mappings to maximize rewards, necessitates an accompanying explanation for human comprehension. In this paper, we introduce a set of \textit{linear…

Artificial Intelligence · Computer Science 2025-05-01 Mikihisa Yuasa , Huy T. Tran , Ramavarapu S. Sreenivas

The rising popularity of driver-less cars has led to the research and development in the field of autonomous racing, and overtaking in autonomous racing is a challenging task. Vehicles have to detect and operate at the limits of dynamic…

Robotics · Computer Science 2021-07-22 Jayanth Bhargav , Johannes Betz , Hongrui Zheng , Rahul Mangharam

Conventional reinforcement learning (RL) methods can successfully solve a wide range of sequential decision problems. However, learning policies that can generalize predictably across multiple tasks in a setting with non-Markovian reward…

Machine Learning · Computer Science 2024-06-04 Guillermo Infante , David Kuric , Anders Jonsson , Vicenç Gómez , Herke van Hoof

Road congestion induces significant costs across the world, and road network disturbances, such as traffic accidents, can cause highly congested traffic patterns. If a planner had control over the routing of all vehicles in the network,…

Optimization and Control · Mathematics 2021-06-07 Daniel A. Lazar , Erdem Bıyık , Dorsa Sadigh , Ramtin Pedarsani

In this paper, we consider a transfer reinforcement learning problem involving agents with different action spaces. Specifically, for any new unseen task, the goal is to use a successful demonstration of this task by an expert agent in its…

Machine Learning · Computer Science 2024-10-21 Kavinayan P. Sivakumar , Yan Zhang , Zachary Bell , Scott Nivison , Michael M. Zavlanos

Engineering a high-performance race car requires a direct consideration of the human driver using real-world tests or Human-Driver-in-the-Loop simulations. Apart from that, offline simulations with human-like race driver models could make…

Machine Learning · Computer Science 2022-07-21 Stefan Löckel , Siwei Ju , Maximilian Schaller , Peter van Vliet , Jan Peters

Robot motion planning involves computing a sequence of valid robot configurations that take the robot from its initial state to a goal state. Solving a motion planning problem optimally using analytical methods is proven to be PSPACE-Hard.…

Robotics · Computer Science 2021-07-26 Naman Shah , Abhyudaya Srinet , Siddharth Srivastava

Autonomous car racing is a major challenge in robotics. It raises fundamental problems for classical approaches such as planning minimum-time trajectories under uncertain dynamics and controlling the car at the limits of its handling.…

Artificial Intelligence · Computer Science 2021-05-11 Florian Fuchs , Yunlong Song , Elia Kaufmann , Davide Scaramuzza , Peter Duerr

The skill to drift a car--i.e., operate in a state of controlled oversteer like professional drivers--could give future autonomous cars maximum flexibility when they need to retain control in adverse conditions or avoid collisions. We…

Robotics · Computer Science 2024-10-29 Franck Djeumou , Michael Thompson , Makoto Suminaka , John Subosits

The problem of reinforcement learning is considered where the environment or the model undergoes a change. An algorithm is proposed that an agent can apply in such a problem to achieve the optimal long-time discounted reward. The algorithm…

Systems and Control · Electrical Eng. & Systems 2023-04-25 Wuxia Chen , Taposh Banerjee , Jemin George , Carl Busart

Autonomous racing presents unique challenges due to its non-linear dynamics, the high speed involved, and the critical need for real-time decision-making under dynamic and unpredictable conditions. Most traditional Reinforcement Learning…

Robotics · Computer Science 2025-05-13 Benedict Hildisch , Edoardo Ghignone , Nicolas Baumann , Cheng Hu , Andrea Carron , Michele Magno

Path planning in a changing environment is a challenging task in robotics, as moving objects impose time-dependent constraints. Recent planning methods primarily focus on the spatial aspects, lacking the capability to directly incorporate…

Robotics · Computer Science 2024-10-29 Xi Huang , Gergely Sóti , Christoph Ledermann , Björn Hein , Torsten Kröger

Two natural ways of modelling Formula 1 race outcomes are a probabilistic approach, based on the exponential distribution, and econometric modelling of the ranks. Both approaches lead to exactly soluble race-winning probabilities. Equating…

Applications · Statistics 2024-06-21 John Fry , Tom Brighton , Silvio Fanzon

This paper presents a novel framework for automatic learning of complex strategies in human decision making. The task that we are interested in is to better facilitate long term planning for complex, multi-step events. We observe temporal…

Computer Vision and Pattern Recognition · Computer Science 2018-05-15 Tharindu Fernando , Simon Denman , Sridha Sridharan , Clinton Fookes

This paper presents a unified planning-control strategy for competing with other racing cars called IteraOptiRacing in autonomous racing environments. This unified strategy is proposed based on Iterative Linear Quadratic Regulator for…

Robotics · Computer Science 2025-07-15 Yifan Zeng , Yihan Li , Suiyi He , Koushil Sreenath , Jun Zeng

We present an approach for safe trajectory planning, where a strategic task related to autonomous racing is learned sample-efficient within a simulation environment. A high-level policy, represented as a neural network, outputs a reward…

Robotics · Computer Science 2022-12-06 Rudolf Reiter , Jasper Hoffmann , Joschka Boedecker , Moritz Diehl

Map-based methods for autonomous racing estimate the vehicle's location, which is used to follow a high-level plan. While map-based optimisation methods demonstrate high-performance results, they are limited by requiring a map of the…

Robotics · Computer Science 2024-02-01 Benjamin David Evans , Hendrik Willem Jordaan , Herman Arnold Engelbrecht

An agent with an inaccurate model of its environment faces a difficult choice: it can ignore the errors in its model and act in the real world in whatever way it determines is optimal with respect to its model. Alternatively, it can take a…

Transportation and traffic are currently undergoing a rapid increase in terms of both scale and complexity. At the same time, an increasing share of traffic participants are being transformed into agents driven or supported by artificial…

Machine Learning · Computer Science 2018-10-24 Mark Schutera , Niklas Goby , Dirk Neumann , Markus Reischl