English
Related papers

Related papers: Autonomous Vehicle Controllers From End-to-End Dif…

200 papers

Modern autonomous driving algorithms often rely on learning the mapping from visual inputs to steering actions from human driving data in a variety of scenarios and visual scenes. The required data collection is not only labor intensive,…

Robotics · Computer Science 2018-03-20 Sascha Hornauer , Karl Zipser , Stella X. Yu

Autonomous driving has a natural bi-level structure. The goal of the upper behavioural layer is to provide appropriate lane change, speeding up, and braking decisions to optimize a given driving task. However, this layer can only indirectly…

Robotics · Computer Science 2022-12-06 Arun Kumar Singh , Jatan Shrestha , Nicola Albarella

Deep networks trained on demonstrations of human driving have learned to follow roads and avoid obstacles. However, driving policies trained via imitation learning cannot be controlled at test time. A vehicle trained end-to-end to imitate…

Robotics · Computer Science 2018-03-05 Felipe Codevilla , Matthias Müller , Antonio López , Vladlen Koltun , Alexey Dosovitskiy

Autonomous vehicle (AV) planners must undergo rigorous evaluation before widespread deployment on public roads, particularly to assess their robustness against the uncertainty of human behaviors. While recent advancements in data-driven…

Artificial Intelligence · Computer Science 2025-06-06 Augusto Mondelli , Yueshan Li , Alessandro Zanardi , Emilio Frazzoli

We introduce AMAGO, an in-context Reinforcement Learning (RL) agent that uses sequence models to tackle the challenges of generalization, long-term memory, and meta-learning. Recent works have shown that off-policy learning can make…

Machine Learning · Computer Science 2024-02-02 Jake Grigsby , Linxi Fan , Yuke Zhu

To operate effectively in tomorrow's smart cities, autonomous vehicles (AVs) must rely on intra-vehicle sensors such as camera and radar as well as inter-vehicle communication. Such dependence on sensors and communication links exposes AVs…

Systems and Control · Computer Science 2018-05-09 Aidin Ferdowsi , Ursula Challita , Walid Saad , Narayan B. Mandayam

The self-driving based on deep reinforcement learning, as the most important application of artificial intelligence, has become a popular topic. Most of the current self-driving methods focus on how to directly learn end-to-end self-driving…

Machine Learning · Computer Science 2019-12-05 Qi Zhang , Tao Du , Changzheng Tian

With the development of state-of-art deep reinforcement learning, we can efficiently tackle continuous control problems. But the deep reinforcement learning method for continuous control is based on historical data, which would make…

Robotics · Computer Science 2016-12-02 Xi Xiong , Jianqiang Wang , Fang Zhang , Keqiang Li

Data-driven simulation has become a favorable way to train and test autonomous driving algorithms. The idea of replacing the actual environment with a learned simulator has also been explored in model-based reinforcement learning in the…

Robotics · Computer Science 2023-09-29 Zhejun Zhang , Alexander Liniger , Dengxin Dai , Fisher Yu , Luc Van Gool

The deployment of robot controllers is hindered by modeling discrepancies due to necessary simplifications for computational tractability or inaccuracies in data-generating simulators. Such discrepancies typically require ad-hoc tuning to…

Robotics · Computer Science 2025-06-02 Lokesh Krishna , Sheng Cheng , Junheng Li , Naira Hovakimyan , Quan Nguyen

Autonomous vehicle (AV) stacks are typically built in a modular fashion, with explicit components performing detection, tracking, prediction, planning, control, etc. While modularity improves reusability, interpretability, and…

Robotics · Computer Science 2022-12-14 Peter Karkus , Boris Ivanovic , Shie Mannor , Marco Pavone

Intrinsically, driving is a Markov Decision Process which suits well the reinforcement learning paradigm. In this paper, we propose a novel agent which learns to drive a vehicle without any human assistance. We use the concept of…

Robotics · Computer Science 2019-04-30 Shashank Kotyan , Danilo Vasconcellos Vargas , Venkanna U

Autonomous Vehicles (AVs) represent a transformative advancement in the transportation industry. These vehicles have sophisticated sensors, advanced algorithms, and powerful computing systems that allow them to navigate and operate without…

Signal Processing · Electrical Eng. & Systems 2025-01-03 Noor Aboueleneen , Yahuza Bello , Abdullatif Albaseer , Ahmed Refaey Hussein , Mohamed Abdallah , Ekram Hossain

Ensuring safety in autonomous driving systems remains a critical challenge, particularly in handling rare but potentially catastrophic safety-critical scenarios. While existing research has explored generating safety-critical scenarios for…

Robotics · Computer Science 2025-02-24 Zihao Sheng , Zilin Huang , Yansong Qu , Yue Leng , Sruthi Bhavanam , Sikai Chen

Simulating realistic behaviors of traffic agents is pivotal for efficiently validating the safety of autonomous driving systems. Existing data-driven simulators primarily use an encoder-decoder architecture to encode the historical…

Artificial Intelligence · Computer Science 2024-11-12 Zikang Zhou , Haibo Hu , Xinhong Chen , Jianping Wang , Nan Guan , Kui Wu , Yung-Hui Li , Yu-Kai Huang , Chun Jason Xue

In most modern cities, traffic congestion is one of the most salient societal challenges. Past research has shown that inserting a limited number of autonomous vehicles (AVs) within the traffic flow, with driving policies learned…

Artificial Intelligence · Computer Science 2023-01-26 Yulin Zhang , William Macke , Jiaxun Cui , Daniel Urieli , Peter Stone

We present a training pipeline for the autonomous driving task given the current camera image and vehicle speed as the input to produce the throttle, brake, and steering control output. The simulator Airsim's convenient weather and lighting…

Machine Learning · Computer Science 2019-07-17 Tianqi Wang , Dong Eui Chang

While recent developments in autonomous vehicle (AV) technology highlight substantial progress, we lack tools for rigorous and scalable testing. Real-world testing, the $\textit{de facto}$ evaluation environment, places the public in…

Machine Learning · Computer Science 2019-01-15 Matthew O'Kelly , Aman Sinha , Hongseok Namkoong , John Duchi , Russ Tedrake

Interaction between the background vehicles (BVs) and automated vehicles (AVs) in scenario-based testing plays a critical role in evaluating the intelligence of the AVs. Current testing scenarios typically employ predefined or scripted BVs,…

Systems and Control · Electrical Eng. & Systems 2023-06-13 Yining Ma , Wei Jiang , Lingtong Zhang , Junyi Chen , Hong Wang , Chen Lv , Xuesong Wang , Lu Xiong

Capturing and simulating intelligent adaptive behaviours within spatially explicit individual-based models remains an ongoing challenge for researchers. While an ever-increasing abundance of real-world behavioural data are collected, few…

Multiagent Systems · Computer Science 2022-01-05 Sedar Olmez , Dan Birks , Alison Heppenstall