English
Related papers

Related papers: Learning End-to-end Autonomous Driving using Guide…

200 papers

Many advanced Learning from Demonstration (LfD) methods consider the decomposition of complex, real-world tasks into simpler sub-tasks. By reusing the corresponding sub-policies within and between tasks, they provide training data for each…

Machine Learning · Computer Science 2018-08-13 Kyriacos Shiarlis , Markus Wulfmeier , Sasha Salter , Shimon Whiteson , Ingmar Posner

Multi-modal end-to-end autonomous driving has shown promising advancements in recent work. By embedding more modalities into end-to-end networks, the system's understanding of both static and dynamic aspects of the driving environment is…

Robotics · Computer Science 2025-05-15 Ziang Guo , Xinhao Lin , Zakhar Yagudin , Artem Lykov , Yong Wang , Yanqiang Li , Dzmitry Tsetserukou

Socially compliant navigation is an integral part of safety features in Human-Robot Interaction. Traditional approaches to mobile navigation prioritize physical aspects, such as efficiency, but social behaviors gain traction as robots…

Robotics · Computer Science 2024-05-03 Yigit Yildirim , Mehmet Suzer , Emre Ugur

We trained a convolutional neural network (CNN) to map raw pixels from a single front-facing camera directly to steering commands. This end-to-end approach proved surprisingly powerful. With minimum training data from humans the system…

In autonomous driving, end-to-end planners directly utilize raw sensor data, enabling them to extract richer scene features and reduce information loss compared to traditional planners. This raises a crucial research question: how can we…

Computer Vision and Pattern Recognition · Computer Science 2025-03-03 Yingyan Li , Lue Fan , Jiawei He , Yuqi Wang , Yuntao Chen , Zhaoxiang Zhang , Tieniu Tan

In the learning from demonstration (LfD) paradigm, understanding and evaluating the demonstrated behaviors plays a critical role in extracting control policies for robots. Without this knowledge, a robot may infer incorrect reward functions…

Robotics · Computer Science 2022-12-20 Aniruddh G. Puranic , Jyotirmoy V. Deshmukh , Stefanos Nikolaidis

Autonomous car racing is a challenging task, as it requires precise applications of control while the vehicle is operating at cornering speeds. Traditional autonomous pipelines require accurate pre-mapping, localization, and planning which…

Robotics · Computer Science 2023-03-07 Dvij Kalaria , Qin Lin , John M. Dolan

Navigating through intersections is one of the main challenging tasks for an autonomous vehicle. However, for the majority of intersections regulated by traffic lights, the problem could be solved by a simple rule-based method in which the…

Robotics · Computer Science 2021-05-04 Alessandro Paolo Capasso , Paolo Maramotti , Anthony Dell'Eva , Alberto Broggi

End-to-end autonomous driving provides a feasible way to automatically maximize overall driving system performance by directly mapping the raw pixels from a front-facing camera to control signals. Recent advanced methods construct a latent…

Machine Learning · Computer Science 2024-05-21 Zeyu Gao , Yao Mu , Chen Chen , Jingliang Duan , Shengbo Eben Li , Ping Luo , Yanfeng Lu

A principal barrier to large-scale deployment of urban autonomous driving systems lies in the prevalence of complex scenarios and edge cases. Existing systems fail to effectively interpret semantic information within traffic contexts and…

Robotics · Computer Science 2025-07-09 Yuhang Zhang , Jiaqi Liu , Chengkai Xu , Peng Hang , Jian Sun

Autonomous driving systems need to handle complex scenarios such as lane following, avoiding collisions, taking turns, and responding to traffic signals. In recent years, approaches based on end-to-end behavioral cloning have demonstrated…

Robotics · Computer Science 2021-04-23 Keishi Ishihara , Anssi Kanervisto , Jun Miura , Ville Hautamäki

Urban autonomous driving is an open and challenging problem to solve as the decision-making system has to account for several dynamic factors like multi-agent interactions, diverse scene perceptions, complex road geometries, and other…

Artificial Intelligence · Computer Science 2021-08-30 Arjit Sharma , Sahil Sharma

In the area of learning-driven artificial intelligence advancement, the integration of machine learning (ML) into self-driving (SD) technology stands as an impressive engineering feat. Yet, in real-world applications outside the confines of…

Robotics · Computer Science 2023-09-06 Haozhe Lei , Quanyan Zhu

The success of automated driving deployment is highly depending on the ability to develop an efficient and safe driving policy. The problem is well formulated under the framework of optimal control as a cost optimization problem. Model…

Artificial Intelligence · Computer Science 2017-06-14 Ahmad El Sallab , Mahmoud Saeed , Omar Abdel Tawab , Mohammed Abdou

In this paper, we present a system to train driving policies from experiences collected not just from the ego-vehicle, but all vehicles that it observes. This system uses the behaviors of other agents to create more diverse driving…

Robotics · Computer Science 2022-09-13 Dian Chen , Philipp Krähenbühl

Robot learning from demonstration (LfD) is a research paradigm that can play an important role in addressing the issue of scaling up robot learning. Since this type of approach enables non-robotics experts can teach robots new knowledge…

Robotics · Computer Science 2017-10-25 Jangwon Lee

Our research investigates the challenges Deep Reinforcement Learning (DRL) faces in complex, Partially Observable Markov Decision Processes (POMDP) such as autonomous driving (AD), and proposes a solution for vision-based navigation in…

Computer Vision and Pattern Recognition · Computer Science 2024-09-18 Shawan Mohammed , Alp Argun , Nicolas Bonnotte , Gerd Ascheid

Ego-centric driving videos available online provide an abundant source of visual data for autonomous driving, yet their lack of annotations makes it difficult to learn representations that capture both semantic structure and 3D geometry.…

Computer Vision and Pattern Recognition · Computer Science 2026-03-06 Matthew Strong , Wei-Jer Chang , Quentin Herau , Jiezhi Yang , Yihan Hu , Chensheng Peng , Wei Zhan

End-to-end autonomous driving models based on Vision-Language-Action (VLA) architectures have shown promising results by learning driving policies through behavior cloning on expert demonstrations. However, imitation learning inherently…

Computer Vision and Pattern Recognition · Computer Science 2026-04-06 Zihao Sheng , Xin Ye , Jingru Luo , Sikai Chen , Liu Ren

Modern end-to-end learning systems can learn to explicitly infer control from perception. However, it is difficult to guarantee stability and robustness for these systems since they are often exposed to unstructured, high-dimensional, and…

Robotics · Computer Science 2023-04-07 Tsun-Hsuan Wang , Wei Xiao , Makram Chahine , Alexander Amini , Ramin Hasani , Daniela Rus