English
Related papers

Related papers: Learning End-to-end Autonomous Driving using Guide…

200 papers

In this paper, we present an adherence-aware reinforcement learning (RL) approach aimed at seeking optimal lane-changing recommendations within a semi-autonomous driving environment to enhance a single vehicle's travel efficiency. The…

Machine Learning · Computer Science 2025-04-30 Weihao Sun , Heeseung Bang , Andreas A. Malikopoulos

While there have been advancements in autonomous driving control and traffic simulation, there have been little to no works exploring their unification with deep learning. Works in both areas seem to focus on entirely different exclusive…

Robotics · Computer Science 2023-04-10 Laura Zheng , Sanghyun Son , Ming C. Lin

Current Vision-Language-Action (VLA) paradigms in autonomous driving primarily rely on Imitation Learning (IL), which introduces inherent challenges such as distribution shift and causal confusion. Online Reinforcement Learning offers a…

Computer Vision and Pattern Recognition · Computer Science 2026-02-06 Haoyu Fu , Diankun Zhang , Zongchuang Zhao , Jianfeng Cui , Hongwei Xie , Bing Wang , Guang Chen , Dingkang Liang , Xiang Bai

Autonomous driving visual question answering (AD-VQA) aims to answer questions related to perception, prediction, and planning based on given driving scene images, heavily relying on the model's spatial understanding capabilities. Prior…

Computer Vision and Pattern Recognition · Computer Science 2025-04-02 Zhiyuan Zhang , Xiaofan Li , Zhihao Xu , Wenjie Peng , Zijian Zhou , Miaojing Shi , Shuangping Huang

Human intention prediction provides an augmented solution for the design of assistants and collaboration between the human driver and intelligent vehicles. In this study, a multi-task sequential learning framework is developed to predict…

Human-Computer Interaction · Computer Science 2022-07-04 Yang Xing , Wenbo Li , Xiaoyu Mo , Chen Lv

Widespread adoption of self-driving cars will depend not only on their safety but largely on their ability to interact with human users. Just like human drivers, self-driving cars will be expected to understand and safely follow…

Robotics · Computer Science 2019-10-18 Junha Roh , Chris Paxton , Andrzej Pronobis , Ali Farhadi , Dieter Fox

Urban autonomous driving decision making is challenging due to complex road geometry and multi-agent interactions. Current decision making methods are mostly manually designing the driving policy, which might result in sub-optimal solutions…

Machine Learning · Computer Science 2019-10-23 Jianyu Chen , Bodi Yuan , Masayoshi Tomizuka

Vision-Language Models (VLMs) have demonstrated significant potential for end-to-end autonomous driving. However, the field still lacks a practical platform that enables dynamic model updates, rapid validation, fair comparison, and…

Robotics · Computer Science 2025-09-16 Zhijie Qiao , Haowei Li , Zhong Cao , Henry X. Liu

Model Predictive Control lacks the ability to escape local minima in nonconvex problems. Furthermore, in fast-changing, uncertain environments, the conventional warmstart, using the optimal trajectory from the last timestep, often falls…

Systems and Control · Electrical Eng. & Systems 2023-10-05 Mohamed-Khalil Bouzidi , Yue Yao , Daniel Goehring , Joerg Reichardt

Learning from Demonstration (LfD) is a promising approach to enable Multi-Robot Systems (MRS) to acquire complex skills and behaviors. However, the intricate interactions and coordination challenges in MRS pose significant hurdles for…

Robotics · Computer Science 2024-04-04 Vishnunandan L. N. Venkatesh , Byung-Cheol Min

The establishment of fast and reliable communication technologies, such as 5G, is enabling the evolution of a new generation of connected ADAS. This work aims to develop a traffic light advisory system, Multiple Traffic Light Advisor…

Systems and Control · Electrical Eng. & Systems 2023-01-10 Michael Khayyat , Alberto Gabriele , Francesca Mancini , Stefano Arrigoni , Francesco Braghin

In robotics, there is need of an interactive and expedite learning method as experience is expensive. Robot Learning from Demonstration (RLfD) enables a robot to learn a policy from demonstrations performed by teacher. RLfD enables a human…

Robotics · Computer Science 2018-10-01 Sulabh Kumra , Ferat Sahin

Recent advancements in Vision-Language-Action (VLA) models have shown promise for end-to-end autonomous driving by leveraging world knowledge and reasoning capabilities. However, current VLA models often struggle with physically infeasible…

Computer Vision and Pattern Recognition · Computer Science 2025-11-07 Zewei Zhou , Tianhui Cai , Seth Z. Zhao , Yun Zhang , Zhiyu Huang , Bolei Zhou , Jiaqi Ma

Learning from Demonstration (LfD) stands as an efficient framework for imparting human-like skills to robots. Nevertheless, designing an LfD framework capable of seamlessly imitating, generalizing, and reacting to disturbances for…

Robotics · Computer Science 2024-06-25 Yan Zhang , Teng Xue , Amirreza Razmjoo , Sylvain Calinon

In complex environments with high dimension, training a reinforcement learning (RL) model from scratch often suffers from lengthy and tedious collection of agent-environment interactions. Instead, leveraging expert demonstration to guide RL…

Machine Learning · Computer Science 2021-09-28 Zhaorun Chen , Binhao Chen , Shenghan Xie , Liang Gong , Chengliang Liu , Zhengfeng Zhang , Junping Zhang

Latency-accuracy tradeoffs are fundamental in real-time applications of deep neural networks (DNNs) for cyber-physical systems. In autonomous driving, in particular, safety depends on both prediction quality and the end-to-end delay from…

Robotics · Computer Science 2026-05-29 Qitao Weng , Heechul Yun

For a self-driving car to operate reliably, its perceptual system must generalize to the end-user's environment -- ideally without additional annotation efforts. One potential solution is to leverage unlabeled data (e.g., unlabeled LiDAR…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Yurong You , Cheng Perng Phoo , Katie Z Luo , Travis Zhang , Wei-Lun Chao , Bharath Hariharan , Mark Campbell , Kilian Q. Weinberger

Advanced driver assistance systems require a comprehensive understanding of the driver's mental/physical state and traffic context but existing works often neglect the potential benefits of joint learning between these tasks. This paper…

Computer Vision and Pattern Recognition · Computer Science 2025-04-04 Wenzhuo Liu , Wenshuo Wang , Yicheng Qiao , Qiannan Guo , Jiayin Zhu , Pengfei Li , Zilong Chen , Huiming Yang , Zhiwei Li , Lening Wang , Tiao Tan , Huaping Liu

In the field of autonomous driving, there have been many excellent perception models for object detection, semantic segmentation, and other tasks, but how can we effectively use the perception models for vehicle planning? Traditional…

Robotics · Computer Science 2023-08-04 Jingyu Du , Yang Zhao , Hong Cheng

In autonomous driving, end-to-end (E2E) driving systems that predict control commands directly from sensor data have achieved significant advancements. For safe driving in unexpected scenarios, these systems may additionally rely on human…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Seo Hyun Kim , Jin Bok Park , Do Yeon Koo , Hogun Park , Il Yong Chun