English
Related papers

Related papers: Vision-Based Autonomous Driving: A Model Learning …

200 papers

Non-holonomic vehicle motion has been studied extensively using physics-based models. Common approaches when using these models interpret the wheel/ground interactions using a linear tire model and thus may not fully capture the nonlinear…

Robotics · Computer Science 2022-07-19 Taekyung Kim , Hojin Lee , Wonsuk Lee

Our research investigates the challenges Deep Reinforcement Learning (DRL) faces in complex, Partially Observable Markov Decision Processes (POMDP) such as autonomous driving (AD), and proposes a solution for vision-based navigation in…

Computer Vision and Pattern Recognition · Computer Science 2024-09-18 Shawan Mohammed , Alp Argun , Nicolas Bonnotte , Gerd Ascheid

Trustworthy AI is mandatory for the broad deployment of autonomous vehicles. Although end-to-end approaches derive control commands directly from raw data, interpreting these decisions remains challenging, especially in complex urban…

Computer Vision and Pattern Recognition · Computer Science 2025-10-22 Mona Mirzaie , Bodo Rosenhahn

World models learn the consequences of actions in vision-based interactive systems. However, in practical scenarios like autonomous driving, noncontrollable dynamics that are independent or sparsely dependent on action signals often exist,…

Machine Learning · Computer Science 2023-11-20 Minting Pan , Xiangming Zhu , Yitao Zheng , Yunbo Wang , Xiaokang Yang

In this paper, we investigate a predictive approach for collision risk assessment in autonomous and assisted driving. A deep predictive model is trained to anticipate imminent accidents from traditional video streams. In particular, the…

Robotics · Computer Science 2018-04-02 Mark Strickland , Georgios Fainekos , Heni Ben Amor

The technological and scientific challenges involved in the development of autonomous vehicles (AVs) are currently of primary interest for many automobile companies and research labs. However, human-controlled vehicles are likely to remain…

Machine Learning · Computer Science 2020-06-22 Ran Emuna , Avinoam Borowsky , Armin Biess

Urban autonomous driving is an open and challenging problem to solve as the decision-making system has to account for several dynamic factors like multi-agent interactions, diverse scene perceptions, complex road geometries, and other…

Artificial Intelligence · Computer Science 2021-08-30 Arjit Sharma , Sahil Sharma

Vision-language-action models have reshaped autonomous driving to incorporate languages into the decision-making process. However, most existing pipelines only utilize the language modality for scene descriptions or reasoning and lack the…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Sicheng Zuo , Yuxuan Li , Wenzhao Zheng , Zheng Zhu , Jie Zhou , Jiwen Lu

Autonomous vehicles with a self-evolving ability are expected to cope with unknown scenarios in the real-world environment. Take advantage of trial and error mechanism, reinforcement learning is able to self evolve by learning the optimal…

Robotics · Computer Science 2024-08-23 Shuo Yang , Liwen Wang , Yanjun Huang , Hong Chen

In this paper, we present an adherence-aware reinforcement learning (RL) approach aimed at seeking optimal lane-changing recommendations within a semi-autonomous driving environment to enhance a single vehicle's travel efficiency. The…

Machine Learning · Computer Science 2025-04-30 Weihao Sun , Heeseung Bang , Andreas A. Malikopoulos

Risk is traditionally described as the expected likelihood of an undesirable outcome, such as collisions for autonomous vehicles. Accurately predicting risk or potentially risky situations is critical for the safe operation of autonomous…

Artificial Intelligence · Computer Science 2021-06-10 Kasra Mokhtari , Alan R. Wagner

High-level driving behavior decision-making is an open-challenging problem for connected vehicle technology, especially in heterogeneous traffic scenarios. In this paper, a deep reinforcement learning based high-level driving behavior…

Machine Learning · Computer Science 2019-02-27 Zhengwei Bai , Baigen Cai , Wei Shangguan , Linguo Chai

Learning contextual and spatial environmental representations enhances autonomous vehicle's hazard anticipation and decision-making in complex scenarios. Recent perception systems enhance spatial understanding with sensor fusion but often…

Robotics · Computer Science 2024-01-18 Shoaib Azam , Farzeen Munir , Ville Kyrki , Moongu Jeon , Witold Pedrycz

Autonomous driving technology can improve traffic safety and reduce traffic accidents. In addition, it improves traffic flow, reduces congestion, saves energy and increases travel efficiency. In the relatively mature automatic driving…

Robotics · Computer Science 2024-03-13 Wenjian Sun , Linying Pan , Jingyu Xu , Weixiang Wan , Yong Wang

The end-to-end learning ability of self-driving vehicles has achieved significant milestones over the last decade owing to rapid advances in deep learning and computer vision algorithms. However, as autonomous driving technology is a…

Computer Vision and Pattern Recognition · Computer Science 2023-07-21 Shahin Atakishiyev , Mohammad Salameh , Housam Babiker , Randy Goebel

Vision-Language-Action (VLA) models are emerging as a promising paradigm for end-to-end autonomous driving, valued for their potential to leverage world knowledge and reason about complex driving scenes. However, existing methods suffer…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Xinyang Wang , Qian Liu , Wenjie Ding , Zhao Yang , Wei Li , Chang Liu , Bailin Li , Kun Zhan , Xianpeng Lang , Wei Chen

This paper addresses the problem of traffic prediction and control of autonomous vehicles on highways. A modified Interacting Multiple Model Kalman filter algorithm is applied to predict the motion behavior of the traffic participants by…

Systems and Control · Electrical Eng. & Systems 2023-10-12 Xiaorong Zhang , Sahar Zeinali , Georg Schildbach

Driving in a dynamic, multi-agent, and complex urban environment is a difficult task requiring a complex decision-making policy. The learning of such a policy requires a state representation that can encode the entire environment. Mid-level…

Machine Learning · Computer Science 2021-12-23 Eshagh Kargar , Ville Kyrki

In autonomous driving, end-to-end planners directly utilize raw sensor data, enabling them to extract richer scene features and reduce information loss compared to traditional planners. This raises a crucial research question: how can we…

Computer Vision and Pattern Recognition · Computer Science 2025-03-03 Yingyan Li , Lue Fan , Jiawei He , Yuqi Wang , Yuntao Chen , Zhaoxiang Zhang , Tieniu Tan

The robustness of any machine learning solution is fundamentally bound by the data it was trained on. One way to generalize beyond the original training is through human-informed augmentation of the original dataset; however, it is…

Machine Learning · Computer Science 2022-09-08 Nicholas A. Ketz , Praveen K. Pilly