English
Related papers

Related papers: Geo-Context Aware Study of Vision-Based Autonomous…

200 papers

The advancement of autonomous driving technologies necessitates increasingly sophisticated methods for understanding and predicting real-world scenarios. Vision language models (VLMs) are emerging as revolutionary tools with significant…

Computer Vision and Pattern Recognition · Computer Science 2024-08-30 Yongjie Fu , Anmol Jain , Xuan Di , Xu Chen , Zhaobin Mo

Autonomous Vehicles (AVs) must make reliable decisions in dense urban environments where pedestrian behavior is variable, sometimes abnormal, and often unseen during training. Reinforcement learning (RL)-based AV control systems perform…

Robotics · Computer Science 2026-05-19 Aidana Baimbetova , Haruki Yonekura , Hamada Rizk , Hirozumi Yamaguchi

Autonomous driving systems face significant challenges in handling unpredictable edge-case scenarios, such as adversarial pedestrian movements, dangerous vehicle maneuvers, and sudden environmental changes. Current end-to-end driving models…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Dianwei Chen , Zifan Zhang , Lei Cheng , Yuchen Liu , Xianfeng Terry Yang

Deep learning models for autonomous driving, encompassing perception, planning, and control, depend on vast datasets to achieve their high performance. However, their generalization often suffers due to domain-specific data distributions,…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Esteban Rivera , Jannik Lübberstedt , Nico Uhlemann , Markus Lienkamp

In this paper, we introduce a learning-based vision dynamics approach to nonlinear model predictive control for autonomous vehicles, coined LVD-NMPC. LVD-NMPC uses an a-priori process model and a learned vision dynamics model used to…

Robotics · Computer Science 2021-05-28 Sorin Grigorescu , Cosmin Ginerica , Mihai Zaha , Gigel Macesanu , Bogdan Trasnea

Virtual development and prototyping has already become an integral part in the field of automated driving systems (ADS). There are plenty of software tools that are used for the virtual development of ADS. One such tool is CarMaker from IPG…

Robotics · Computer Science 2021-04-16 Philip Pannagger , Demin Nalic , Faris Orucevic , Arno Eichberger , Branko Rogic

Recent research on Large Language Models for autonomous driving shows promise in planning and control. However, high computational demands and hallucinations still challenge accurate trajectory prediction and control signal generation.…

Robotics · Computer Science 2024-10-03 Ziang Guo , Zakhar Yagudin , Artem Lykov , Mikhail Konenkov , Dzmitry Tsetserukou

Vision-based autonomous driving has gained much attention due to its low costs and excellent performance. Compared with dense BEV (Bird's Eye View) or sparse query models, Gaussian-centric method is a comprehensive yet sparse representation…

Computer Vision and Pattern Recognition · Computer Science 2026-04-02 Yiyao Zhu , Ying Xue , Haiming Zhang , Guangfeng Jiang , Wending Zhou , Xu Yan , Jiantao Gao , Yingjie Cai , Bingbing Liu , Zhen Li , Shaojie Shen

Behaviour prediction function of an autonomous vehicle predicts the future states of the nearby vehicles based on the current and past observations of the surrounding environment. This helps enhance their awareness of the imminent hazards.…

Computer Vision and Pattern Recognition · Computer Science 2020-08-07 Sajjad Mozaffari , Omar Y. Al-Jarrah , Mehrdad Dianati , Paul Jennings , Alexandros Mouzakitis

The rapid progress of multimodal large language models (MLLM) has paved the way for Vision-Language-Action (VLA) paradigms, which integrate visual perception, natural language understanding, and control within a single policy. Researchers…

In this paper, we investigate a predictive approach for collision risk assessment in autonomous and assisted driving. A deep predictive model is trained to anticipate imminent accidents from traditional video streams. In particular, the…

Robotics · Computer Science 2018-04-02 Mark Strickland , Georgios Fainekos , Heni Ben Amor

Interpreting natural-language commands to localize target objects is critical for autonomous driving (AD). Existing visual grounding (VG) methods for autonomous vehicles (AVs) typically struggle with ambiguous, context-dependent…

Computer Vision and Pattern Recognition · Computer Science 2026-05-11 Haicheng Liao , Huanming Shen , Bonan Wang , Yongkang Li , Yihong Tang , Chengyue Wang , Dingyi Zhuang , Kehua Chen , Hai Yang , Chengzhong Xu , Zhenning Li

Vision-Language-Action (VLA) models have emerged as a promising framework for end-to-end autonomous driving. However, existing VLAs typically rely on sparse action supervision, which underutilizes their powerful scene understanding and…

Computer Vision and Pattern Recognition · Computer Science 2026-05-22 Xiaodong Mei , Diankun Zhang , Hongwei Xie , Guang Chen , Hangjun Ye , Dan Xu

Modern driver assistance systems rely on a wide range of sensors (RADAR, LIDAR, ultrasound and cameras) for scene understanding and prediction. These sensors are typically used for detecting traffic participants and scene elements required…

Computer Vision and Pattern Recognition · Computer Science 2018-05-21 JeongYeol Baek , Ioana Veronica Chelu , Livia Iordache , Vlad Paunescu , HyunJoo Ryu , Alexandru Ghiuta , Andrei Petreanu , YunSung Soh , Andrei Leica , ByeongMoon Jeon

Spatiotemporal intelligence in autonomous driving (AD) requires an agent to integrate multi-view observations into a coherent scene representation, maintain object continuity across viewpoints and time, and reason about spatial relations,…

The safe deployment of autonomous vehicles relies on their ability to effectively react to environmental changes. This can require maneuvering on varying surfaces which is still a difficult problem, especially for slippery terrains. To…

Robotics · Computer Science 2023-03-22 Johan Vertens , Nicolai Dorka , Tim Welschehold , Michael Thompson , Wolfram Burgard

A key component in autonomous driving is the ability of the self-driving car to understand, track and predict the dynamics of the surrounding environment. Although there is significant work in the area of object detection, tracking and…

Robotics · Computer Science 2021-07-20 Cosmin Ginerica , Mihai Zaha , Florin Gogianu , Lucian Busoniu , Bogdan Trasnea , Sorin Grigorescu

The driving environment perception has a vital role for autonomous driving and nowadays has been actively explored for its realization. The research community and relevant stakeholders necessitate the development of Deep Learning (DL)…

Artificial Intelligence · Computer Science 2025-10-16 Jalal Khan , Manzoor Khan , Sherzod Turaev , Sumbal Malik , Hesham El-Sayed , Farman Ullah

In autonomous driving, perception systems are piv otal as they interpret sensory data to understand the envi ronment, which is essential for decision-making and planning. Ensuring the safety of these perception systems is fundamental for…

Robotics · Computer Science 2024-11-19 Urvishkumar Bharti , Vikram Shahapur

Autonomous driving is a multi-task problem requiring a deep understanding of the visual environment. End-to-end autonomous systems have attracted increasing interest as a method of learning to drive without exhaustively programming…

Computer Vision and Pattern Recognition · Computer Science 2019-09-12 Alexander Makrigiorgos , Ali Shafti , Alex Harston , Julien Gerard , A. Aldo Faisal