English
Related papers

Related papers: Traffic Regulation-aware Path Planning with Regula…

200 papers

Computer Vision, either alone or combined with other technologies such as radar or Lidar, is one of the key technologies used in Advanced Driver Assistance Systems (ADAS). Its role understanding and analysing the driving scene is of great…

Computer Vision and Pattern Recognition · Computer Science 2015-04-29 Gorka Velez , Oihana Otaegui

Scenario-based testing for automated driving systems (ADS) must be able to simulate traffic scenarios that rely on interactions with other vehicles. Although many languages for high-level scenario modelling have been proposed, they lack the…

In this paper, we introduce VisioPath, a novel framework combining vision-language models (VLMs) with model predictive control (MPC) to enable safe autonomous driving in dynamic traffic environments. The proposed approach leverages a…

Systems and Control · Electrical Eng. & Systems 2025-07-10 Shanting Wang , Panagiotis Typaldos , Chenjun Li , Andreas A. Malikopoulos

Deep Reinforcement Learning (DRL) uses diverse, unstructured data and makes RL capable of learning complex policies in high dimensional environments. Intelligent Transportation System (ITS) based on Autonomous Vehicles (AVs) offers an…

Machine Learning · Computer Science 2022-06-30 Anum Mushtaq , Irfan ul Haq , Muhammad Azeem Sarwar , Asifullah Khan , Omair Shafiq

Semi-autonomous driving, as it is already available today and will eventually become even more accessible, implies the need for driver and automation system to reliably work together in order to ensure safe driving. A particular challenge…

Artificial Intelligence · Computer Science 2023-08-31 Jakob Suchan , Jan-Patrick Osterloh

While Vision-Language Models (VLMs) show significant promise for end-to-end autonomous driving by leveraging the common sense embedded in language models, their reliance on 2D image cues for complex scene understanding and decision-making…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Weijie Wei , Zhipeng Luo , Ling Feng , Venice Erin Liong

With the development of advanced communication technology, connected vehicles become increasingly popular in our transportation systems, which can conduct cooperative maneuvers with each other as well as road entities through…

Human-Computer Interaction · Computer Science 2020-09-01 Ziran Wang , Kyungtae Han , Prashant Tiwari

In this paper, we propose a novel framework for enhancing visual comprehension in autonomous driving systems by integrating visual language models (VLMs) with additional visual perception module specialised in object detection. We extend…

Computer Vision and Pattern Recognition · Computer Science 2024-11-12 Linfeng He , Yiming Sun , Sihao Wu , Jiaxu Liu , Xiaowei Huang

The safety and reliability of Automated Driving Systems (ADSs) must be validated prior to large-scale deployment. Among existing validation approaches, scenario-based testing has been regarded as a promising method to improve testing…

Software Engineering · Computer Science 2026-01-05 Yongqi Zhao , Ji Zhou , Dong Bi , Tomislav Mihalj , Jia Hu , Arno Eichberger

Structured road understanding of lane geometry, topology, and traffic element relationships is foundational to safe autonomous driving. While vision-language models (VLMs) offer promising semantic flexibility, they lack the geometric and…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Lena Wild , Katie Z Luo , Marco Pavone

While Vision-Language Models (VLMs) enable high-level semantic reasoning for end-to-end autonomous driving, particularly in unstructured environments, existing off-road datasets suffer from language annotations that are weakly aligned with…

Robotics · Computer Science 2026-04-24 Byounggun Park , Soonmin Hwang

Traffic safety remains a critical global challenge, with traditional Advanced Driver-Assistance Systems (ADAS) often struggling in dynamic real-world scenarios due to fragmented sensor processing and susceptibility to adversarial…

Computer Vision and Pattern Recognition · Computer Science 2025-04-24 Mohammad Abu Tami , Mohammed Elhenawy , Huthaifa I. Ashqar

We present here a first prototype of a "Speed Limit Support" Advance Driving Assistance System (ADAS) producing permanent reliable information on the current speed limit applicable to the vehicle. Such a module can be used either for…

Computer Vision and Pattern Recognition · Computer Science 2010-10-20 Alexandre Bargeton , Fabien Moutarde , Fawzi Nashashibi , Anne-Sophie Puthon

Large language models (LLMs) are growingly extended to process multimodal data such as text and video simultaneously. Their remarkable performance in understanding what is shown in images is surpassing specialized neural networks (NNs) such…

Computer Vision and Pattern Recognition · Computer Science 2025-07-24 Malsha Ashani Mahawatta Dona , Beatriz Cabrero-Daniel , Yinan Yu , Christian Berger

Vision-language models (VLMs) have become a promising approach to enhancing perception and decision-making in autonomous driving. The gap remains in applying VLMs to understand complex scenarios interacting with pedestrians and efficient…

Computer Vision and Pattern Recognition · Computer Science 2025-07-31 Haoxiang Gao , Li Zhang , Yu Zhao , Zhou Yang , Jinghan Cao

Accurately understanding and deciding high-level meta-actions is essential for ensuring reliable and safe autonomous driving systems. While vision-language models (VLMs) have shown significant potential in various autonomous driving tasks,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-19 Yujin Wang , Quanfeng Liu , Zhengxin Jiang , Tianyi Wang , Junfeng Jiao , Hongqing Chu , Bingzhao Gao , Hong Chen

Advanced driver assistance systems (ADAS) often rely on deep neural networks to interpret driving images and support vehicle control. Although reliable under nominal conditions, these systems remain vulnerable to input variations and…

Software Engineering · Computer Science 2026-03-26 Hannes Leonhard , Stefano Carlo Lambertenghi , Andrea Stocco

Automatic license plate recognition (ALPR) and vehicle make and model recognition underpin intelligent transportation systems, supporting law enforcement, toll collection, and post-incident investigation. Applying these methods to videos…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Pouya Parsa , Keya Li , Kara M. Kockelman , Seongjin Choi

Modern driver assistance systems rely on a wide range of sensors (RADAR, LIDAR, ultrasound and cameras) for scene understanding and prediction. These sensors are typically used for detecting traffic participants and scene elements required…

Computer Vision and Pattern Recognition · Computer Science 2018-05-21 JeongYeol Baek , Ioana Veronica Chelu , Livia Iordache , Vlad Paunescu , HyunJoo Ryu , Alexandru Ghiuta , Andrei Petreanu , YunSung Soh , Andrei Leica , ByeongMoon Jeon

Ensuring reliable autonomous operation when visual input is degraded remains a key challenge in intelligent vehicles and robotics. We present DepthVision, a multimodal framework that enables Vision--Language Models (VLMs) to exploit LiDAR…

Robotics · Computer Science 2025-11-19 Sven Kirchner , Nils Purschke , Ross Greer , Alois C. Knoll