English
Related papers

Related papers: DRAMA: Joint Risk Localization and Captioning in D…

200 papers

Autonomous Cyber-Physical Systems must often operate under uncertainties like sensor degradation and shifts in the operating conditions, which increases its operational risk. Dynamic Assurance of these systems requires designing runtime…

Robotics · Computer Science 2022-03-01 Shreyas Ramakrishna , Baiting Luo , Yogesh Barve , Gabor Karsai , Abhishek Dubey

Developing autonomous driving systems for complex traffic environments requires balancing multiple objectives, such as avoiding collisions, obeying traffic rules, and making efficient progress. In many situations, these objectives cannot be…

This research explores the integration of language embeddings for active learning in autonomous driving datasets, with a focus on novelty detection. Novelty arises from unexpected scenarios that autonomous vehicles struggle to navigate,…

Computer Vision and Pattern Recognition · Computer Science 2024-02-13 Ross Greer , Mohan Trivedi

Large Vision Language Models (LVLMs) have shown strong capabilities in understanding and analyzing visual scenes across various domains. However, in the context of autonomous driving, their limited comprehension of 3D environments restricts…

Computer Vision and Pattern Recognition · Computer Science 2025-05-02 Jannik Lübberstedt , Esteban Rivera , Nico Uhlemann , Markus Lienkamp

Simulation of conflict situations for autonomous driving research is crucial for understanding and managing interactions between Automated Vehicles (AVs) and human drivers. This paper presents a set of exemplary conflict scenarios in CARLA…

Human-Computer Interaction · Computer Science 2025-03-24 Tsvetomila Mihaylova , Stefan Reitmann , Elin A. Topp , Ville Kyrki

We present an optimization-based method to plan the motion of an autonomous robot under the uncertainties associated with dynamic obstacles, such as humans. Our method bounds the marginal risk of collisions at each point in time by…

Robotics · Computer Science 2021-03-24 O. de Groot , B. Brito , L. Ferranti , D. Gavrila , J. Alonso-Mora

As the demand for autonomous driving increases, it is paramount to ensure safety. Early accident prediction using deep learning methods for driving safety has recently gained much attention. In this task, early accident prediction and a…

Artificial Intelligence · Computer Science 2022-12-12 Injoon Cho , Praveen Kumar Rajendran , Taeyoung Kim , Dongsoo Har

An open question in autonomous driving is how best to use simulation to validate the safety of autonomous vehicles. Existing techniques rely on simulated rollouts, which can be inefficient for finding rare failure events, while other…

Robotics · Computer Science 2020-06-29 Anthony Corso , Ritchie Lee , Mykel J. Kochenderfer

Reinforcement learning (RL) has shown to reach super human-level performance across a wide range of tasks. However, unlike supervised machine learning, learning strategies that generalize well to a wide range of situations remains one of…

Machine Learning · Computer Science 2022-07-26 Sebastian Rietsch , Shih-Yuan Huang , Georgios Kontes , Axel Plinge , Christopher Mutschler

Automated driving in level 3 autonomy has been adopted by multiple companies such as Tesla and BMW, alleviating the burden on drivers while unveiling new complexities. This article focused on the under-explored territory of micro accidents…

Human-Computer Interaction · Computer Science 2025-08-12 Wei Xiang , Chuyue Zhang , Jie Yan

Reliable collision avoidance under extreme situations remains a critical challenge for autonomous vehicles. While large language models (LLMs) offer promising reasoning capabilities, their application in safety-critical evasive maneuvers is…

Robotics · Computer Science 2025-06-12 Shiyue Zhao , Junzhi Zhang , Neda Masoud , Heye Huang , Xiaohui Hou , Chengkun He

Adversarial scenario generation is crucial for autonomous driving testing because it can efficiently simulate various challenge and complex traffic conditions. However, it is difficult to control current existing methods to generate desired…

Robotics · Computer Science 2024-08-27 Shuo Yang , Caojun Wang , Yuanjian Zhang , Yuming Yin , Yanjun Huang , Shengbo Eben Li , Hong Chen

Autonomous driving research currently faces data sparsity in representation of risky scenarios. Such data is both difficult to obtain ethically in the real world, and unreliable to obtain via simulation. Recent advances in virtual reality…

Robotics · Computer Science 2023-03-10 Laura Zheng , Julio Poveda , James Mullen , Shreelekha Revankar , Ming C. Lin

We introduce RoadSocial, a large-scale, diverse VideoQA dataset tailored for generic road event understanding from social media narratives. Unlike existing datasets limited by regional bias, viewpoint bias and expert-driven annotations,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-28 Chirag Parikh , Deepti Rawat , Rakshitha R. T. , Tathagata Ghosh , Ravi Kiran Sarvadevabhatla

Autonomous driving technology has the potential to transform transportation, but its wide adoption depends on the development of interpretable and transparent decision-making systems. Scene captioning, which generates natural language…

Computer Vision and Pattern Recognition · Computer Science 2025-07-28 Felix Brandstaetter , Erik Schuetz , Katharina Winter , Fabian Flohr

Many decision-making scenarios in modern life benefit from the decision support of artificial intelligence algorithms, which focus on a data-driven philosophy and automated programs or systems. However, crucial decision issues related to…

Artificial Intelligence · Computer Science 2023-12-29 Xia Wang , Anda Liang , Jonathan Sprinkle , Taylor T. Johnson

Risk quantification is a critical component of safe autonomous driving, however, constrained by the limited perception range and occlusion of single-vehicle systems in complex and dense scenarios. Vehicle-to-everything (V2X) paradigm has…

Robotics · Computer Science 2025-06-23 Mingyue Lei , Zewei Zhou , Hongchen Li , Jia Hu , Jiaqi Ma

Simulation-based testing is crucial for validating autonomous vehicles (AVs), yet existing scenario generation methods either overfit to common driving patterns or operate in an offline, non-interactive manner that fails to expose rare,…

Artificial Intelligence · Computer Science 2025-07-16 Yuewen Mei , Tong Nie , Jian Sun , Ye Tian

Autonomous driving has become one of the most popular research topics within Artificial Intelligence. An autonomous vehicle is understood as a system that combines perception, decision-making, planning, and control. All of those tasks…

Robotics · Computer Science 2023-06-01 Mariana Pinto , Inês Dutra , Joaquim Fonseca

Semantic segmentation is key in autonomous driving. Using deep visual learning architectures is not trivial in this context, because of the challenges in creating suitable large scale annotated datasets. This issue has been traditionally…

Computer Vision and Pattern Recognition · Computer Science 2021-10-25 Emanuele Alberti , Antonio Tavera , Carlo Masone , Barbara Caputo