English
Related papers

Related papers: DRAMA: Joint Risk Localization and Captioning in D…

200 papers

Ensuring safe interactions between autonomous vehicles (AVs) and human drivers in mixed traffic systems remains a major challenge, particularly in complex, high-risk scenarios. This paper presents a cognition-decision framework that…

Artificial Intelligence · Computer Science 2025-03-18 Heye Huang , Zheng Li , Hao Cheng , Haoran Wang , Junkai Jiang , Xiaopeng Li , Arkady Zgonnikov

Grounding a command to the visual environment is an essential ingredient for interactions between autonomous vehicles and humans. In this work, we study the problem of language grounding for autonomous vehicles, which aims to localize a…

Computer Vision and Pattern Recognition · Computer Science 2022-03-15 Hou Pong Chan , Mingxi Guo , Cheng-Zhong Xu

Applying reinforcement learning to autonomous driving entails particular challenges, primarily due to dynamically changing traffic flows. To address such challenges, it is necessary to quickly determine response strategies to the changing…

Robotics · Computer Science 2022-12-12 Se-Wook Yoo , Chan Kim , Jin-Woo Choi , Seong-Woo Kim , Seung-Woo Seo

Despite impressive advancements in Autonomous Driving Systems (ADS), navigation in complex road conditions remains a challenging problem. There is considerable evidence that evaluating the subjective risk level of various decisions can…

Computer Vision and Pattern Recognition · Computer Science 2020-09-15 Shih-Yuan Yu , Arnav V. Malawade , Deepan Muthirayan , Pramod P. Khargonekar , Mohammad A. Al Faruque

Driver assistance systems are designed to increase comfort and safety by automating parts of the driving task. At the same time, modern in-vehicle information systems with large touchscreens provide the driver with numerous options for…

Human-Computer Interaction · Computer Science 2023-05-26 Patrick Ebel , Christoph Lingenfelder , Andreas Vogelsang

We present ChatScene, a Large Language Model (LLM)-based agent that leverages the capabilities of LLMs to generate safety-critical scenarios for autonomous vehicles. Given unstructured language instructions, the agent first generates…

Artificial Intelligence · Computer Science 2024-05-24 Jiawei Zhang , Chejian Xu , Bo Li

In this work, we present a reward-driven automated curriculum reinforcement learning approach for interaction-aware self-driving at unsignalized intersections, taking into account the uncertainties associated with surrounding vehicles…

Robotics · Computer Science 2025-01-16 Zengqi Peng , Xiao Zhou , Lei Zheng , Yubin Wang , Jun Ma

This paper offers a formal framework for the rare collision risk estimation of autonomous vehicles (AVs) with multi-agent situation awareness, affected by different sources of noise in a complex dynamic environment. In our proposed setting,…

Systems and Control · Electrical Eng. & Systems 2024-05-03 Mahdieh Zaker , Henk A. P. Blom , Sadegh Soudjani , Abolfazl Lavaei

Ensuring validation for highly automated driving poses significant obstacles to the widespread adoption of highly automated vehicles. Scenario-based testing offers a potential solution by reducing the homologation effort required for these…

Machine Learning · Computer Science 2023-09-19 Maximilian Zipfl , Moritz Jarosch , J. Marius Zöllner

Traffic scene recognition, which requires various visual classification tasks, is a critical ingredient in autonomous vehicles. However, most existing approaches treat each relevant task independently from one another, never considering the…

Computer Vision and Pattern Recognition · Computer Science 2020-04-06 Younkwan Lee , Jihyo Jeon , Jongmin Yu , Moongu Jeon

In this paper we present a novel dataset for a critical aspect of autonomous driving, the joint attention that must occur between drivers and of pedestrians, cyclists or other drivers. This dataset is produced with the intention of…

Robotics · Computer Science 2020-04-24 Iuliia Kotseruba , Amir Rasouli , John K. Tsotsos

The end-to-end learning ability of self-driving vehicles has achieved significant milestones over the last decade owing to rapid advances in deep learning and computer vision algorithms. However, as autonomous driving technology is a…

Computer Vision and Pattern Recognition · Computer Science 2023-07-21 Shahin Atakishiyev , Mohammad Salameh , Housam Babiker , Randy Goebel

Intelligent driving systems aim to achieve a zero-collision mobility experience, requiring interdisciplinary efforts to enhance safety performance. This work focuses on risk identification, the process of identifying and analyzing risks…

Computer Vision and Pattern Recognition · Computer Science 2024-03-06 Chi-Hsi Kung , Chieh-Chi Yang , Pang-Yuan Pao , Shu-Wei Lu , Pin-Lun Chen , Hsin-Cheng Lu , Yi-Ting Chen

Modern self-driving autonomy systems heavily rely on deep learning. As a consequence, their performance is influenced significantly by the quality and richness of the training data. Data collecting platforms can generate many hours of raw…

Machine Learning · Computer Science 2021-01-19 Abbas Sadat , Sean Segal , Sergio Casas , James Tu , Bin Yang , Raquel Urtasun , Ersin Yumer

Time-to-Contact (TTC) estimation is a critical task for assessing collision risk and is widely used in various driver assistance and autonomous driving systems. The past few decades have witnessed development of related theories and…

Computer Vision and Pattern Recognition · Computer Science 2023-11-07 Yuheng Shi , Zehao Huang , Yan Yan , Naiyan Wang , Xiaojie Guo

Safety-critical traffic scenarios are integral to the development and validation of autonomous driving systems. These scenarios provide crucial insights into vehicle responses under high-risk conditions rarely encountered in real-world…

Robotics · Computer Science 2024-10-08 Jinxiong Lu , Shoaib Azam , Gokhan Alcan , Ville Kyrki

The driving behavior at urban intersections is very complex. It is thus crucial for autonomous vehicles to comprehensively understand challenging urban traffic scenes in order to navigate intersections and prevent accidents. In this paper,…

Computer Vision and Pattern Recognition · Computer Science 2021-12-13 Prarthana Bhattacharyya , Yanlei Gu , Jiali Bao , Xu Liu , Shunsuke Kamijo

Autonomous driving has been the subject of increased interest in recent years both in industry and in academia. Serious efforts are being pursued to address legal, technical and logistical problems and make autonomous cars a viable option…

Artificial Intelligence · Computer Science 2016-08-31 Nan Li , Dave Oyler , Mengxuan Zhang , Yildiray Yildiz , Ilya Kolmanovsky , Anouck Girard

Text and signs around roads provide crucial information for drivers, vital for safe navigation and situational awareness. Scene text recognition in motion is a challenging problem, while textual cues typically appear for a short time span,…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 George Tom , Minesh Mathew , Sergi Garcia , Dimosthenis Karatzas , C. V. Jawahar

Dashboard cameras capture a tremendous amount of driving scene video each day. These videos are purposefully coupled with vehicle sensing data, such as from the speedometer and inertial sensors, providing an additional sensing modality for…

Computer Vision and Pattern Recognition · Computer Science 2019-09-17 Seokju Lee , Junsik Kim , Tae-Hyun Oh , Yongseop Jeong , Donggeun Yoo , Stephen Lin , In So Kweon