English
Related papers

Related papers: Dual-Stage LLM Framework for Scenario-Centric Sema…

200 papers

Ensuring robust safety measures across a wide range of scenarios is crucial for user-facing systems. While Large Language Models (LLMs) can generate valuable data for safety measures, they often exhibit distributional biases, focusing on…

Computation and Language · Computer Science 2024-10-16 Sabit Hassan , Anthony Sicilia , Malihe Alikhani

Temporal understanding in autonomous driving (AD) remains a significant challenge, even for recent state-of-the-art (SoTA) Vision-Language Models (VLMs). Prior work has introduced datasets and benchmarks aimed at improving temporal…

Computer Vision and Pattern Recognition · Computer Science 2025-12-18 Kevin Cannons , Saeed Ranjbar Alvar , Mohammad Asiful Hossain , Ahmad Rezaei , Mohsen Gholami , Alireza Heidarikhazaei , Zhou Weimin , Yong Zhang , Mohammad Akbari

While Multi-Agent Systems (MAS) empower Large Language Models to tackle complex reasoning tasks through collaborative interaction, optimizing their dynamics remains a formidable challenge due to the discrete, non-differentiable nature of…

Multiagent Systems · Computer Science 2026-05-29 Wenwu Li , Yuran Song , Mingze Zhao , Bo Jin , Wenhao Li

The integration of Large Language Models (LLMs) with microscopic traffic simulation offers a promising path toward autonomous urban planning and intelligent transportation analysis. However, existing monolithic agent architectures often…

Multiagent Systems · Computer Science 2026-05-28 Shuyang Li , Ruimin Ke

The concept of scenario and its many qualifications -- specifically logical and abstract scenarios -- have emerged as a foundational element in safeguarding automated driving systems. However, the original linguistic definitions of the…

Robotics · Computer Science 2025-04-08 Christian Neurohr , Lukas Westhofen , Tjark Koopmann , Eike Möhlmann , Eckard Böde , Axel Hahn

Driving scenario data play an increasingly vital role in the development of intelligent vehicles and autonomous driving. Accurate and efficient scenario data search is critical for both online vehicle decision-making and planning, and…

Robotics · Computer Science 2025-04-08 Cheng Chang , Jingwei Ge , Jiazhe Guo , Zelin Guo , Binghong Jiang , Li Li

With increasing complexity of Automated Driving Systems (ADS), ensuring their safety and reliability has become a critical challenge. The Verification and Validation (V&V) of these systems are particularly demanding when AI components are…

Logic in Computer Science · Computer Science 2023-11-17 Srajan Goyal , Alberto Griggio , Jacob Kimblad , Stefano Tonetta

The rapid growth of ego-centric dashcam footage presents a major challenge for detecting safety-critical events such as collisions and near-collisions, scenarios that are brief, rare, and difficult for generic vision models to capture.…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Mohammad Qazim Bhat , Yufan Huang , Niket Agarwal , Hao Wang , Michael Woods , John Kenyon , Tsung-Yi Lin , Xiaodong Yang , Ming-Yu Liu , Kevin Xie

Autonomous vehicle navigation in complex environments such as dense and fast-moving highways and merging scenarios remains an active area of research. A key limitation of RL is its reliance on well-specified reward functions, which often…

Machine Learning · Computer Science 2025-11-18 Timur Anvar , Jeffrey Chen , Yuyan Wang , Rohan Chandra

Despite the growing prevalence of large language models (LLMs) in domain-specific applications, the challenge of query understanding in the automotive sector still remains underexplored. This domain presents unique complexities due to its…

Information Retrieval · Computer Science 2026-04-21 Isha Motiyani , Abhishek Kumar , Tilak Kasturi

Designing diverse and safety-critical driving scenarios is essential for evaluating autonomous driving systems. In this paper, we propose a novel framework that leverages Large Language Models (LLMs) for few-shot code generation to…

Robotics · Computer Science 2026-04-14 Yongjie Fu , Ruijian Zha , Pei Tian , Xuan Di

Large-scale Vision Language Models (LVLMs) exhibit advanced capabilities in tasks that require visual information, including object detection. These capabilities have promising applications in various industrial domains, such as autonomous…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Haruki Sakajo , Hiroshi Takato , Hiroshi Tsutsui , Komei Soda , Hidetaka Kamigaito , Taro Watanabe

LLM systems must make control decisions in addition to generating outputs: whether to answer, clarify, retrieve, call tools, repair, or escalate. In many current architectures, these decisions remain implicit within generation, entangling…

Artificial Intelligence · Computer Science 2026-04-02 Wei Sun

Motorcycles face disproportionately high crash risks compared to cars due to limited protection and heightened sensitivity to surface hazards, yet Advanced Rider Assistance Systems (ARAS) remain underdeveloped relative to Advanced Driver…

Recent advances in foundation models (FMs), including large language models (LLMs), vision-language models (VLMs), and world models, have opened new opportunities for autonomous driving systems (ADSs) in perception, reasoning,…

Software Engineering · Computer Science 2026-04-03 Xiongfei Wu , Mingfei Cheng , Xiaoning Ren , Qiang Hu , Jianlang Chen , Yuheng Huang , Maxime Cordy , Yao Zhang , Xiaofei Xie , Lei Ma , Yves Le Traon

Large Language Models (LLMs), AI models trained on massive text corpora with remarkable language understanding and generation capabilities, are transforming the field of Autonomous Driving (AD). As AD systems evolve from rule-based and…

Artificial Intelligence · Computer Science 2024-07-30 Yun Li , Kai Katsumata , Ehsan Javanmardi , Manabu Tsukada

Ensuring both safety and efficiency in decision-making for autonomous driving systems remains a fundamental challenge. Traditional Deep Reinforcement Learning (DRL) suffers from unsafe random exploration and slow convergence, while Large…

Robotics · Computer Science 2026-05-28 Kangyu Wu , Peng Cui , Guoxi Chen , Ya Zhang

Large Language Models are being increasingly deployed as the decision-making core of autonomous agents capable of effecting change in external environments. Yet, in conversational benchmarks, which simulate real-world customer-centric issue…

Computation and Language · Computer Science 2026-04-29 Amir Saeidi , Venkatesh Mishra , Souradeep Mukhopadhyay , Gaowen Liu , Ali Payani , Jayanth Srinivasa , Chitta Baral

How many scenarios are sufficient to validate the safe Operational Design Domain (ODD) of an Automated Driving System (ADS) equipped vehicle? Is a more significant number of sampled scenarios guaranteeing a more accurate safety assessment…

Robotics · Computer Science 2021-11-16 Bowen Weng , Linda Capito , Umit Ozguner , Keith Redmill

Large Language Models (LLMs) challenge conventional automated programming assessment because students can now produce functionally correct code without demonstrating corresponding understanding. This paper makes two contributions. First, it…

Software Engineering · Computer Science 2026-04-09 Eduard Frankford , Erik Cikalleshi , Ruth Breu