English
Related papers

Related papers: LinguaSim: Interactive Multi-Vehicle Testing Scena…

200 papers

The safe deployment of autonomous driving systems (ADSs) relies on comprehensive testing and evaluation. However, safety-critical scenarios that can effectively expose system vulnerabilities are extremely sparse in the real world. Existing…

Robotics · Computer Science 2025-12-03 Xinzheng Wu , Junyi Chen , Naiting Zhong , Yong Shen

Deploying autonomous vision systems on edge devices faces a critical challenge: resource constraints prevent real-time and predictable execution of comprehensive safety tests. Existing validation methods depend on static datasets or manual…

Machine Learning · Computer Science 2026-04-10 Faezeh Pasandideh , Achim Rettberg

Vision-language models (VLMs) have recently emerged as powerful representation learning systems that align visual observations with natural language concepts, offering new opportunities for semantic reasoning in safety-critical autonomous…

Computer Vision and Pattern Recognition · Computer Science 2026-02-19 Ross Greer , Maitrayee Keskar , Angel Martinez-Sanchez , Parthib Roy , Shashank Shriram , Mohan Trivedi

In high-conflict mixed-traffic scenarios involving human-driven and autonomous vehicles, most existing autonomous driving systems default to overly conservative behaviors, lack proactive interaction, and consequently suffer from limited…

Robotics · Computer Science 2026-04-28 Xinwei Dong , Jiyang Li , Jiabin Xie , Yang Yi , Tianshang Jia , Shiyu Fang , Ye Tian , Peng Hang

The rapid advancement of large language models (LLMs) has accelerated progress toward universal AI assistants. However, existing benchmarks for personalized assistants remain misaligned with real-world user-assistant interactions, failing…

Computation and Language · Computer Science 2026-03-13 Feiyu Duan , Xuanjing Huang , Zhongyu Wei

Large Language Models (LLMs) are increasingly used to simulate how specific users respond to a given context, enabling more user-centric applications that rely on user feedback. However, existing user simulators mostly imitate surface-level…

Computation and Language · Computer Science 2026-03-05 Shirley Wu , Evelyn Choi , Arpandeep Khatua , Zhanghan Wang , Joy He-Yueya , Tharindu Cyril Weerasooriya , Wei Wei , Diyi Yang , Jure Leskovec , James Zou

With the broader adoption and highly successful development of Large Language Models (LLMs), there has been growing interest and demand for applying LLMs to autonomous driving technology. Driven by their natural language understanding and…

Autonomous Driving (AD) encounters significant safety hurdles in long-tail unforeseen driving scenarios, largely stemming from the non-interpretability and poor generalization of the deep neural networks within the AD system, particularly…

Artificial Intelligence · Computer Science 2024-03-25 Yixuan Wang , Ruochen Jiao , Sinong Simon Zhan , Chengtian Lang , Chao Huang , Zhaoran Wang , Zhuoran Yang , Qi Zhu

Autonomous driving has made significant strides through data-driven techniques, achieving robust performance in standardized tasks. However, existing methods frequently overlook user-specific preferences, offering limited scope for…

Robotics · Computer Science 2025-05-13 Chengkai Xu , Jiaqi Liu , Yicheng Guo , Yuhang Zhang , Peng Hang , Jian Sun

Recent advancements on Large Language Models (LLMs) enable AI Agents to automatically generate and execute multi-step plans to solve complex tasks. However, since LLM's content generation process is hardly controllable, current LLM-based…

Machine Learning · Computer Science 2024-08-13 Zelong Li , Wenyue Hua , Hao Wang , He Zhu , Yongfeng Zhang

Automated Driving System (ADS) is a safety-critical software system responsible for the interpretation of the vehicle's environment and making decisions accordingly. The unbounded complexity of the driving context, including unforeseeable…

Large language models (LLMs) have demonstrated remarkable performance by following natural language instructions without fine-tuning them on domain-specific tasks and data. However, leveraging LLMs for domain-specific question answering…

Evaluating the decision-making system is indispensable in developing autonomous vehicles, while realistic and challenging safety-critical test scenarios play a crucial role. Obtaining these scenarios is non-trivial, thanks to the…

Robotics · Computer Science 2024-08-08 Kunkun Hao , Yonggang Luo , Wen Cui , Yuqiao Bai , Jucheng Yang , Songyang Yan , Yuxi Pan , Zijiang Yang

Software engineers in various industrial domains are already using Large Language Models (LLMs) to accelerate the process of implementing parts of software systems. When considering its potential use for ADAS or AD systems in the automotive…

Software Engineering · Computer Science 2025-05-27 Ali Nouri , Beatriz Cabrero-Daniel , Zhennan Fei , Krishna Ronanki , Håkan Sivencrona , Christian Berger

Ensuring safe decision-making in autonomous vehicles remains a fundamental challenge despite rapid advances in end-to-end learning approaches. Traditional reinforcement learning (RL) methods rely on manually engineered rewards or sparse…

Robotics · Computer Science 2026-03-20 Zilin Huang , Zihao Sheng , Zhengyang Wan , Yansong Qu , Junwei You , Sicong Jiang , Sikai Chen

Large Language Models (LLMs) become the start-of-the-art solutions for a variety of natural language tasks and are integrated into real-world applications. However, LLMs can be potentially harmful in manifesting undesirable safety issues…

Artificial Intelligence · Computer Science 2024-03-05 Zhuoer Xu , Jianping Zhang , Shiwen Cui , Changhua Meng , Weiqiang Wang

Scenario-based training has been widely adopted in many public service sectors. Recent advancements in Large Language Models (LLMs) have shown promise in simulating diverse personas to create these training scenarios. However, little is…

Computation and Language · Computer Science 2025-01-07 Yerong Li , Yiren Liu , Yun Huang

Recent advancements in large language models (LLMs) have notably propelled natural language processing (NLP) capabilities, demonstrating significant potential in safety engineering applications. Despite these advancements, LLMs face…

Artificial Intelligence · Computer Science 2023-12-15 Haiyang Tang , Zhenyi Liu , Dongping Chen , Qingzhao Chu

We advocate the idea of the natural-language-driven(NLD) simulation to efficiently produce the object interactions between multiple objects in the virtual road scenes, for teaching and testing the autonomous driving systems that should take…

Computer Vision and Pattern Recognition · Computer Science 2023-12-18 Kairui Yang , Zihao Guo , Gengjie Lin , Haotian Dong , Die Zuo , Jibin Peng , Zhao Huang , Zhecheng Xu , Fupeng Li , Ziyun Bai , Di Lin

Large Language Models (LLMs) are widely used in Software Engineering (SE) for various tasks, including generating code, designing and documenting software, adding code comments, reviewing code, and writing test scripts. However, creating…

Software Engineering · Computer Science 2024-06-12 Abdul Malik Sami , Zeeshan Rasheed , Muhammad Waseem , Zheying Zhang , Herda Tomas , Pekka Abrahamsson