中文
相关论文

相关论文: VLM as Strategist: Adaptive Generation of Safety-c…

200 篇论文

In the autonomous driving testing methods based on evolving scenarios, the construction method of the driver model, which determines the driving maneuvers of background vehicles (BVs) in the scenario, plays a critical role in generating…

机器学习 · 计算机科学 2025-08-05 Xinzheng Wu , Junyi Chen , Shaolingfeng Ye , Wei Jiang , Yong Shen

Autonomous Vehicle (AV) requires rigorous testing in safety-critical scenarios for safety validation, yet its validation is hindered by the high cost of field testing and the lack of fidelity in current simulations for rare safety-critical…

机器人学 · 计算机科学 2026-05-19 Hongyi Zhao , Shuo Wang , Qijie He , Ziyuan Pu

Laboratories are prone to severe injuries from minor unsafe actions, yet continuous safety monitoring -- beyond mandatory pre-lab safety training -- is limited by human availability. Vision language models (VLMs) offer promise for…

计算机视觉与模式识别 · 计算机科学 2026-02-03 Trishna Chakraborty , Udita Ghosh , Aldair Ernesto Gongora , Ruben Glatt , Yue Dong , Jiachen Li , Amit K. Roy-Chowdhury , Chengyu Song

Autonomous driving systems face significant challenges in handling unpredictable edge-case scenarios, such as adversarial pedestrian movements, dangerous vehicle maneuvers, and sudden environmental changes. Current end-to-end driving models…

计算机视觉与模式识别 · 计算机科学 2026-03-30 Dianwei Chen , Zifan Zhang , Lei Cheng , Yuchen Liu , Xianfeng Terry Yang

Large Language Models (LLMs) and Vision-Language Models (VLMs) have emerged as promising candidates for end-to-end autonomous driving. However, these models typically face challenges in inference latency, action precision, and…

计算机视觉与模式识别 · 计算机科学 2026-02-25 Jiaru Zhang , Manav Gagvani , Can Cui , Juntong Peng , Ruqi Zhang , Ziran Wang

Vision-language models (VLMs) have significantly advanced autonomous driving (AD) by enhancing reasoning capabilities. However, these models remain highly vulnerable to adversarial attacks. While existing research has primarily focused on…

计算机视觉与模式识别 · 计算机科学 2026-04-22 Tianyuan Zhang , Lu Wang , Xinwei Zhang , Yitong Zhang , Boyi Jia , Siyuan Liang , Shengshan Hu , Qiang Fu , Aishan Liu , Xianglong Liu

Autonomous driving systems (ADS) are safety-critical and require comprehensive testing before their deployment on public roads. While existing testing approaches primarily aim at the criticality of scenarios, they often overlook the…

软件工程 · 计算机科学 2024-09-17 Shuncheng Tang , Zhenya Zhang , Jixiang Zhou , Lei Lei , Yuan Zhou , Yinxing Xue

Recent advances in decision-making policies have led to significant progress in fields such as autonomous driving and robotics. However, testing these policies remains crucial with the existence of critical scenarios that may threaten their…

机器学习 · 计算机科学 2024-12-17 Weichao Xu , Huaxin Pei , Jingxuan Yang , Yuchen Shi , Yi Zhang , Qianchuan Zhao

The safe deployment of autonomous driving (AD) systems is fundamentally hindered by the long-tail problem, where rare yet critical driving scenarios are severely underrepresented in real-world data. Existing solutions including…

计算机视觉与模式识别 · 计算机科学 2026-01-21 Qimao Chen , Fang Li , Shaoqing Xu , Zhiyi Lai , Zixun Xie , Yuechen Luo , Shengyin Jiang , Hanbing Li , Long Chen , Bing Wang , Yi Zhang , Zhi-Xin Yang

End-to-End (E2E) solutions have emerged as a mainstream approach for autonomous driving systems, with Vision-Language-Action (VLA) models representing a new paradigm that leverages pre-trained multimodal knowledge from Vision-Language…

机器人学 · 计算机科学 2025-09-25 Pengxiang Li , Yinan Zheng , Yue Wang , Huimin Wang , Hang Zhao , Jingjing Liu , Xianyuan Zhan , Kun Zhan , Xianpeng Lang

The validation of autonomous driving systems benefits greatly from the ability to generate scenarios that are both realistic and precisely controllable. Conventional approaches, such as real-world test drives, are not only expensive but…

机器人学 · 计算机科学 2025-04-01 Yizhuo Xiao , Mustafa Suphi Erden , Cheng Wang

Decision-making stands as a pivotal component in the realm of autonomous vehicles (AVs), playing a crucial role in navigating the intricacies of autonomous driving. Amidst the evolving landscape of data-driven methodologies, enhancing…

机器人学 · 计算机科学 2024-04-08 Jiaqi Liu , Peng Hang , Xiaocong Zhao , Jianqiang Wang , Jian Sun

Ensuring robust safety measures across a wide range of scenarios is crucial for user-facing systems. While Large Language Models (LLMs) can generate valuable data for safety measures, they often exhibit distributional biases, focusing on…

计算与语言 · 计算机科学 2024-10-16 Sabit Hassan , Anthony Sicilia , Malihe Alikhani

Real-world crash reports, which combine textual summaries and sketches, are valuable for scenario-based testing of autonomous driving systems (ADS). However, current methods cannot effectively translate this multimodal data into precise,…

软件工程 · 计算机科学 2026-02-25 Fida Khandaker Safa , Yupeng Jiang , Xi Zheng

Vision-Language Models (VLMs) have demonstrated notable promise in autonomous driving by offering the potential for multimodal reasoning through pretraining on extensive image-text pairs. However, adapting these models from broad web-scale…

机器人学 · 计算机科学 2025-06-18 Yupeng Zhou , Can Cui , Juntong Peng , Zichong Yang , Juanwu Lu , Jitesh H Panchal , Bin Yao , Ziran Wang

Safety-critical scenarios are essential for the development of autonomous vehicles (AVs) but are rare in real-world driving data. While simulation offers a way to generate such scenarios, manually designed test cases lack scalability, and…

机器人学 · 计算机科学 2026-05-07 Zimu Gong , Brian Zhaoning Zhang , Chris Zhang , Kelvin Wong , Raquel Urtasun

Advanced Driver Assistance Systems (ADAS) increasingly rely on learning-based perception, yet safety-relevant failures often arise without component malfunction, driven instead by partial observability and semantic ambiguity in how risk is…

Vision-Language Models (VLMs) have recently emerged as a promising paradigm in autonomous driving (AD). However, current performance evaluation protocols for VLM-based AD systems (ADVLMs) are predominantly confined to open-loop settings…

计算机视觉与模式识别 · 计算机科学 2025-08-21 Tianyuan Zhang , Ting Jin , Lu Wang , Jiangfan Liu , Siyuan Liang , Mingchuan Zhang , Aishan Liu , Xianglong Liu

Ensuring safe interactions between autonomous vehicles (AVs) and human drivers in mixed traffic systems remains a major challenge, particularly in complex, high-risk scenarios. This paper presents a cognition-decision framework that…

人工智能 · 计算机科学 2025-03-18 Heye Huang , Zheng Li , Hao Cheng , Haoran Wang , Junkai Jiang , Xiaopeng Li , Arkady Zgonnikov

Diffusion Language Models (DLMs) provide a promising alternative to autoregressive language models by generating text through iterative denoising and bidirectional refinement. However, this iterative generation paradigm also introduces…

计算与语言 · 计算机科学 2026-05-14 Yejin Lee , Yo-Sub Han