English
Related papers

Related papers: SG-CADVLM: A Context-Aware Decoding Powered Vision…

200 papers

Large vision-language models (LVLMs) are prone to hallucinations, where certain contextual cues in an image can trigger the language module to produce overconfident and incorrect reasoning about abnormal or hypothetical objects. While some…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Xiyang Wu , Tianrui Guan , Dianqi Li , Shuaiyi Huang , Xiaoyu Liu , Xijun Wang , Ruiqi Xian , Abhinav Shrivastava , Furong Huang , Jordan Lee Boyd-Graber , Tianyi Zhou , Dinesh Manocha

Autonomous landing is essential for drones deployed in emergency deliveries, post-disaster response, and other large-scale missions. By enabling self-docking on charging platforms, it facilitates continuous operation and significantly…

Robotics · Computer Science 2025-05-13 Siwei Cai , Yuwei Wu , Lifeng Zhou

Testing Automated Driving Systems (ADS) in simulation with realistic driving scenarios is important for verifying their performance. However, converting real-world driving videos into simulation scenarios is a significant challenge due to…

Computer Vision and Pattern Recognition · Computer Science 2025-01-28 Yan Miao , Georgios Fainekos , Bardh Hoxha , Hideki Okamoto , Danil Prokhorov , Sayan Mitra

Accurate and timely identification of construction hazards around workers is essential for preventing workplace accidents. While large vision-language models (VLMs) demonstrate strong contextual reasoning capabilities, their high…

Computer Vision and Pattern Recognition · Computer Science 2026-04-08 Muhammad Adil , Mehmood Ahmed , Muhammad Aqib , Vicente A. Gonzalez , Gaang Lee , Qipei Mei

Vision-Language-Action (VLA) models for autonomous driving must integrate diverse textual inputs, including navigation commands, hazard warnings, and traffic state descriptions, yet current systems often present these as disconnected…

Robotics · Computer Science 2026-04-03 Yun Li , Yidu Zhang , Simon Thompson , Ehsan Javanmardi , Manabu Tsukada

Developing safety-critical automotive software presents significant challenges due to increasing system complexity and strict regulatory demands. This paper proposes a novel framework integrating Generative Artificial Intelligence (GenAI)…

Software Engineering · Computer Science 2025-06-05 Sven Kirchner , Alois C. Knoll

End-to-end autonomous driving frameworks face persistent challenges in generalization, training efficiency, and interpretability. While recent methods leverage Vision-Language Models (VLMs) through supervised learning on large-scale…

Robotics · Computer Science 2025-12-11 Lin Li , Yuxin Cai , Jianwu Fang , Jianru Xue , Chen Lv

Autonomous driving policy learning with reinforcement learning (RL) is fundamentally limited by low sample efficiency, weak generalization, and a dependence on unsafe online trial-and-error interactions. Although safe RL introduces explicit…

Robotics · Computer Science 2026-03-31 Yansong Qu , Zilin Huang , Zihao Sheng , Jiancong Chen , Yue Leng , Samuel Labi , Sikai Chen

Real-world crash reports, which combine textual summaries and sketches, are valuable for scenario-based testing of autonomous driving systems (ADS). However, current methods cannot effectively translate this multimodal data into precise,…

Software Engineering · Computer Science 2026-02-25 Fida Khandaker Safa , Yupeng Jiang , Xi Zheng

Scenario-based testing for automated driving systems (ADS) must be able to simulate traffic scenarios that rely on interactions with other vehicles. Although many languages for high-level scenario modelling have been proposed, they lack the…

This paper proposes a novel Large Vision-Language Model (LVLM) and Model Predictive Control (MPC) integration framework that delivers both task scalability and safety for Autonomous Driving (AD). LVLMs excel at high-level task planning…

Robotics · Computer Science 2025-07-16 Kazuki Atsuta , Kohei Honda , Hiroyuki Okuda , Tatsuya Suzuki

Rare, yet critical, scenarios pose a significant challenge in testing and evaluating autonomous driving planners. Relying solely on real-world driving scenes requires collecting massive datasets to capture these scenarios. While automatic…

Driving in safety-critical scenarios requires quick, context-aware decision-making grounded in both situational understanding and experiential reasoning. Large Language Models (LLMs), with their powerful general-purpose reasoning…

Artificial Intelligence · Computer Science 2025-06-26 Wenbin Gan , Minh-Son Dao , Koji Zettsu

Ensuring realistic traffic dynamics is a prerequisite for simulation platforms to evaluate the reliability of self-driving systems before deployment in the real world. Because most road users are human drivers, reproducing their diverse…

Robotics · Computer Science 2025-08-26 Wendi Li , Hao Wu , Han Gao , Bing Mao , Fengyuan Xu , Sheng Zhong

Automated Driving System (ADS) is a safety-critical software system responsible for the interpretation of the vehicle's environment and making decisions accordingly. The unbounded complexity of the driving context, including unforeseeable…

Current autonomous driving vehicles rely mainly on their individual sensors to understand surrounding scenes and plan for future trajectories, which can be unreliable when the sensors are malfunctioning or occluded. To address this problem,…

Computer Vision and Pattern Recognition · Computer Science 2026-02-17 Hsu-kuang Chiu , Ryo Hachiuma , Chien-Yi Wang , Stephen F. Smith , Yu-Chiang Frank Wang , Min-Hung Chen

Accurately predicting human behaviors is crucial for mobile robots operating in human-populated environments. While prior research primarily focuses on predicting actions in single-human scenarios from an egocentric view, several robotic…

Computer Vision and Pattern Recognition · Computer Science 2025-12-19 Utsav Panchal , Yuchen Liu , Luigi Palmieri , Ilche Georgievski , Marco Aiello

Ensuring the safety of Autonomous Driving Systems (ADS) requires realistic and reproducible test scenarios, yet extracting such scenarios from multimodal crash reports remains a major challenge. Large Language Models (LLMs) often…

Software Engineering · Computer Science 2025-11-26 Siwei Luo , Yang Zhang , Yao Deng , Linfeng Liang , Xi Zheng

Ensuring the safety of vision-language models (VLMs) in autonomous driving systems is of paramount importance, yet existing research has largely focused on conventional benchmarks rather than safety-critical evaluation. In this work, we…

Computer Vision and Pattern Recognition · Computer Science 2025-10-30 Enming Zhang , Peizhe Gong , Xingyuan Dai , Min Huang , Yisheng Lv , Qinghai Miao

Self-driving vehicles (SDVs) must be rigorously tested on a wide range of scenarios to ensure safe deployment. The industry typically relies on closed-loop simulation to evaluate how the SDV interacts on a corpus of synthetic and real…

Robotics · Computer Science 2023-11-03 Jay Sarva , Jingkang Wang , James Tu , Yuwen Xiong , Sivabalan Manivasagam , Raquel Urtasun