English
Related papers

Related papers: LAVQA: A Latency-Aware Visual Question Answering F…

200 papers

Safe and smooth interacting with other vehicles is one of the ultimate goals of driving automation. However, recent reports of demonstrative deployments of automated vehicles (AVs) indicate that AVs are still difficult to meet the…

Systems and Control · Electrical Eng. & Systems 2022-05-11 Daofei Li , Ao Liu , Hao Pan , Wentao Chen

Connected and autonomous vehicles (CAVs) possess the capability of perception and information broadcasting with other CAVs and connected intersections. Additionally, they exhibit computational abilities and can be controlled strategically,…

Computational Engineering, Finance, and Science · Computer Science 2024-07-23 Maziar Zamanpour , Suiyi He , Michael W. Levin , Zongxuan Sun

Recent advances in Vision-Language-Action (VLA) models have shown promising capabilities in autonomous driving by leveraging the understanding and reasoning strengths of Large Language Models(LLMs).However, our empirical analysis reveals…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Zihan You , Hongwei Liu , Chenxu Dang , Zhe Wang , Sining Ang , Aoqi Wang , Yan Wang

With the level of automation increases in vehicles, such as conditional and highly automated vehicles (AVs), drivers are becoming increasingly out of the control loop, especially in unexpected driving scenarios. Although it might be not…

Human-Computer Interaction · Computer Science 2022-07-18 Lilit Avetisyan , Jackie Ayoub , Feng Zhou

We consider the problem of safe real-time navigation of a robot in a dynamic environment with moving obstacles of arbitrary smooth geometries and input saturation constraints. We assume that the robot detects and models nearby obstacle…

Robotics · Computer Science 2026-01-06 Anusha Srikanthan , Yifan Xue , Vijay Kumar , Nikolai Matni , Nadia Figueroa

Trustworthy AI is mandatory for the broad deployment of autonomous vehicles. Although end-to-end approaches derive control commands directly from raw data, interpreting these decisions remains challenging, especially in complex urban…

Computer Vision and Pattern Recognition · Computer Science 2025-10-22 Mona Mirzaie , Bodo Rosenhahn

Recent advancements in Vision-Language Models (VLMs) have demonstrated strong potential for autonomous driving tasks. However, their spatial understanding and reasoning-key capabilities for autonomous driving-still exhibit significant…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Kexin Tian , Jingrui Mao , Yunlong Zhang , Jiwan Jiang , Yang Zhou , Zhengzhong Tu

Accurate driving behavior recognition and reasoning are critical for autonomous driving video understanding. However, existing methods often tend to dig out the shallow causal, fail to address spurious correlations across modalities, and…

Computer Vision and Pattern Recognition · Computer Science 2025-07-09 Tongtong Cheng , Rongzhen Li , Yixin Xiong , Tao Zhang , Jing Wang , Kai Liu

Vision-Language-Action (VLA) models have recently achieved notable progress in end-to-end autonomous driving by integrating perception, reasoning, and control within a unified multimodal framework. However, they often lack explicit modeling…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 Guoqing Wang , Pin Tang , Xiangxuan Ren , Guodongfang Zhao , Bailan Feng , Chao Ma

For an autonomous vehicle, situation understand-ing is a key capability towards safe and comfortable decision-making and navigation. Information is in general provided bymultiple sources. Prior information about the road topology andtraffic…

Robotics · Computer Science 2021-10-25 Corentin Sanchez , Philippe Xu , Alexandre Armand , Philippe Bonnifait

Cooperative autonomous driving requires traffic scene understanding from both vehicle and infrastructure perspectives. While vision-language models (VLMs) show strong general reasoning capabilities, their performance in safety-critical…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 Rui Gan , Junyi Ma , Pei Li , Xingyou Yang , Kai Chen , Sikai Chen , Bin Ran

Driver gaze estimation serves as a fundamental metric for evaluating driver attentiveness in modern monitoring systems. Beyond being vulnerable to sudden lighting changes and sensor noise, spatial-domain models struggle to disentangle…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Jun Ma , Zhenye Yang , Ruichen Zhou , Pei Zhang , Huan Li , Jinpeng Chen

Completely unmanned autonomous vehicles have been anticipated for a while. Initially, these are expected to drive only under certain conditions on some roads, and advanced functionality is required to cope with the ever-increasing…

Human-Computer Interaction · Computer Science 2020-07-23 Walter Morales Alvarez , Miguel Ángel de Miguel , Fernando García , Cristina Olaverri-Monreal

Road congestion in urban environments, especially near signalized intersections, has been a major cause of significant fuel and time waste. Various solutions have been proposed to solve the problem of increasing idling times and number of…

Optimization and Control · Mathematics 2018-03-29 Mahmoud Faraj , Baris Fidan , Vincent Gaudet

Connected autonomous vehicles (CAVs) promise to enhance safety, efficiency, and sustainability in urban transportation. However, this is contingent upon a CAV correctly predicting the motion of surrounding agents and planning its own motion…

Robotics · Computer Science 2023-09-15 Jiankai Sun , Shreyas Kousik , David Fridovich-Keil , Mac Schwager

Document Visual Question Answering (VQA) demands robust integration of text detection, recognition, and spatial reasoning to interpret complex document layouts. In this work, we introduce DLaVA, a novel, training-free pipeline that…

Computer Vision and Pattern Recognition · Computer Science 2025-07-11 Ahmad Mohammadshirazi , Pinaki Prasad Guha Neogi , Ser-Nam Lim , Rajiv Ramnath

Collaborative perception allows connected autonomous vehicles (CAVs) to overcome occlusion and limited sensor range by sharing intermediate features. Yet transmitting dense Bird's-Eye-View (BEV) feature maps can overwhelm the bandwidth…

Computer Vision and Pattern Recognition · Computer Science 2025-08-19 Melih Yazgan , Qiyuan Wu , Iramm Hamdard , Shiqi Li , J. Marius Zoellner

Large language models have been widely applied to knowledge-driven decision-making for automated vehicles due to their strong generalization and reasoning capabilities. However, the safety of the resulting decisions cannot be ensured due to…

Robotics · Computer Science 2025-10-09 Yuanfei Lin , Sebastian Illing , Matthias Althoff

Autonomous vehicles interacting with other traffic participants heavily rely on the perception and prediction of other agents' behaviors to plan safe trajectories. However, as occlusions limit the vehicle's perception ability, reasoning…

Robotics · Computer Science 2021-08-04 Zixu Zhang , Jaime F. Fisac

Autonomous driving visual question answering (AD-VQA) aims to answer questions related to perception, prediction, and planning based on given driving scene images, heavily relying on the model's spatial understanding capabilities. Prior…

Computer Vision and Pattern Recognition · Computer Science 2025-04-02 Zhiyuan Zhang , Xiaofan Li , Zhihao Xu , Wenjie Peng , Zijian Zhou , Miaojing Shi , Shuangping Huang