English
Related papers

Related papers: CoT-VLM4Tar: Chain-of-Thought Guided Vision-Langua…

200 papers

Integrating large language models (LLMs) into autonomous driving has attracted significant attention with the hope of improving generalization and explainability. However, existing methods often focus on either driving or vision-language…

Computer Vision and Pattern Recognition · Computer Science 2025-03-13 Katrin Renz , Long Chen , Elahe Arani , Oleg Sinavski

Recent advances in video question answering (VideoQA) offer promising applications, especially in traffic monitoring, where efficient video interpretation is critical. Within ITS, answering complex, real-time queries like "How many red cars…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Joseph Raj Vishal , Divesh Basina , Aarya Choudhary , Bharatesh Chakravarthi

The increasing rate of road accidents worldwide results not only in significant loss of life but also imposes billions financial burdens on societies. Current research in traffic crash frequency modeling and analysis has predominantly…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Zhiwen Fan , Pu Wang , Yang Zhao , Yibo Zhao , Boris Ivanovic , Zhangyang Wang , Marco Pavone , Hao Frank Yang

Road traffic accidents pose a significant global public health concern, leading to injuries, fatalities, and vehicle damage. Approximately 1,3 million people lose their lives daily due to traffic accidents [World Health Organization, 2022].…

Computer Vision and Pattern Recognition · Computer Science 2023-11-29 Dila Dede , Mehmet Ali Sarsıl , Ata Shaker , Olgu Altıntaş , Onur Ergen

Vision-Language Models (VLMs) have been applied to autonomous driving to support decision-making in complex real-world scenarios. However, their training on static, web-sourced image-text pairs fundamentally limits the precise…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Keishi Ishihara , Kento Sasaki , Tsubasa Takahashi , Daiki Shiono , Yu Yamaguchi

In this paper, we propose a novel framework for enhancing visual comprehension in autonomous driving systems by integrating visual language models (VLMs) with additional visual perception module specialised in object detection. We extend…

Computer Vision and Pattern Recognition · Computer Science 2024-11-12 Linfeng He , Yiming Sun , Sihao Wu , Jiaxu Liu , Xiaowei Huang

Graph Chain-of-Thought (Graph-CoT) enables large language models (LLMs) to perform step-by-step reasoning over graph-structured knowledge, but existing pipelines suffer from low accuracy, excessive token usage, high latency, and low…

Achieving human-level performance in Vision-and-Language Navigation (VLN) requires an embodied agent to jointly understand multimodal instructions and visual-spatial context while reasoning over long action sequences. Recent works, such as…

Computer Vision and Pattern Recognition · Computer Science 2026-01-26 Jing Zuo , Lingzhou Mu , Fan Jiang , Chengcheng Ma , Mu Xu , Yonggang Qi

In this technical report, we present CarLLaVA, a Vision Language Model (VLM) for autonomous driving, developed for the CARLA Autonomous Driving Challenge 2.0. CarLLaVA uses the vision encoder of the LLaVA VLM and the LLaMA architecture as…

Computer Vision and Pattern Recognition · Computer Science 2024-06-17 Katrin Renz , Long Chen , Ana-Maria Marcu , Jan Hünermann , Benoit Hanotte , Alice Karnsund , Jamie Shotton , Elahe Arani , Oleg Sinavski

Vision-Language Models (VLMs) have made significant strides in static image understanding but continue to face critical hurdles in spatiotemporal reasoning. A major bottleneck is "multi-image reasoning hallucination", where a massive…

Artificial Intelligence · Computer Science 2026-04-14 Xiaoda Yang , Shuai Yang , Can Wang , Jingyang Xue , Menglan Tang , Checheng Yu , Xunzhe Zhou , Sashuai Zhou , Tao Jin , Lixin Yang , Xiangyu Yue , Zhou Zhao

The rapid development of autonomous vehicles (AVs) holds vast potential for transportation systems through improved safety, efficiency, and access to mobility. However, the progression of these impacts, as AVs are adopted, is not well…

Artificial Intelligence · Computer Science 2022-01-03 Cathy Wu , Aboudy Kreidieh , Kanaad Parvate , Eugene Vinitsky , Alexandre M Bayen

Traffic prediction constitutes a pivotal facet within the purview of Intelligent Transportation Systems (ITS), and the attainment of highly precise predictions holds profound significance for efficacious traffic management. The precision of…

Machine Learning · Computer Science 2024-10-27 Yilong Ren , Yue Chen , Shuai Liu , Boyue Wang , Haiyang Yu , Zhiyong Cui

While Chain-of-Thought (CoT) significantly enhances the performance of Large Language Models (LLMs), explicit reasoning chains introduce substantial computational redundancy. Recent latent reasoning methods attempt to mitigate this by…

Computation and Language · Computer Science 2026-02-02 Fanmeng Wang , Haotian Liu , Guojiang Zhao , Hongteng Xu , Zhifeng Gao

Vision-Language Models (VLMs) excel at reasoning in linguistic space but struggle with perceptual understanding that requires dense visual perception, e.g., spatial reasoning and geometric awareness. This limitation stems from the fact that…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Yiming Qin , Bomin Wei , Jiaxin Ge , Konstantinos Kallidromitis , Stephanie Fu , Trevor Darrell , XuDong Wang

Real-world path planning tasks typically involve multiple constraints beyond simple route optimization, such as the number of routes, maximum route length, depot locations, and task-specific requirements. Traditional approaches rely on…

Computation and Language · Computer Science 2026-03-23 Dylan Shim , Minghan Wei

This paper considers optimal traffic signal control in smart cities, which has been taken as a complex networked system control problem. Given the interacting dynamics among traffic lights and road networks, attaining controller adaptivity…

Machine Learning · Computer Science 2023-11-08 Yao Zhang , Zhiwen Yu , Jun Zhang , Liang Wang , Tom H. Luan , Bin Guo , Chau Yuen

Cyclists often encounter safety-critical situations in urban traffic, highlighting the need for assistive systems that support safe and informed decision-making. Recently, vision-language models (VLMs) have demonstrated strong performance…

Computer Vision and Pattern Recognition · Computer Science 2026-02-12 Krishna Kanth Nakka , Vedasri Nakka

Large Language Models (LLMs) are increasingly used for decision-making and planning in autonomous driving, showing promising reasoning capabilities and potential to generalize across diverse traffic situations. However, current LLM-based…

Computer Vision and Pattern Recognition · Computer Science 2025-11-19 Fabian Schmidt , Noushiq Mohammed Kayilan Abdul Nazar , Markus Enzweiler , Abhinav Valada

Autonomous vehicles (AVs), possibly using Multi-Agent Reinforcement Learning (MARL) for simultaneous route optimization, may destabilize traffic networks, with human drivers potentially experiencing longer travel times. We study this…

Multiagent Systems · Computer Science 2025-06-17 Anastasia Psarou , Ahmet Onur Akman , Łukasz Gorczyca , Michał Hoffmann , Grzegorz Jamróz , Rafał Kucharski

The rapid expansion of modern wide-area networks (WANs) has made traffic engineering (TE) increasingly challenging, as traditional solvers struggle to keep pace. Although existing offline ML-driven approaches accelerate TE optimization with…

Networking and Internet Architecture · Computer Science 2026-02-03 Xinyu Yuan , Yan Qiao , Zonghui Wang , Meng Li , Wenzhi Chen