中文
相关论文

相关论文: DriveQA: Passing the Driving Knowledge Test

200 篇论文

Traditional autonomous driving systems often struggle to connect high-level reasoning with low-level control, leading to suboptimal and sometimes unsafe behaviors. Recent advances in multimodal large language models (MLLMs), which process…

机器人学 · 计算机科学 2025-06-09 Jiawei Zhang , Xuan Yang , Taiqi Wang , Yu Yao , Aleksandr Petiushko , Bo Li

Machine learning (ML) powered network traffic analysis has been widely used for the purpose of threat detection. Unfortunately, their generalization across different tasks and unseen data is very limited. Large language models (LLMs), known…

机器学习 · 计算机科学 2025-04-16 Tianyu Cui , Xinjie Lin , Sijia Li , Miao Chen , Qilei Yin , Qi Li , Ke Xu

Traditional approaches to safety event analysis in autonomous systems have relied on complex machine learning models and extensive datasets for high accuracy and reliability. However, the advent of Multimodal Large Language Models (MLLMs)…

计算机视觉与模式识别 · 计算机科学 2024-06-21 Mohammad Abu Tami , Huthaifa I. Ashqar , Mohammed Elhenawy

The rapid rise of Large Language Models (LLMs) is transforming traffic and transportation research, with significant advancements emerging between the years 2023 and 2025 -- a period marked by the inception and swift growth of adopting and…

计算工程、金融与科学 · 计算机科学 2025-03-28 Yimo Yan , Yejia Liao , Guanhao Xu , Ruili Yao , Huiying Fan , Jingran Sun , Xia Wang , Jonathan Sprinkle , Ziyan An , Meiyi Ma , Xi Cheng , Tong Liu , Zemian Ke , Bo Zou , Matthew Barth , Yong-Hong Kuo

Multimodal large language models (MLLMs) hold the potential to enhance autonomous driving by combining domain-independent world knowledge with context-specific language guidance. Their integration into autonomous driving systems shows…

计算机视觉与模式识别 · 计算机科学 2025-03-17 Tin Stribor Sohn , Philipp Reis , Maximilian Dillitzer , Johannes Bach , Jason J. Corso , Eric Sax

Large language models (LLMs) have opened up new possibilities for intelligent agents, endowing them with human-like thinking and cognitive abilities. In this work, we delve into the potential of large language models (LLMs) in autonomous…

计算机视觉与模式识别 · 计算机科学 2025-12-18 Erfei Cui , Wenhai Wang , Zhiqi Li , Jiangwei Xie , Haoming Zou , Hanming Deng , Gen Luo , Lewei Lu , Xizhou Zhu , Jifeng Dai

Question Answering (QA) is an important part of tasks like text classification through information gathering. These are finding increasing use in sectors like healthcare, customer support, legal services, etc., to collect and classify…

计算与语言 · 计算机科学 2024-11-12 Priya Mishra , Suraj Racha , Kaustubh Ponkshe , Adit Akarsh , Ganesh Ramakrishnan

Large language models (LLMs) are growingly extended to process multimodal data such as text and video simultaneously. Their remarkable performance in understanding what is shown in images is surpassing specialized neural networks (NNs) such…

计算机视觉与模式识别 · 计算机科学 2025-07-24 Malsha Ashani Mahawatta Dona , Beatriz Cabrero-Daniel , Yinan Yu , Christian Berger

Despite significant recent progress in the field of autonomous driving, modern methods still struggle and can incur serious accidents when encountering long-tail unforeseen events and challenging urban scenarios. On the one hand, large…

计算机视觉与模式识别 · 计算机科学 2023-12-22 Hao Shao , Yuxuan Hu , Letian Wang , Steven L. Waslander , Yu Liu , Hongsheng Li

Autonomous driving requires reliable perception and safe decision-making in complex scenarios. Recent vision-language models (VLMs) demonstrate reasoning and generalization abilities, opening new possibilities for autonomous driving;…

Multiple Choice Question Answering (MCQA) benchmarks are an established standard for measuring Vision Language Model (VLM) performance in driving tasks. However, we observe the known phenomenon that synthetically generated MCQAs are highly…

机器学习 · 计算机科学 2026-02-23 Sutej Kulgod , Sean Ye , Sanchit Tanwar , Christoffer Heckman

Within the multimodal field, large vision-language models (LVLMs) have made significant progress due to their strong perception and reasoning capabilities in the visual and language systems. However, LVLMs are still plagued by the two…

计算机视觉与模式识别 · 计算机科学 2024-06-14 Sirui Cheng , Siyu Zhang , Jiayi Wu , Muchen Lan

The increasing rate of road accidents worldwide results not only in significant loss of life but also imposes billions financial burdens on societies. Current research in traffic crash frequency modeling and analysis has predominantly…

计算机视觉与模式识别 · 计算机科学 2024-06-18 Zhiwen Fan , Pu Wang , Yang Zhao , Yibo Zhao , Boris Ivanovic , Zhangyang Wang , Marco Pavone , Hao Frank Yang

Autonomous driving is a challenging domain that entails multiple aspects: a vehicle should be able to drive to its destination as fast as possible while avoiding collision, obeying traffic rules and ensuring the comfort of passengers. In…

机器学习 · 计算机科学 2019-02-28 Changjian Li , Krzysztof Czarnecki

Visual Question Answering (VQA) is the task of answering a question about an image and requires processing multimodal input and reasoning to obtain the answer. Modular solutions that use declarative representations within the reasoning…

人工智能 · 计算机科学 2024-10-15 Thomas Eiter , Jan Hadl , Nelson Higuera , Johannes Oetsch

Crash detection from video feeds is a critical problem in intelligent transportation systems. Recent developments in large language models (LLMs) and vision-language models (VLMs) have transformed how we process, reason about, and summarize…

计算机视觉与模式识别 · 计算机科学 2025-09-10 Sanjeda Akter , Ibne Farabi Shihab , Anuj Sharma

The rapid progress of multimodal large language models (MLLM) has paved the way for Vision-Language-Action (VLA) paradigms, which integrate visual perception, natural language understanding, and control within a single policy. Researchers…

Large language models (LLMs) have emerged as a dominant AI paradigm due to their exceptional text understanding and generation capabilities. However, their tendency to generate inconsistent or erroneous outputs challenges their reliability,…

人工智能 · 计算机科学 2025-12-01 Yedi Zhang , Sun Yi Emma , Annabelle Lee Jia En , Jin Song Dong

Ensuring realistic traffic dynamics is a prerequisite for simulation platforms to evaluate the reliability of self-driving systems before deployment in the real world. Because most road users are human drivers, reproducing their diverse…

机器人学 · 计算机科学 2025-08-26 Wendi Li , Hao Wu , Han Gao , Bing Mao , Fengyuan Xu , Sheng Zhong