English
Related papers

Related papers: LLM-MLFFN: Multi-Level Autonomous Driving Behavior…

200 papers

The integration of Large Language Models (LLMs) into autonomous driving systems demonstrates strong common sense and reasoning abilities, effectively addressing the pitfalls of purely data-driven methods. Current LLM-based agents require…

Robotics · Computer Science 2024-10-22 Sihao Wu , Jiaxu Liu , Xiangyu Yin , Guangliang Cheng , Xingyu Zhao , Meng Fang , Xinping Yi , Xiaowei Huang

To perform effective causal inference in high-dimensional datasets, initiating the process with causal discovery is imperative, wherein a causal graph is generated based on observational data. However, obtaining a complete and accurate…

Machine Learning · Computer Science 2025-04-18 Elahe Khatibi , Mahyar Abbasian , Zhongqi Yang , Iman Azimi , Amir M. Rahmani

Traffic prediction constitutes a pivotal facet within the purview of Intelligent Transportation Systems (ITS), and the attainment of highly precise predictions holds profound significance for efficacious traffic management. The precision of…

Machine Learning · Computer Science 2024-10-27 Yilong Ren , Yue Chen , Shuai Liu , Boyue Wang , Haiyang Yu , Zhiyong Cui

Vision-language models (VLMs) have recently emerged as powerful representation learning systems that align visual observations with natural language concepts, offering new opportunities for semantic reasoning in safety-critical autonomous…

Computer Vision and Pattern Recognition · Computer Science 2026-02-19 Ross Greer , Maitrayee Keskar , Angel Martinez-Sanchez , Parthib Roy , Shashank Shriram , Mohan Trivedi

We provide a sober look at the application of Multimodal Large Language Models (MLLMs) in autonomous driving, challenging common assumptions about their ability to interpret dynamic driving scenarios. Despite advances in models like GPT-4o,…

Robotics · Computer Science 2024-10-29 Shiva Sreeram , Tsun-Hsuan Wang , Alaa Maalouf , Guy Rosman , Sertac Karaman , Daniela Rus

A primary hurdle of autonomous driving in urban environments is understanding complex and long-tail scenarios, such as challenging road conditions and delicate human behaviors. We introduce DriveVLM, an autonomous driving system leveraging…

Computer Vision and Pattern Recognition · Computer Science 2024-06-26 Xiaoyu Tian , Junru Gu , Bailin Li , Yicheng Liu , Yang Wang , Zhiyong Zhao , Kun Zhan , Peng Jia , Xianpeng Lang , Hang Zhao

The integration of Large Language Models (LLMs) with computer vision is profoundly transforming perception tasks like image segmentation. For intelligent transportation systems (ITS), where accurate scene understanding is critical for…

Computer Vision and Pattern Recognition · Computer Science 2025-09-09 Sanjeda Akter , Ibne Farabi Shihab , Anuj Sharma

The rapid rise of Large Language Models (LLMs) is transforming traffic and transportation research, with significant advancements emerging between the years 2023 and 2025 -- a period marked by the inception and swift growth of adopting and…

Computational Engineering, Finance, and Science · Computer Science 2025-03-28 Yimo Yan , Yejia Liao , Guanhao Xu , Ruili Yao , Huiying Fan , Jingran Sun , Xia Wang , Jonathan Sprinkle , Ziyan An , Meiyi Ma , Xi Cheng , Tong Liu , Zemian Ke , Bo Zou , Matthew Barth , Yong-Hong Kuo

Large language models (LLMs) constitute a breakthrough state-of-the-art Artificial Intelligence technology which is rapidly evolving and promises to aid in medical diagnosis. However, the correctness and the accuracy of their returns has…

Computation and Language · Computer Science 2024-02-07 Dimitrios P. Panagoulias , Maria Virvou , George A. Tsihrintzis

Steering, or direct manipulation of internal activations to guide LLM responses toward specific semantic concepts, is emerging as a promising avenue for both understanding how semantic concepts are stored within LLMs and advancing LLM…

Machine Learning · Computer Science 2026-02-03 Parmida Davarmanesh , Ashia Wilson , Adityanarayanan Radhakrishnan

The emergence of Multimodal Large Language Models (MLLMs) has revolutionized image understanding by bridging textual and visual modalities. However, these models often struggle with capturing fine-grained semantic information, such as the…

Computer Vision and Pattern Recognition · Computer Science 2025-07-16 Jie Yang , Wang Zeng , Sheng Jin , Lumin Xu , Wentao Liu , Chen Qian , Zhen Li , Ruimao Zhang

Decision-making and motion planning constitute critical components for ensuring the safety and efficiency of autonomous vehicles (AVs). Existing methodologies typically adopt two paradigms: decision then planning or generation then scoring.…

Robotics · Computer Science 2025-04-01 Ruoyu Yao , Yubin Wang , Haichao Liu , Rui Yang , Zengqi Peng , Lei Zhu , Jun Ma

Unmanned Aerial Vehicles (UAVs) have emerged as a transformative technology across diverse sectors, offering adaptable solutions to complex challenges in both military and civilian domains. Their expanding capabilities present a platform…

Artificial Intelligence · Computer Science 2024-05-06 Shumaila Javaid , Nasir Saeed , Bin He

Mobility Foundation Models (MFMs) have advanced the modeling of human movement patterns, yet they face a ceiling due to limitations in data scale and semantic understanding. While Large Language Models (LLMs) offer powerful semantic…

Machine Learning · Computer Science 2026-04-14 Fanjin Meng , Yuan Yuan , Jingtao Ding , Jie Feng , Chonghua Han , Yong Li

Large Language Models (LLMs) and Multimodal LLMs (MLLMs) have demonstrated immense potential in autonomous driving (AD) by offering human-like reasoning and open-world generalization. However, the excessive computational overhead and high…

Robotics · Computer Science 2026-05-26 Ruoyu Yao , Ruiguo Zhong , Pei Liu , Mingxing Peng , Rui Yang , Jun Ma

Large Language Models (LLMs), AI models trained on massive text corpora with remarkable language understanding and generation capabilities, are transforming the field of Autonomous Driving (AD). As AD systems evolve from rule-based and…

Artificial Intelligence · Computer Science 2024-07-30 Yun Li , Kai Katsumata , Ehsan Javanmardi , Manabu Tsukada

Multimodal Large Language Models (MLLMs) have demonstrated remarkable capabilities across a wide range of vision-language tasks. However, their performance as embodied agents, which requires multi-round dialogue spatial reasoning and…

Computer Vision and Pattern Recognition · Computer Science 2026-01-07 Xunyi Zhao , Gengze Zhou , Qi Wu

As autonomous vehicles (AVs) are increasingly deployed on public roads, understanding their real-world behaviors is critical for traffic safety analysis and regulatory oversight. However, many data-driven methods lack interpretability and…

Robotics · Computer Science 2026-03-24 Xiangyu Li , Tianyi Wang , Junfeng Jiao , Christian Claudel , Zhaomiao Guo

Traffic safety remains a critical global challenge, with traditional Advanced Driver-Assistance Systems (ADAS) often struggling in dynamic real-world scenarios due to fragmented sensor processing and susceptibility to adversarial…

Computer Vision and Pattern Recognition · Computer Science 2025-04-24 Mohammad Abu Tami , Mohammed Elhenawy , Huthaifa I. Ashqar

Recent breakthroughs in multimodal large language models (MLLMs) have endowed AI systems with unified perception, reasoning and natural-language interaction across text, image and video streams. Meanwhile, Unmanned Aerial Vehicle (UAV)…