English
Related papers

Related papers: LLM-MLFFN: Multi-Level Autonomous Driving Behavior…

200 papers

Large language models (LLMs) are effective at capturing complex, valuable conceptual representations from textual data for a wide range of real-world applications. However, in fields like Intelligent Fault Diagnosis (IFD), incorporating…

Artificial Intelligence · Computer Science 2024-12-03 Hamzah A. A. M. Qaid , Bo Zhang , Dan Li , See-Kiong Ng , Wei Li

Despite significant recent progress in the field of autonomous driving, modern methods still struggle and can incur serious accidents when encountering long-tail unforeseen events and challenging urban scenarios. On the one hand, large…

Computer Vision and Pattern Recognition · Computer Science 2023-12-22 Hao Shao , Yuxuan Hu , Letian Wang , Steven L. Waslander , Yu Liu , Hongsheng Li

In recent years, large language models have had a very impressive performance, which largely contributed to the development and application of artificial intelligence, and the parameters and performance of the models are still growing…

Machine Learning · Computer Science 2025-01-10 Xuran Zheng , Chang D. Yoo

Large Language Models (LLMs) have shown promise in the autonomous driving sector, particularly in generalization and interpretability. We introduce a unique object-level multimodal LLM architecture that merges vectorized numeric modalities…

The future of autonomous vehicles lies in the convergence of human-centric design and advanced AI capabilities. Autonomous vehicles of the future will not only transport passengers but also interact and adapt to their desires, making the…

Human-Computer Interaction · Computer Science 2023-09-20 Can Cui , Yunsheng Ma , Xu Cao , Wenqian Ye , Ziran Wang

Multi-sensor fusion plays a critical role in enhancing perception for autonomous driving, overcoming individual sensor limitations, and enabling comprehensive environmental understanding. This paper first formalizes multi-sensor fusion…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Chuheng Wei , Ziye Qin , Ziyan Zhang , Guoyuan Wu , Matthew J. Barth

The fusion of human-centric design and artificial intelligence (AI) capabilities has opened up new possibilities for next-generation autonomous vehicles that go beyond transportation. These vehicles can dynamically interact with passengers…

Human-Computer Interaction · Computer Science 2023-10-13 Can Cui , Yunsheng Ma , Xu Cao , Wenqian Ye , Ziran Wang

Simulation-based testing is crucial for validating autonomous vehicles (AVs), yet existing scenario generation methods either overfit to common driving patterns or operate in an offline, non-interactive manner that fails to expose rare,…

Artificial Intelligence · Computer Science 2025-07-16 Yuewen Mei , Tong Nie , Jian Sun , Ye Tian

Predicting the future trajectories of dynamic traffic actors is a cornerstone task in autonomous driving. Though existing notable efforts have resulted in impressive performance improvements, a gap persists in scene cognitive and…

Computer Vision and Pattern Recognition · Computer Science 2024-05-09 Zhengxing Lan , Hongbo Li , Lingshan Liu , Bo Fan , Yisheng Lv , Yilong Ren , Zhiyong Cui

Large language models (LLMs) have opened up new possibilities for intelligent agents, endowing them with human-like thinking and cognitive abilities. In this work, we delve into the potential of large language models (LLMs) in autonomous…

Computer Vision and Pattern Recognition · Computer Science 2025-12-18 Erfei Cui , Wenhai Wang , Zhiqi Li , Jiangwei Xie , Haoming Zou , Hanming Deng , Gen Luo , Lewei Lu , Xizhou Zhu , Jifeng Dai

Recent advancements in Large Language Models (LLMs) offer new opportunities to create natural language interfaces for Autonomous Driving Systems (ADSs), moving beyond rigid inputs. This paper addresses the challenge of mapping the…

Robotics · Computer Science 2026-01-26 Marvin Seegert , Korbinian Moller , Johannes Betz

In this era of technological advancements, several cutting-edge techniques are being implemented to enhance Autonomous Driving (AD) systems, focusing on improving safety, efficiency, and adaptability in complex driving environments.…

Computation and Language · Computer Science 2025-02-27 Md Robiul Islam

Motion prediction is among the most fundamental tasks in autonomous driving. Traditional methods of motion forecasting primarily encode vector information of maps and historical trajectory data of traffic participants, lacking a…

Computer Vision and Pattern Recognition · Computer Science 2024-07-31 Xiaoji Zheng , Lixiu Wu , Zhijie Yan , Yuanrong Tang , Hao Zhao , Chen Zhong , Bokui Chen , Jiangtao Gong

With the broader adoption and highly successful development of Large Language Models (LLMs), there has been growing interest and demand for applying LLMs to autonomous driving technology. Driven by their natural language understanding and…

Large Vision Language Models (LVLMs) have shown strong capabilities in understanding and analyzing visual scenes across various domains. However, in the context of autonomous driving, their limited comprehension of 3D environments restricts…

Computer Vision and Pattern Recognition · Computer Science 2025-05-02 Jannik Lübberstedt , Esteban Rivera , Nico Uhlemann , Markus Lienkamp

This study aims to comprehensively review and empirically evaluate the application of multimodal large language models (MLLMs) and Large Vision Models (VLMs) in object detection for transportation systems. In the first fold, we provide a…

Computer Vision and Pattern Recognition · Computer Science 2024-09-30 Huthaifa I. Ashqar , Ahmed Jaber , Taqwa I. Alhadidi , Mohammed Elhenawy

Autonomous vehicles (AVs) are more vulnerable to network attacks due to the high connectivity and diverse communication modes between vehicles and external networks. Deep learning-based Intrusion detection, an effective method for detecting…

Cryptography and Security · Computer Science 2023-09-27 Pengzhou Cheng , Lei Hua , Haobin Jiang , Gongshen Liu

To ensure safe driving in dynamic environments, autonomous vehicles should possess the capability to accurately predict lane change intentions of surrounding vehicles in advance and forecast their future trajectories. Existing motion…

Artificial Intelligence · Computer Science 2026-01-19 Mingxing Peng , Xusen Guo , Xianda Chen , Meixin Zhu , Kehua Chen

Autonomous driving technology, a catalyst for revolutionizing transportation and urban mobility, has the tend to transition from rule-based systems to data-driven strategies. Traditional module-based systems are constrained by cumulative…

Artificial Intelligence · Computer Science 2024-08-13 Zhenjie Yang , Xiaosong Jia , Hongyang Li , Junchi Yan

Traffic prediction plays a central role in intelligent transportation systems (ITS) by supporting real-time decision-making, congestion management, and long-term planning. However, many existing approaches face practical limitations. Most…

Machine Learning · Computer Science 2026-04-21 Seerat Kaur , Sukhjit Singh Sehra , Dariush Ebrahimi