中文
相关论文

相关论文: Driving Everywhere with Large Language Model Polic…

200 篇论文

We show that large language models (LLMs) can be adapted to be generalizable policies for embodied visual tasks. Our approach, called Large LAnguage model Reinforcement Learning Policy (LLaRP), adapts a pre-trained frozen LLM to take as…

Human-level driving is an ultimate goal of autonomous driving. Conventional approaches formulate autonomous driving as a perception-prediction-planning framework, yet their systems do not capitalize on the inherent reasoning ability and…

计算机视觉与模式识别 · 计算机科学 2024-07-30 Jiageng Mao , Junjie Ye , Yuxi Qian , Marco Pavone , Yue Wang

Although planning is a crucial component of the autonomous driving stack, researchers have yet to develop robust planning algorithms that are capable of safely handling the diverse range of possible driving scenarios. Learning-based…

人工智能 · 计算机科学 2024-01-02 S P Sharan , Francesco Pittaluga , Vijay Kumar B G , Manmohan Chandraker

Since the advent of Multimodal Large Language Models (MLLMs), they have made a significant impact across a wide range of real-world applications, particularly in Autonomous Driving (AD). Their ability to process complex visual data and…

计算机视觉与模式识别 · 计算机科学 2025-02-18 Shuo Xing , Chengyuan Qian , Yuping Wang , Hongyuan Hua , Kexin Tian , Yang Zhou , Zhengzhong Tu

The rapid rise of Large Language Models (LLMs) is transforming traffic and transportation research, with significant advancements emerging between the years 2023 and 2025 -- a period marked by the inception and swift growth of adopting and…

计算工程、金融与科学 · 计算机科学 2025-03-28 Yimo Yan , Yejia Liao , Guanhao Xu , Ruili Yao , Huiying Fan , Jingran Sun , Xia Wang , Jonathan Sprinkle , Ziyan An , Meiyi Ma , Xi Cheng , Tong Liu , Zemian Ke , Bo Zou , Matthew Barth , Yong-Hong Kuo

At present, Connected Autonomous Vehicles (CAVs) have begun to open road testing around the world, but their safety and efficiency performance in complex scenarios is still not satisfactory. Cooperative driving leverages the connectivity…

机器人学 · 计算机科学 2025-09-22 Shiyu Fang , Jiaqi Liu , Mingyu Ding , Yiming Cui , Chen Lv , Peng Hang , Jian Sun

Recent advancements in Vision-Language-Action (VLA) models have shown promise for end-to-end autonomous driving by leveraging world knowledge and reasoning capabilities. However, current VLA models often struggle with physically infeasible…

计算机视觉与模式识别 · 计算机科学 2025-11-07 Zewei Zhou , Tianhui Cai , Seth Z. Zhao , Yun Zhang , Zhiyu Huang , Bolei Zhou , Jiaqi Ma

Motion planning in complex scenarios is the core challenge in autonomous driving. Conventional methods apply predefined rules or learn from driving data to plan the future trajectory. Recent methods seek the knowledge preserved in large…

机器人学 · 计算机科学 2024-06-12 Ruijun Zhang , Xianda Guo , Wenzhao Zheng , Chenming Zhang , Kurt Keutzer , Long Chen

Widespread adoption of self-driving cars will depend not only on their safety but largely on their ability to interact with human users. Just like human drivers, self-driving cars will be expected to understand and safely follow…

机器人学 · 计算机科学 2019-10-18 Junha Roh , Chris Paxton , Andrzej Pronobis , Ali Farhadi , Dieter Fox

Large Language Models (LLM) based agents have shown promise in autonomously completing tasks across various domains, e.g., robotics, games, and web navigation. However, these agents typically require elaborate design and expert prompts to…

人工智能 · 计算机科学 2024-11-12 Minghao Chen , Yihang Li , Yanting Yang , Shiyu Yu , Binbin Lin , Xiaofei He

Autonomous driving (AD) has made significant strides in recent years. However, existing frameworks struggle to interpret and execute spontaneous user instructions, such as "overtake the car ahead." Large Language Models (LLMs) have…

Artificial intelligence (AI) plays a crucial role in autonomous driving (AD) research, propelling its development towards intelligence and efficiency. Currently, the development of AD technology follows two main technical paths:…

人工智能 · 计算机科学 2024-12-03 Yuxuan Zhu , Shiyi Wang , Wenqing Zhong , Nianchen Shen , Yunqi Li , Siqi Wang , Zhiheng Li , Cathy Wu , Zhengbing He , Li Li

Autonomous vehicle navigation in complex environments such as dense and fast-moving highways and merging scenarios remains an active area of research. A key limitation of RL is its reliance on well-specified reward functions, which often…

机器学习 · 计算机科学 2025-11-18 Timur Anvar , Jeffrey Chen , Yuyan Wang , Rohan Chandra

Large Language Models (LLMs) have shown remarkable effectiveness in various general-domain natural language processing (NLP) tasks. However, their performance in transportation safety domain tasks has been suboptimal, primarily attributed…

计算与语言 · 计算机科学 2023-07-31 Ou Zheng , Mohamed Abdel-Aty , Dongdong Wang , Chenzhu Wang , Shengxuan Ding

With the rapid advancement of large language models (LLMs), their deployment in real-world applications has become increasingly widespread. LLMs are expected to deliver robust performance across diverse tasks, user preferences, and…

计算与语言 · 计算机科学 2025-11-21 Wei Xia , Zhi-Hong Deng

Autonomous driving, particularly navigating complex and unanticipated scenarios, demands sophisticated reasoning and planning capabilities. While Multi-modal Large Language Models (MLLMs) offer a promising avenue for this, their use has…

计算机视觉与模式识别 · 计算机科学 2025-10-15 Hidehisa Arai , Keita Miwa , Kento Sasaki , Yu Yamaguchi , Kohei Watanabe , Shunsuke Aoki , Issei Yamamoto

Large language models have been widely applied to knowledge-driven decision-making for automated vehicles due to their strong generalization and reasoning capabilities. However, the safety of the resulting decisions cannot be ensured due to…

机器人学 · 计算机科学 2025-10-09 Yuanfei Lin , Sebastian Illing , Matthias Althoff

A Language Model is a term that encompasses various types of models designed to understand and generate human communication. Large Language Models (LLMs) have gained significant attention due to their ability to process text with human-like…

Recent advancements in autonomous vehicles (AVs) use Large Language Models (LLMs) to perform well in normal driving scenarios. However, ensuring safety in dynamic, high-risk environments and managing safety-critical long-tail events remain…

人工智能 · 计算机科学 2024-12-20 Zhiyuan Zhou , Heye Huang , Boqi Li , Shiyue Zhao , Yao Mu , Jianqiang Wang

Since DARPA Grand Challenges (rural) in 2004/05 and Urban Challenges in 2007, autonomous driving has been the most active field of AI applications. Recently powered by large language models (LLMs), chat systems, such as chatGPT and PaLM,…

计算机视觉与模式识别 · 计算机科学 2024-01-08 Yu Huang , Yue Chen , Zhu Li