中文
相关论文

相关论文: Enhancing LLM-based Autonomous Driving with Modula…

200 篇论文

Large language models (LLMs) have opened up new possibilities for intelligent agents, endowing them with human-like thinking and cognitive abilities. In this work, we delve into the potential of large language models (LLMs) in autonomous…

计算机视觉与模式识别 · 计算机科学 2025-12-18 Erfei Cui , Wenhai Wang , Zhiqi Li , Jiangwei Xie , Haoming Zou , Hanming Deng , Gen Luo , Lewei Lu , Xizhou Zhu , Jifeng Dai

Autonomous driving has the potential to set the stage for more efficient future mobility, requiring the research domain to establish trust through safe, reliable and transparent driving. Large Language Models (LLMs) possess reasoning…

机器人学 · 计算机科学 2025-03-06 Katharina Winter , Mark Azer , Fabian B. Flohr

Traffic signal control (TSC) is a core component of intelligent transportation systems (ITS), aiming to reduce congestion, emissions, and travel time. Recent approaches based on reinforcement learning (RL) and large language models (LLMs)…

人工智能 · 计算机科学 2026-04-14 Qing Guo , Xinhang Li , Junyu Chen , Zheng Guo , Shengzhe Xu , Lin Zhang , Lei Li

As robots acquire increasingly sophisticated skills and see increasingly complex and varied environments, the threat of an edge case or anomalous failure is ever present. For example, Tesla cars have seen interesting failure modes ranging…

机器人学 · 计算机科学 2023-09-13 Amine Elhafsi , Rohan Sinha , Christopher Agia , Edward Schmerling , Issa Nesnas , Marco Pavone

In recent years, large language models have had a very impressive performance, which largely contributed to the development and application of artificial intelligence, and the parameters and performance of the models are still growing…

机器学习 · 计算机科学 2025-01-10 Xuran Zheng , Chang D. Yoo

Urban congestion remains a critical challenge, with traffic signal control (TSC) emerging as a potent solution. TSC is often modeled as a Markov Decision Process problem and then solved using reinforcement learning (RL), which has proven…

人工智能 · 计算机科学 2024-07-09 Aoyu Pang , Maonan Wang , Man-On Pun , Chung Shue Chen , Xi Xiong

Intelligent Transportation Systems (ITS) are increasingly vulnerable to sophisticated cyberattacks due to their complex, interconnected nature. Ensuring the cybersecurity of these systems is paramount to maintaining road safety and…

密码学与安全 · 计算机科学 2025-06-23 Lu Gao , Yongxin Liu , Hongyun Chen , Dahai Liu , Yunpeng Zhang , Jingran Sun

Large vision-language models (VLMs) have shown promising capabilities in scene understanding, enhancing the explainability of driving behaviors and interactivity with users. Existing methods primarily fine-tune VLMs on on-board multi-view…

计算机视觉与模式识别 · 计算机科学 2025-08-19 Nan Song , Bozhou Zhang , Xiatian Zhu , Jiankang Deng , Li Zhang

Developing autonomous driving systems (ADSs) involves generating and storing extensive log data from test drives, which is essential for verification, research, and simulation. However, these high-frequency logs, recorded over varying…

软件工程 · 计算机科学 2025-06-16 Simin Sun , Yuchuan Jin , Miroslaw Staron

Traffic signal control (TSC) is a core challenge in urban mobility, where real-time decisions must balance efficiency and safety. Existing methods - ranging from rule-based heuristics to reinforcement learning (RL) - often struggle to…

系统与控制 · 电气工程与系统科学 2025-12-12 Maonan Wang , Yirong Chen , Aoyu Pang , Yuxin Cai , Chung Shue Chen , Yuheng Kan , Man-On Pun

Although Deep Reinforcement Learning (DRL) and Large Language Models (LLMs) each show promise in addressing decision-making challenges in autonomous driving, DRL often suffers from high sample complexity, while LLMs have difficulty ensuring…

人工智能 · 计算机科学 2025-02-21 Chengkai Xu , Jiaqi Liu , Shiyu Fang , Yiming Cui , Dong Chen , Peng Hang , Jian Sun

Recent work on activation and latent steering has demonstrated that modifying internal representations can effectively guide large language models (LLMs) toward improved reasoning and efficiency without additional training. However, most…

机器学习 · 计算机科学 2026-01-07 Tuc Nguyen , Thai Le

The integration of electric vehicles (EVs) into smart grids presents unique opportunities to enhance both transportation systems and energy networks. However, ensuring safe and interpretable interactions between drivers, vehicles, and the…

Predicting the future trajectories of dynamic traffic actors is a cornerstone task in autonomous driving. Though existing notable efforts have resulted in impressive performance improvements, a gap persists in scene cognitive and…

计算机视觉与模式识别 · 计算机科学 2024-05-09 Zhengxing Lan , Hongbo Li , Lingshan Liu , Bo Fan , Yisheng Lv , Yilong Ren , Zhiyong Cui

The integration of Large Language Models (LLMs) with computer vision is profoundly transforming perception tasks like image segmentation. For intelligent transportation systems (ITS), where accurate scene understanding is critical for…

计算机视觉与模式识别 · 计算机科学 2025-09-09 Sanjeda Akter , Ibne Farabi Shihab , Anuj Sharma

With the emergence of Large Language Models (LLMs) and Vision Foundation Models (VFMs), multimodal AI systems benefiting from large models have the potential to equally perceive the real world, make decisions, and control tools as humans.…

Recent advancements in Multimodal Large Language Models (MLLMs) have demonstrated impressive capabilities in general visual understanding. However, their application to safety-critical driving scenarios remains limited by an inability to…

计算机视觉与模式识别 · 计算机科学 2026-05-22 Tomaso Trinci , Henrique Piñeiro Monteagudo , Leonardo Taccari

In autonomous driving, end-to-end (E2E) driving systems that predict control commands directly from sensor data have achieved significant advancements. For safe driving in unexpected scenarios, these systems may additionally rely on human…

计算机视觉与模式识别 · 计算机科学 2026-03-17 Seo Hyun Kim , Jin Bok Park , Do Yeon Koo , Hogun Park , Il Yong Chun

With the broader adoption and highly successful development of Large Language Models (LLMs), there has been growing interest and demand for applying LLMs to autonomous driving technology. Driven by their natural language understanding and…

Traditional autonomous driving methods adopt a modular design, decomposing tasks into sub-tasks. In contrast, end-to-end autonomous driving directly outputs actions from raw sensor data, avoiding error accumulation. However, training an…

机器人学 · 计算机科学 2024-11-22 Zeyu Dong , Yimin Zhu , Yansong Li , Kevin Mahon , Yu Sun