English
Related papers

Related papers: Enhancing LLM-based Autonomous Driving Agents to M…

200 papers

Accurate motion forecasting is crucial for safe autonomous driving (AD). This study proposes CoT-Drive, a novel approach that enhances motion forecasting by leveraging large language models (LLMs) and a chain-of-thought (CoT) prompting…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Haicheng Liao , Hanlin Kong , Bonan Wang , Chengyue Wang , Wang Ye , Zhengbing He , Chengzhong Xu , Zhenning Li

Ensuring realistic traffic dynamics is a prerequisite for simulation platforms to evaluate the reliability of self-driving systems before deployment in the real world. Because most road users are human drivers, reproducing their diverse…

Robotics · Computer Science 2025-08-26 Wendi Li , Hao Wu , Han Gao , Bing Mao , Fengyuan Xu , Sheng Zhong

Autonomous Vehicles (AVs) must make reliable decisions in dense urban environments where pedestrian behavior is variable, sometimes abnormal, and often unseen during training. Reinforcement learning (RL)-based AV control systems perform…

Robotics · Computer Science 2026-05-19 Aidana Baimbetova , Haruki Yonekura , Hamada Rizk , Hirozumi Yamaguchi

With the broader adoption and highly successful development of Large Language Models (LLMs), there has been growing interest and demand for applying LLMs to autonomous driving technology. Driven by their natural language understanding and…

Large Language Model (LLM)-based agents are increasingly employed to automate complex software engineering tasks, such as program repair and issue resolution. These agents operate by autonomously generating natural language thoughts,…

Software Engineering · Computer Science 2025-10-09 Islem Bouzenia , Michael Pradel

Recent incidents with autonomous vehicles highlight the need for rigorous testing to ensure safety and robustness. Constructing test scenarios for autonomous driving systems (ADSs), however, is labor-intensive. We propose TARGET, an…

Software Engineering · Computer Science 2025-05-19 Yao Deng , Jiaohong Yao , Zhi Tu , Xi Zheng , Mengshi Zhang , Tianyi Zhang

Large language models (LLMs) as autonomous agents offer a novel avenue for tackling real-world challenges through a knowledge-driven manner. These LLM-enhanced methodologies excel in generalization and interpretability. However, the…

Artificial Intelligence · Computer Science 2024-07-22 Kemou Jiang , Xuan Cai , Zhiyong Cui , Aoyong Li , Yilong Ren , Haiyang Yu , Hao Yang , Daocheng Fu , Licheng Wen , Pinlong Cai

Vision-language models (VLMs) are increasingly used in autonomous driving because they combine visual perception with language-based reasoning, supporting more interpretable decision-making, yet their robustness to physical adversarial…

Computer Vision and Pattern Recognition · Computer Science 2026-05-01 David Fernandez , Pedram MohajerAnsari , Amir Salarpour , Mert D. Pese

With the rapid development of China high-speed railway, drivers face increasingly significant technical challenges during operations, such as fault handling. Currently, drivers depend on the onboard mechanic when facing technical issues,…

Artificial Intelligence · Computer Science 2025-01-15 Y. C. Luo , J. Xun , W. Wang , R. Z. Zhang , Z. C. Zhao

As large language models (LLMs) become increasingly capable, security and safety evaluation are crucial. While current red teaming approaches have made strides in assessing LLM vulnerabilities, they often rely heavily on human input and…

Cryptography and Security · Computer Science 2025-03-21 Andy Zhou , Kevin Wu , Francesco Pinto , Zhaorun Chen , Yi Zeng , Yu Yang , Shuang Yang , Sanmi Koyejo , James Zou , Bo Li

Although Deep Reinforcement Learning (DRL) and Large Language Models (LLMs) each show promise in addressing decision-making challenges in autonomous driving, DRL often suffers from high sample complexity, while LLMs have difficulty ensuring…

Artificial Intelligence · Computer Science 2025-02-21 Chengkai Xu , Jiaqi Liu , Shiyu Fang , Yiming Cui , Dong Chen , Peng Hang , Jian Sun

Large Vision-Language Models (LVLMs) empower autonomous mobile agents, yet their security under realistic mobile deployment constraints remains underexplored. While agents are vulnerable to visual prompt injections, stealthily executing…

Cryptography and Security · Computer Science 2026-04-10 Renhua Ding , Xiao Yang , Zhengwei Fang , Jun Luo , Kun He , Jun Zhu

Integrating Large Language Models (LLMs) with Reinforcement Learning (RL) can enhance autonomous driving (AD) performance in complex scenarios. However, current LLM-Dominated RL methods over-rely on LLM outputs, which are prone to…

Robotics · Computer Science 2025-05-23 Zhiwen Chen , Bo Leng , Zhuoren Li , Hanming Deng , Guizhe Jin , Ran Yu , Huanxi Wen

Large Language Models (LLMs) have revolutionised natural language processing tasks, particularly as chat agents. However, their applicability to threat detection problems remains unclear. This paper examines the feasibility of employing…

Cryptography and Security · Computer Science 2025-04-21 Paul R. B. Houssel , Priyanka Singh , Siamak Layeghy , Marius Portmann

Level 3 automated driving systems allows drivers to engage in secondary tasks while diminishing their perception of risk. In the event of an emergency necessitating driver intervention, the system will alert the driver with a limited window…

Human-Computer Interaction · Computer Science 2025-08-08 Wei Xiang , Muchen Li , Jie Yan , Manling Zheng , Hanfei Zhu , Mengyun Jiang , Lingyun Sun

Automated Driving System (ADS) is a safety-critical software system responsible for the interpretation of the vehicle's environment and making decisions accordingly. The unbounded complexity of the driving context, including unforeseeable…

Autonomous highway driving demands a critical balance between proactive, efficiency-seeking behavior and robust safety guarantees. This paper proposes Language Action-guided Reinforcement Learning (LA-RL) with Safety Guarantees, a novel…

Systems and Control · Electrical Eng. & Systems 2025-12-08 Yiming Shu , Jiahui Xu , Jiwei Tang , Ruiyang Gao , Chen Sun

Recent work on activation and latent steering has demonstrated that modifying internal representations can effectively guide large language models (LLMs) toward improved reasoning and efficiency without additional training. However, most…

Machine Learning · Computer Science 2026-01-07 Tuc Nguyen , Thai Le

Intent detection is a critical component of task-oriented dialogue systems (TODS) which enables the identification of suitable actions to address user utterances at each dialog turn. Traditional approaches relied on computationally…

Computation and Language · Computer Science 2024-10-03 Gaurav Arora , Shreya Jain , Srujana Merugu

Large language models (LLMs) and LLM-based agents have been widely deployed in a wide range of applications in the real world, including healthcare diagnostics, financial analysis, customer support, robotics, and autonomous driving,…

Cryptography and Security · Computer Science 2025-05-20 Wenrui Xu , Keshab K. Parhi