English
Related papers

Related papers: Personalized Autonomous Driving with Large Languag…

200 papers

TalkWithMachines aims to enhance human-robot interaction by contributing to interpretable industrial robotic systems, especially for safety-critical applications. The presented paper investigates recent advancements in Large Language Models…

Robotics · Computer Science 2024-12-23 Ammar N. Abbas , Csaba Beleznai

Autonomous vehicles (AVs) rely on sophisticated perception systems to interpret their surroundings, a cornerstone for safe navigation and decision-making. The integration of Large Language Models (LLMs) into AV perception frameworks offers…

Robotics · Computer Science 2024-12-31 Athanasios Karagounis

Large Language Models (LLMs), AI models trained on massive text corpora with remarkable language understanding and generation capabilities, are transforming the field of Autonomous Driving (AD). As AD systems evolve from rule-based and…

Artificial Intelligence · Computer Science 2024-07-30 Yun Li , Kai Katsumata , Ehsan Javanmardi , Manabu Tsukada

Recent advancements in autonomous driving have relied on data-driven approaches, which are widely adopted but face challenges including dataset bias, overfitting, and uninterpretability. Drawing inspiration from the knowledge-driven nature…

Robotics · Computer Science 2024-02-23 Licheng Wen , Daocheng Fu , Xin Li , Xinyu Cai , Tao Ma , Pinlong Cai , Min Dou , Botian Shi , Liang He , Yu Qiao

Large language models (LLMs) and large multimodal models (LMMs) have achieved unprecedented breakthrough, showcasing remarkable capabilities in natural language understanding, generation, and complex reasoning. This transformative potential…

Machine Learning · Computer Science 2025-10-24 Hyun Jong Yang , Hyunsoo Kim , Hyeonho Noh , Seungnyun Kim , Byonghyo Shim

The utilization of Large Language Models (LLMs) within the realm of reinforcement learning, particularly as planners, has garnered a significant degree of attention in recent scholarly literature. However, a substantial proportion of…

Robotics · Computer Science 2024-07-30 Yiqun Duan , Qiang Zhang , Renjing Xu

Since DARPA Grand Challenges (rural) in 2004/05 and Urban Challenges in 2007, autonomous driving has been the most active field of AI applications. Recently powered by large language models (LLMs), chat systems, such as chatGPT and PaLM,…

Computer Vision and Pattern Recognition · Computer Science 2024-01-08 Yu Huang , Yue Chen , Zhu Li

Past work has demonstrated that autonomous vehicles can drive more safely if they communicate with one another than if they do not. However, their communication has often not been human-understandable. Using natural language as a…

Robotics · Computer Science 2025-06-02 Jiaxun Cui , Chen Tang , Jarrett Holtz , Janice Nguyen , Alessandro G. Allievi , Hang Qiu , Peter Stone

The advent of Large Language Models (LLM) provides new insights to validate Automated Driving Systems (ADS). In the herein-introduced work, a novel approach to extracting scenarios from naturalistic driving datasets is presented. A…

Robotics · Computer Science 2024-07-19 Yongqi Zhao , Wenbo Xiao , Tomislav Mihalj , Jia Hu , Arno Eichberger

Large Language Models (LLMs) and Multimodal LLMs (MLLMs) have demonstrated immense potential in autonomous driving (AD) by offering human-like reasoning and open-world generalization. However, the excessive computational overhead and high…

Robotics · Computer Science 2026-05-26 Ruoyu Yao , Ruiguo Zhong , Pei Liu , Mingxing Peng , Rui Yang , Jun Ma

In recent years, large language models have had a very impressive performance, which largely contributed to the development and application of artificial intelligence, and the parameters and performance of the models are still growing…

Machine Learning · Computer Science 2025-01-10 Xuran Zheng , Chang D. Yoo

In autonomous exploration tasks, robots are required to explore and map unknown environments while efficiently planning in dynamic and uncertain conditions. Given the significant variability of environments, human operators often have…

Robotics · Computer Science 2025-03-11 Shuhao Liao , Xuxin Lv , Yuhong Cao , Jeric Lew , Wenjun Wu , Guillaume Sartoretti

Large language models (LLMs) have emerged as effective action policies for sequential decision-making (SDM) tasks due to their extensive prior knowledge. However, this broad yet general knowledge is often insufficient for specific…

Machine Learning · Computer Science 2025-10-01 Xue Yan , Zijing Ou , Mengyue Yang , Yan Song , Haifeng Zhang , Yingzhen Li , Jun Wang

How to construct an interpretable autonomous driving decision-making system has become a focal point in academic research. In this study, we propose a novel approach that leverages large language models (LLMs) to generate executable,…

Artificial Intelligence · Computer Science 2025-06-18 Fanzhi Zeng , Siqi Wang , Chuzhao Zhu , Li Li

Over the last year, significant advancements have been made in the realms of large language models (LLMs) and multi-modal large language models (MLLMs), particularly in their application to autonomous driving. These models have showcased…

Robotics · Computer Science 2024-06-11 Xiangrui Kong , Thomas Braunl , Marco Fahmi , Yue Wang

A long-term goal of artificial intelligence is to have an agent execute commands communicated through natural language. In many cases the commands are grounded in a visual environment shared by the human who gives the command and the agent.…

Artificial Intelligence · Computer Science 2020-08-27 Thierry Deruyttere , Simon Vandenhende , Dusan Grujicic , Luc Van Gool , Marie-Francine Moens

As large language models (LLMs) become more deeply integrated into various sectors, understanding how they make moral judgments has become crucial, particularly in the realm of autonomous driving. This study utilized the Moral Machine…

Computation and Language · Computer Science 2024-02-08 Kazuhiro Takemoto

Deep learning architectures with powerful reasoning capabilities have driven significant advancements in autonomous driving technology. Large language models (LLMs) applied in this field can describe driving scenes and behaviors with a…

Artificial Intelligence · Computer Science 2024-10-01 Yizhou Huang , Yihua Cheng , Kezhi Wang

Neural Networks (NNs) trained through supervised learning struggle with managing edge-case scenarios common in real-world driving due to the intractability of exhaustive datasets covering all edge-cases, making knowledge-driven approaches,…

Artificial Intelligence · Computer Science 2025-04-17 Nicolas Baumann , Cheng Hu , Paviththiren Sivasothilingam , Haotong Qin , Lei Xie , Michele Magno , Luca Benini

With the rapid development of large language models (LLMs), it is highly demanded that LLMs can be adopted to make decisions to enable the artificial general intelligence. Most approaches leverage manually crafted examples to prompt the…

Machine Learning · Computer Science 2023-12-15 Xingjin Wang , Linjing Li , Daniel Zeng