English
Related papers

Related papers: Driver Assistant: Persuading Drivers to Adjust Sec…

200 papers

Recent large language models (LLMs) are promising for making decisions in grounded environments. However, LLMs frequently fail in complex decision-making tasks due to the misalignment between the pre-trained knowledge in LLMs and the actual…

Computation and Language · Computer Science 2023-10-27 Siqi Ouyang , Lei Li

Large language models (LLMs) and large multimodal models (LMMs) have achieved unprecedented breakthrough, showcasing remarkable capabilities in natural language understanding, generation, and complex reasoning. This transformative potential…

Machine Learning · Computer Science 2025-10-24 Hyun Jong Yang , Hyunsoo Kim , Hyeonho Noh , Seungnyun Kim , Byonghyo Shim

The planning ability of Large Language Models (LLMs) has garnered increasing attention in recent years due to their remarkable capacity for multi-step reasoning and their ability to generalize across a wide range of domains. While some…

Artificial Intelligence · Computer Science 2025-02-19 Mohamed Aghzal , Erion Plaku , Gregory J. Stein , Ziyu Yao

Large Language Models (LLMs) are transforming artificial intelligence, enabling autonomous agents to perform diverse tasks across various domains. These agents, proficient in human-like text comprehension and generation, have the potential…

Artificial Intelligence · Computer Science 2024-04-10 Saikat Barua

The integration of electric vehicles (EVs) into smart grids presents unique opportunities to enhance both transportation systems and energy networks. However, ensuring safe and interpretable interactions between drivers, vehicles, and the…

Artificial Intelligence · Computer Science 2025-10-06 Jean Douglas Carvalho , Hugo Kenji , Ahmad Mohammad Saber , Glaucia Melo , Max Mauro Dias Santos , Deepa Kundur

Driven by the great success of Large Language Models (LLMs) in the 2D image domain, their applications in 3D scene understanding has emerged as a new trend. A key difference between 3D and 2D is that the situation of an egocentric observer…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Zhihao Yuan , Yibo Peng , Jinke Ren , Yinghong Liao , Yatong Han , Chun-Mei Feng , Hengshuang Zhao , Guanbin Li , Shuguang Cui , Zhen Li

Large Language Models (LLMs) have shown promise in the autonomous driving sector, particularly in generalization and interpretability. We introduce a unique object-level multimodal LLM architecture that merges vectorized numeric modalities…

Large Language Models (LLMs) are able to provide assistance on a wide range of information-seeking tasks. However, model outputs may be misleading, whether unintentionally or in cases of intentional deception. We investigate the ability of…

Computation and Language · Computer Science 2024-07-17 Betty Li Hou , Kejian Shi , Jason Phang , James Aung , Steven Adler , Rosie Campbell

Autonomous control systems face significant challenges in performing complex tasks in the presence of latent risks. To address this, we propose an integrated framework that combines Large Language Models (LLMs), numerical optimization, and…

Systems and Control · Electrical Eng. & Systems 2025-05-08 Xiyu Deng , Quan Khanh Luu , Anh Van Ho , Yorie Nakahira

Generating varied scenarios through simulation is crucial for training and evaluating safety-critical systems, such as autonomous vehicles. Yet, the task of modeling the trajectories of other vehicles to simulate diverse and meaningful…

Robotics · Computer Science 2024-06-07 Phat Nguyen , Tsun-Hsuan Wang , Zhang-Wei Hong , Sertac Karaman , Daniela Rus

Autonomous driving technology, a catalyst for revolutionizing transportation and urban mobility, has the tend to transition from rule-based systems to data-driven strategies. Traditional module-based systems are constrained by cumulative…

Artificial Intelligence · Computer Science 2024-08-13 Zhenjie Yang , Xiaosong Jia , Hongyang Li , Junchi Yan

Large Language Models (LLMs) are becoming ubiquitous to create intelligent virtual assistants that assist users in interacting with a system, as exemplified in marketing. Although LLMs have been discussed in Modeling & Simulation (M&S), the…

Human-Computer Interaction · Computer Science 2024-09-25 Philippe J. Giabbanelli , Jose J. Padilla , Ameeta Agrawal

Motion prediction is among the most fundamental tasks in autonomous driving. Traditional methods of motion forecasting primarily encode vector information of maps and historical trajectory data of traffic participants, lacking a…

Computer Vision and Pattern Recognition · Computer Science 2024-07-31 Xiaoji Zheng , Lixiu Wu , Zhijie Yan , Yuanrong Tang , Hao Zhao , Chen Zhong , Bokui Chen , Jiangtao Gong

Pedestrian safety is a critical component of urban mobility and is strongly influenced by the interactions between pedestrian decision-making and driver yielding behavior at crosswalks. Modeling driver--pedestrian interactions at…

Computation and Language · Computer Science 2025-09-25 Yicheng Yang , Zixian Li , Jean Paul Bizimana , Niaz Zafri , Yongfeng Dong , Tianyi Li

One of the key challenges in current Reinforcement Learning (RL)-based Automated Driving (AD) agents is achieving flexible, precise, and human-like behavior cost-effectively. This paper introduces an innovative approach that uses large…

Artificial Intelligence · Computer Science 2024-12-30 Ziqi Zhou , Jingyue Zhang , Jingyuan Zhang , Yangfan He , Boyue Wang , Tianyu Shi , Alaa Khamis

Multimodal large language models (MLLMs) have shown satisfactory effects in many autonomous driving tasks. In this paper, MLLMs are utilized to solve joint semantic scene understanding and risk localization tasks, while only relying on…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Jiaqi Fan , Jianhua Wu , Jincheng Gao , Jianhao Yu , Yafei Wang , Hongqing Chu , Bingzhao Gao

Neural Networks (NNs) trained through supervised learning struggle with managing edge-case scenarios common in real-world driving due to the intractability of exhaustive datasets covering all edge-cases, making knowledge-driven approaches,…

Artificial Intelligence · Computer Science 2025-04-17 Nicolas Baumann , Cheng Hu , Paviththiren Sivasothilingam , Haotong Qin , Lei Xie , Michele Magno , Luca Benini

There are many bottlenecks that decrease the flexibility of automotive systems, making their long-term maintenance, as well as updates and extensions in later lifecycle phases increasingly difficult, mainly due to long re-engineering,…

Software Engineering · Computer Science 2025-09-17 Nenad Petrovic , Lukasz Mazur , Alois Knoll

Roadway safety and mobility remain critical challenges for modern transportation systems, demanding innovative analytical frameworks capable of addressing complex, dynamic, and heterogeneous environments. While traditional engineering…

Artificial Intelligence · Computer Science 2025-12-10 Muhammad Monjurul Karim , Yan Shi , Shucheng Zhang , Bingzhang Wang , Mehrdad Nasri , Yinhai Wang

The rapid evolution of large language models (LLMs) has pushed their boundaries to many applications in various domains. Recently, the research community has started to evaluate their potential adoption in autonomous vehicles and especially…

Robotics · Computer Science 2025-09-09 Petros Loukas , David Bassir , Savvas Chatzichristofis , Angelos Amanatiadis