English
Related papers

Related papers: Personalized Autonomous Driving with Large Languag…

200 papers

Bus holding control is a widely-adopted strategy for maintaining stability and improving the operational efficiency of bus systems. Traditional model-based methods often face challenges with the low accuracy of bus state prediction and…

Artificial Intelligence · Computer Science 2025-04-15 Jiajie Yu , Yuhong Wang , Wei Ma

Researchers have been studying approaches to steer the behavior of Large Language Models (LLMs) and build personalized LLMs tailored for various applications. While fine-tuning seems to be a direct solution, it requires substantial…

Computation and Language · Computer Science 2024-07-31 Yuanpu Cao , Tianrong Zhang , Bochuan Cao , Ziyi Yin , Lu Lin , Fenglong Ma , Jinghui Chen

Large Language Models (LLMs) pre-trained on internet-scale datasets have shown impressive capabilities in code understanding, synthesis, and general purpose question-and-answering. Key to their performance is the substantial prior knowledge…

Robotics · Computer Science 2023-11-03 Andrea Tagliabue , Kota Kondo , Tong Zhao , Mason Peterson , Claudius T. Tewari , Jonathan P. How

The integration of Large Language Models (LLMs) into autonomous driving systems demonstrates strong common sense and reasoning abilities, effectively addressing the pitfalls of purely data-driven methods. Current LLM-based agents require…

Robotics · Computer Science 2024-10-22 Sihao Wu , Jiaxu Liu , Xiangyu Yin , Guangliang Cheng , Xingyu Zhao , Meng Fang , Xinping Yi , Xiaowei Huang

One of the key challenges in current Reinforcement Learning (RL)-based Automated Driving (AD) agents is achieving flexible, precise, and human-like behavior cost-effectively. This paper introduces an innovative approach that uses large…

Artificial Intelligence · Computer Science 2024-12-30 Ziqi Zhou , Jingyue Zhang , Jingyuan Zhang , Yangfan He , Boyue Wang , Tianyu Shi , Alaa Khamis

Large Language Models (LLMs) are transforming artificial intelligence, enabling autonomous agents to perform diverse tasks across various domains. These agents, proficient in human-like text comprehension and generation, have the potential…

Artificial Intelligence · Computer Science 2024-04-10 Saikat Barua

Large language models (LLMs) demonstrate extraordinary abilities in a wide range of natural language processing (NLP) tasks. In this paper, we show that, beyond text understanding capability, LLMs are capable of processing text layouts that…

Computation and Language · Computer Science 2024-08-29 Weiming Li , Manni Duan , Dong An , Yan Shao

Effectively integrating Large Language Models (LLMs) into autonomous driving requires a balance between leveraging high-level reasoning and maintaining real-time efficiency. Existing approaches either activate LLMs too frequently, causing…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Ruifei Zhang , Junlin Xie , Wei Zhang , Weikai Chen , Xiao Tan , Xiang Wan , Guanbin Li

Real-world path planning tasks typically involve multiple constraints beyond simple route optimization, such as the number of routes, maximum route length, depot locations, and task-specific requirements. Traditional approaches rely on…

Computation and Language · Computer Science 2026-03-23 Dylan Shim , Minghan Wei

As spacecraft journey further from Earth with more complex missions, systems of greater autonomy and onboard intelligence are called for. Reducing reliance on human-based mission control becomes increasingly critical if we are to increase…

Robotics · Computer Science 2024-05-03 David Maranto

Enabling humanoid robots to perform autonomously loco-manipulation in unstructured environments is crucial and highly challenging for achieving embodied intelligence. This involves robots being able to plan their actions and behaviors in…

Robotics · Computer Science 2024-08-16 Jin Wang , Arturo Laurenzi , Nikos Tsagarakis

Adapting driving behavior to new environments, customs, and laws is a long-standing problem in autonomous driving, precluding the widespread deployment of autonomous vehicles (AVs). In this paper, we present LLaDA, a simple yet powerful…

Robotics · Computer Science 2024-04-12 Boyi Li , Yue Wang , Jiageng Mao , Boris Ivanovic , Sushant Veer , Karen Leung , Marco Pavone

Agentic memory is emerging as a key enabler for large language models (LLM) to maintain continuity, personalization, and long-term context in extended user interactions, critical capabilities for deploying LLMs as truly interactive and…

Artificial Intelligence · Computer Science 2025-12-16 Samarth Sarin , Lovepreet Singh , Bhaskarjit Sarmah , Dhagash Mehta

Vision language model (VLM)-based mobile agents show great potential for assisting users in performing instruction-driven tasks. However, these agents typically struggle with personalized instructions -- those containing ambiguous,…

Artificial Intelligence · Computer Science 2025-08-26 Xin Wang , Zhiyao Cui , Hao Li , Ya Zeng , Chenxu Wang , Ruiqi Song , Yihang Chen , Kun Shao , Qiaosheng Zhang , Jinzhuo Liu , Siyue Ren , Shuyue Hu , Zhen Wang

We introduce Language Feedback Models (LFMs) that identify desirable behaviour - actions that help achieve tasks specified in the instruction - for imitation learning in instruction following. To train LFMs, we obtain feedback from Large…

Machine Learning · Computer Science 2024-10-11 Victor Zhong , Dipendra Misra , Xingdi Yuan , Marc-Alexandre Côté

Designing autonomous driving systems requires efficient exploration of large hardware/software configuration spaces under diverse environmental conditions, e.g., with varying traffic, weather, and road layouts. Traditional design space…

Robotics · Computer Science 2025-12-10 Po-An Shih , Shao-Hua Wang , Yung-Che Li , Chia-Heng Tu , Chih-Han Chang

Autonomous vehicle navigation in complex environments such as dense and fast-moving highways and merging scenarios remains an active area of research. A key limitation of RL is its reliance on well-specified reward functions, which often…

Machine Learning · Computer Science 2025-11-18 Timur Anvar , Jeffrey Chen , Yuyan Wang , Rohan Chandra

Large language models (LLMs) can reshape information processing by handling data analysis, visualization, and interpretation in an interactive, context-aware dialogue with users, including voice interaction, while maintaining high…

Artificial Intelligence · Computer Science 2025-11-25 Mohammad Nour Al Awad , Sergey Ivanov , Olga Tikhonova , Ivan Khodnenko

We propose a multi-agent framework for modeling artificial consciousness in large language models (LLMs), grounded in psychoanalytic theory. Our \textbf{Psychodynamic Model} simulates self-awareness, preconsciousness, and unconsciousness…

Computation and Language · Computer Science 2025-10-22 Sang Hun Kim , Jongmin Lee , Dongkyu Park , So Young Lee , Yosep Chong