English
Related papers

Related papers: SurrealDriver: Designing LLM-powered Generative Dr…

200 papers

Large Language Models (LLMs) have demonstrated impressive performance across diverse domains, yet they still encounter challenges such as insufficient domain-specific knowledge, biases, and hallucinations. This underscores the need for…

Computation and Language · Computer Science 2025-04-07 Hongliu Cao , Ilias Driouich , Robin Singh , Eoin Thomas

Recent studies have highlighted their proficiency in some simple tasks like writing and coding through various reasoning strategies. However, LLM agents still struggle with tasks that require comprehensive planning, a process that…

Artificial Intelligence · Computer Science 2024-05-29 Chengxing Xie , Difan Zou

Human mobility is inextricably linked to social issues such as traffic congestion, energy consumption, and public health; however, privacy concerns restrict access to mobility data. Recently, research have utilized Large Language Models…

Computers and Society · Computer Science 2024-08-06 Xuchuan Li , Fei Huang , Jianrong Lv , Zhixiong Xiao , Guolong Li , Yang Yue

Large Language Models (LLMs) have garnered significant attention for their ability to understand text and images, generate human-like text, and perform complex reasoning tasks. However, their ability to generalize this advanced reasoning…

Computer Vision and Pattern Recognition · Computer Science 2025-02-04 Mehdi Azarafza , Mojtaba Nayyeri , Charles Steinmetz , Steffen Staab , Achim Rettberg

The future of autonomous vehicles lies in the convergence of human-centric design and advanced AI capabilities. Autonomous vehicles of the future will not only transport passengers but also interact and adapt to their desires, making the…

Human-Computer Interaction · Computer Science 2023-09-20 Can Cui , Yunsheng Ma , Xu Cao , Wenqian Ye , Ziran Wang

Designing autonomous driving systems requires efficient exploration of large hardware/software configuration spaces under diverse environmental conditions, e.g., with varying traffic, weather, and road layouts. Traditional design space…

Robotics · Computer Science 2025-12-10 Po-An Shih , Shao-Hua Wang , Yung-Che Li , Chia-Heng Tu , Chih-Han Chang

Large Language Model (LLM)-based agents are increasingly employed to automate complex software engineering tasks, such as program repair and issue resolution. These agents operate by autonomously generating natural language thoughts,…

Software Engineering · Computer Science 2025-10-09 Islem Bouzenia , Michael Pradel

Achieving full automation in self-driving vehicles remains a challenge, especially in dynamic urban environments where navigation requires real-time adaptability. Existing systems struggle to handle navigation plans when faced with…

Robotics · Computer Science 2025-05-23 Augusto Luis Ballardini , Miguel Ángel Sotelo

Large language models (LLMs) are increasingly deployed as agents, expected to decompose goals, invoke tools, and verify results in dynamic environments. Realizing these capabilities requires access to agentic data-structured interaction…

Artificial Intelligence · Computer Science 2025-10-22 Abhigya Verma , Seganrasan Subramanian , Nandhakumar Kandasamy , Naman Gupta

One of the key challenges in current Reinforcement Learning (RL)-based Automated Driving (AD) agents is achieving flexible, precise, and human-like behavior cost-effectively. This paper introduces an innovative approach that uses large…

Artificial Intelligence · Computer Science 2024-12-30 Ziqi Zhou , Jingyue Zhang , Jingyuan Zhang , Yangfan He , Boyue Wang , Tianyu Shi , Alaa Khamis

While large language models (LLMs) bring not only performance but also complexity, recent work has started to turn LLMs into data generators rather than task inferencers, where another affordable task model is trained for efficient…

Computation and Language · Computer Science 2023-05-24 Jiacheng Ye , Chengzu Li , Lingpeng Kong , Tao Yu

Linear programming (LP) problems are pervasive in real-life applications. However, despite their apparent simplicity, an untrained user may find it difficult to determine the linear model of their specific problem. We envisage the creation…

Computation and Language · Computer Science 2024-02-01 Yelaman Abdullin , Diego Molla-Aliod , Bahadorreza Ofoghi , John Yearwood , Qingyang Li

Humans constantly generate a diverse range of tasks guided by internal motivations. While generative agents powered by large language models (LLMs) aim to simulate this complex behavior, it remains uncertain whether they operate on similar…

Artificial Intelligence · Computer Science 2026-01-29 Yi-Long Lu , Jiajun Song , Chunhui Zhang , Wei Wang

Generating realistic and controllable traffic scenes from natural language can greatly enhance the development and evaluation of autonomous driving systems. However, this task poses unique challenges: (1) grounding free-form text into…

Robotics · Computer Science 2026-03-27 Bo-Kai Ruan , Hao-Tang Tsui , Yung-Hui Li , Hong-Han Shuai

Generating varied scenarios through simulation is crucial for training and evaluating safety-critical systems, such as autonomous vehicles. Yet, the task of modeling the trajectories of other vehicles to simulate diverse and meaningful…

Robotics · Computer Science 2024-06-07 Phat Nguyen , Tsun-Hsuan Wang , Zhang-Wei Hong , Sertac Karaman , Daniela Rus

We introduce DriveAgent, a novel multi-agent autonomous driving framework that leverages large language model (LLM) reasoning combined with multimodal sensor fusion to enhance situational understanding and decision-making. DriveAgent…

Robotics · Computer Science 2025-05-06 Xinmeng Hou , Wuqi Wang , Long Yang , Hao Lin , Jinglun Feng , Haigen Min , Xiangmo Zhao

Effective modeling of how human travelers learn and adjust their travel behavior from interacting with transportation systems is critical for system assessment and planning. However, this task is also difficult due to the complex cognition…

Artificial Intelligence · Computer Science 2025-11-04 Tianming Liu , Jirong Yang , Yafeng Yin , Manzi Li , Linghao Wang , Zheng Zhu

Large language models (LLMs) as autonomous agents offer a novel avenue for tackling real-world challenges through a knowledge-driven manner. These LLM-enhanced methodologies excel in generalization and interpretability. However, the…

Artificial Intelligence · Computer Science 2024-07-22 Kemou Jiang , Xuan Cai , Zhiyong Cui , Aoyong Li , Yilong Ren , Haiyang Yu , Hao Yang , Daocheng Fu , Licheng Wen , Pinlong Cai

The emergence of Large Language Models (LLMs), has opened exciting possibilities for constructing computational simulations designed to replicate human behavior accurately. Current research suggests that LLM-based agents become increasingly…

Computation and Language · Computer Science 2024-12-18 Amir Taubenfeld , Yaniv Dover , Roi Reichart , Ariel Goldstein

Machine learning can predict human behavior well when substantial structured data and well-defined outcomes are available, but these models are typically limited to specific outcomes and cannot readily be applied to new domains. We test…