English
Related papers

Related papers: Chat2Scenario: Scenario Extraction From Dataset Th…

200 papers

In this paper, we explore the potential of using a large language model (LLM) to understand the driving environment in a human-like manner and analyze its ability to reason, interpret, and memorize when facing complex scenarios. We argue…

Robotics · Computer Science 2023-07-17 Daocheng Fu , Xin Li , Licheng Wen , Min Dou , Pinlong Cai , Botian Shi , Yu Qiao

Large language models (LLMs) have demonstrated remarkable capabilities across a range of text-generation tasks. However, LLMs still struggle with problems requiring multi-step decision-making and environmental feedback, such as online…

Artificial Intelligence · Computer Science 2025-02-18 Zhenfang Chen , Delin Chen , Rui Sun , Wenjun Liu , Chuang Gan

The future of conversational agents will provide users with personalized information responses. However, a significant challenge in developing models is the lack of large-scale dialogue datasets that span multiple sessions and reflect…

Information Retrieval · Computer Science 2024-05-07 Hideaki Joko , Shubham Chatterjee , Andrew Ramsay , Arjen P. de Vries , Jeff Dalton , Faegheh Hasibi

Large Language Models (LLMs) have revolutionized human-AI interaction by enabling intuitive task execution through natural language prompts. Despite their potential, designing effective prompts remains a significant challenge, as small…

Software Engineering · Computer Science 2025-04-08 Yuetian Mao , Junjie He , Chunyang Chen

Driven by the great success of Large Language Models (LLMs) in the 2D image domain, their applications in 3D scene understanding has emerged as a new trend. A key difference between 3D and 2D is that the situation of an egocentric observer…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Zhihao Yuan , Yibo Peng , Jinke Ren , Yinghong Liao , Yatong Han , Chun-Mei Feng , Hengshuang Zhao , Guanbin Li , Shuguang Cui , Zhen Li

The large set of technical documentation of legacy accelerator systems, coupled with the retirement of experienced personnel, underscores the urgent need for efficient methods to preserve and transfer specialized knowledge. This paper…

Information Retrieval · Computer Science 2025-09-03 Qing Dai , Rasmus Ischebeck , Maruisz Sapinski , Adam Grycner

Motion prediction is among the most fundamental tasks in autonomous driving. Traditional methods of motion forecasting primarily encode vector information of maps and historical trajectory data of traffic participants, lacking a…

Computer Vision and Pattern Recognition · Computer Science 2024-07-31 Xiaoji Zheng , Lixiu Wu , Zhijie Yan , Yuanrong Tang , Hao Zhao , Chen Zhong , Bokui Chen , Jiangtao Gong

Large Vision Language Models (LVLMs) have shown strong capabilities in understanding and analyzing visual scenes across various domains. However, in the context of autonomous driving, their limited comprehension of 3D environments restricts…

Computer Vision and Pattern Recognition · Computer Science 2025-05-02 Jannik Lübberstedt , Esteban Rivera , Nico Uhlemann , Markus Lienkamp

This study addresses the critical need for enhanced situational awareness in autonomous driving (AD) by leveraging the contextual reasoning capabilities of large language models (LLMs). Unlike traditional perception systems that rely on…

Artificial Intelligence · Computer Science 2025-01-09 Xuewen Luo , Fan Ding , Fengze Yang , Yang Zhou , Junnyong Loo , Hwa Hui Tew , Chenxi Liu

This study presents an innovative approach to urban mobility simulation by integrating a Large Language Model (LLM) with Agent-Based Modeling (ABM). Unlike traditional rule-based ABM, the proposed framework leverages LLM to enhance agent…

Multiagent Systems · Computer Science 2025-07-04 Yu-Lun Song , Chung-En Tsern , Che-Cheng Wu , Yu-Ming Chang , Syuan-Bo Huang , Wei-Chu Chen , Michael Chia-Liang Lin , Yu-Ta Lin

Equation discovery is aimed at directly extracting physical laws from data and has emerged as a pivotal research domain. Previous methods based on symbolic mathematics have achieved substantial advancements, but often require the design of…

Machine Learning · Computer Science 2024-07-23 Mengge Du , Yuntian Chen , Zhongzheng Wang , Longfeng Nie , Dongxiao Zhang

Level 3 automated driving systems allows drivers to engage in secondary tasks while diminishing their perception of risk. In the event of an emergency necessitating driver intervention, the system will alert the driver with a limited window…

Human-Computer Interaction · Computer Science 2025-08-08 Wei Xiang , Muchen Li , Jie Yan , Manling Zheng , Hanfei Zhu , Mengyun Jiang , Lingyun Sun

Large Language Models (LLMs) have revolutionized Natural Language Processing but exhibit limitations, particularly in autonomously addressing novel challenges such as reasoning and problem-solving. Traditional techniques like…

Multiagent Systems · Computer Science 2024-01-03 Sumedh Rasal

The applications of Vision-Language Models (VLMs) in the field of Autonomous Driving (AD) have attracted widespread attention due to their outstanding performance and the ability to leverage Large Language Models (LLMs). By incorporating…

Computer Vision and Pattern Recognition · Computer Science 2024-06-25 Xingcheng Zhou , Mingyu Liu , Ekim Yurtsever , Bare Luka Zagar , Walter Zimmer , Hu Cao , Alois C. Knoll

Scenario mining from extensive autonomous driving datasets, such as Argoverse 2, is crucial for the development and validation of self-driving systems. The RefAV framework represents a promising approach by employing Large Language Models…

Computer Vision and Pattern Recognition · Computer Science 2025-06-16 Yifei Chen , Ross Greer

Large Language Models (LLMs) have recently demonstrated impressive capabilities across various real-world applications. However, due to the current text-in-text-out paradigm, it remains challenging for LLMs to handle dynamic and complex…

Artificial Intelligence · Computer Science 2024-10-25 Timothy Wei , Annabelle Miin , Anastasia Miin

This work leverages Large Language Models (LLMs) to simulate human mobility, addressing challenges like high costs and privacy concerns in traditional models. Our hierarchical framework integrates persona generation, activity selection, and…

Artificial Intelligence · Computer Science 2025-02-27 Chenlu Ju , Jiaxin Liu , Shobhit Sinha , Hao Xue , Flora Salim

Crash detection from video feeds is a critical problem in intelligent transportation systems. Recent developments in large language models (LLMs) and vision-language models (VLMs) have transformed how we process, reason about, and summarize…

Computer Vision and Pattern Recognition · Computer Science 2025-09-10 Sanjeda Akter , Ibne Farabi Shihab , Anuj Sharma

Large-scale driving datasets such as Waymo Open Dataset and nuScenes substantially accelerate autonomous driving research, especially for perception tasks such as 3D detection and trajectory forecasting. Since the driving logs in these…

Robotics · Computer Science 2023-10-31 Quanyi Li , Zhenghao Peng , Lan Feng , Zhizheng Liu , Chenda Duan , Wenjie Mo , Bolei Zhou

Ensuring the functional correctness and safety of autonomous vehicles is a major challenge for the automotive industry. However, exhaustive physical test drives are not feasible, as billions of driven kilometers would be required to obtain…

Software Engineering · Computer Science 2021-02-09 Barbara Schuett , Thilo Braun , Stefan Otten , Eric Sax