English
Related papers

Related papers: C-TRAIL: A Commonsense World Framework for Traject…

200 papers

Large language models (LLMs) have opened up new possibilities for intelligent agents, endowing them with human-like thinking and cognitive abilities. In this work, we delve into the potential of large language models (LLMs) in autonomous…

Computer Vision and Pattern Recognition · Computer Science 2025-12-18 Erfei Cui , Wenhai Wang , Zhiqi Li , Jiangwei Xie , Haoming Zou , Hanming Deng , Gen Luo , Lewei Lu , Xizhou Zhu , Jifeng Dai

We present ControlLLM, a novel framework that enables large language models (LLMs) to utilize multi-modal tools for solving complex real-world tasks. Despite the remarkable performance of LLMs, they still struggle with tool invocation due…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 Zhaoyang Liu , Zeqiang Lai , Zhangwei Gao , Erfei Cui , Ziheng Li , Xizhou Zhu , Lewei Lu , Qifeng Chen , Yu Qiao , Jifeng Dai , Wenhai Wang

Integrating large language models (LLMs) into autonomous driving enhances personalization and adaptability in open-world scenarios. However, traditional edge computing models still face significant challenges in processing complex driving…

Robotics · Computer Science 2024-08-20 Jiao Chen , Suyan Dai , Fangfang Chen , Zuohong Lv , Jianhua Tang

Lane merging is one of the critical tasks for self-driving cars, and how to perform lane-merge maneuvers effectively and safely has become one of the important standards in measuring the capability of autonomous driving systems. However,…

Robotics · Computer Science 2024-03-21 Pengfei Lin , Ehsan Javanmardi , Yuze Jiang , Manabu Tsukada

This work introduces SAM-LLM, a novel hybrid architecture that bridges the gap between the contextual reasoning of Large Language Models (LLMs) and the physical precision of kinematic lane change models for autonomous driving. The system is…

Artificial Intelligence · Computer Science 2025-09-04 Zhuo Cao , Yunxiao Shi , Min Xu

Occlusion-aware prediction remains a critical challenge in autonomous driving due to the inherent uncertainty of unobserved regions. Existing approaches either overestimate risk based on reachable states or struggle to predict accurate…

Robotics · Computer Science 2026-05-22 Jie Jia , Yaofeng Su , Zeyu Bao , Yun Hong , Bingzhao Gao , Zhongxue Gan , Wenchao Ding

Large language models (LLMs) have improved significantly in their reasoning through extensive training on massive datasets. However, relying solely on additional data for improvement is becoming increasingly impractical, highlighting the…

Computation and Language · Computer Science 2025-10-01 Gaurav Srivastava , Zhenyu Bi , Meng Lu , Xuan Wang

Dynamic maps (DM) serve as the fundamental information infrastructure for vehicle-road-cloud (VRC) cooperative autonomous driving in China and Japan. By providing comprehensive traffic scene representations, DM overcome the limitations of…

Artificial Intelligence · Computer Science 2026-02-13 Lu Tao , Jinxuan Luo , Yousuke Watanabe , Zhengshu Zhou , Yuhuan Lu , Shen Ying , Pan Zhang , Fei Zhao , Hiroaki Takada

Recent studies demonstrate that tool-calling capability enables large language models (LLMs) to interact with external environments for long-horizon financial tasks. While existing benchmarks have begun evaluating financial tool calling,…

Modern networks generate vast, heterogeneous traffic that must be continuously analyzed for security and performance. Traditional network traffic analysis systems, whether rule-based or machine learning-driven, often suffer from high false…

Machine Learning · Computer Science 2026-03-18 Shaghayegh Shajarian , Kennedy Marsh , James Benson , Sajad Khorsandroo , Mahmoud Abdelsalam

While test-time reasoning enables language models (LMs) to tackle complex tasks, searching or planning in natural language can be slow, costly, and error-prone. But even when LMs struggle to emulate the precise reasoning steps needed to…

Computation and Language · Computer Science 2025-08-11 Gabriel Grand , Joshua B. Tenenbaum , Vikash K. Mansinghka , Alexander K. Lew , Jacob Andreas

Transportation engineering often relies on technical manuals and analytical tools for planning, design, and operations. However, the dissemination and management of these methodologies, such as those defined in the Highway Capacity Manual…

Computers and Society · Computer Science 2026-04-21 Rei Tamaru , Bin Ran

Reinforcement learning (RL) is a promising approach for robotic manipulation, but it can suffer from low sample efficiency and requires extensive exploration of large state-action spaces. Recent methods leverage the commonsense knowledge…

Robotics · Computer Science 2026-04-15 Jelle Luijkx , Runyu Ma , Zlatan Ajanović , Jens Kober

Large language model (LLM)-based agents increasingly rely on tool use to complete real-world tasks. While existing works evaluate the LLMs' tool use capability, they largely focus on the final answers yet overlook the detailed tool usage…

Recent advancements in Large Language Models (LLMs) offer new opportunities to create natural language interfaces for Autonomous Driving Systems (ADSs), moving beyond rigid inputs. This paper addresses the challenge of mapping the…

Robotics · Computer Science 2026-01-26 Marvin Seegert , Korbinian Moller , Johannes Betz

To evaluate code large language models (LLMs), research has relied on a few small manually curated benchmarks, such as HumanEval and MBPP, which represent a narrow part of the real-world software domains. In this work, we introduce…

Software Engineering · Computer Science 2024-05-28 Miltiadis Allamanis , Sheena Panthaplackel , Pengcheng Yin

In real-world domains such as self-driving, generalization to rare scenarios remains a fundamental challenge. To address this, we introduce a new dataset designed for end-to-end driving that focuses on long-tail driving events. We provide…

Autonomous driving systems remain brittle in rare, ambiguous, and out-of-distribution scenarios, where human driver succeed through contextual reasoning. Shared autonomy has emerged as a promising approach to mitigate such failures by…

Robotics · Computer Science 2025-11-07 Phat Nguyen , Erfan Aasi , Shiva Sreeram , Guy Rosman , Andrew Silva , Sertac Karaman , Daniela Rus

Reliable mathematical and scientific reasoning remains an open challenge for large vision-language models. Standard final-answer evaluation often masks reasoning errors, allowing silent failures to persist. To address this gap, we introduce…

Artificial Intelligence · Computer Science 2025-12-15 Shima Imani , Seungwhan Moon , Lambert Mathias , Lu Zhang , Babak Damavandi

Partial perception deficits can compromise autonomous vehicle safety by disrupting environmental understanding. Existing protocols typically default to entirely risk-avoidant actions such as immediate stops, which are detrimental to…

Robotics · Computer Science 2025-12-15 Yuting Hu , Chenhui Xu , Ruiyang Qin , Dancheng Liu , Amir Nassereldine , Yiyu Shi , Jinjun Xiong