English
Related papers

Related papers: AD-H: Language-guided Autonomous Driving with Hier…

200 papers

Effective planning in the real world requires not only world knowledge, but the ability to leverage that knowledge to build the right representation of the task at hand. Decades of hierarchical planning techniques have used domain-specific…

Artificial Intelligence · Computer Science 2023-12-15 Lionel Wong , Jiayuan Mao , Pratyusha Sharma , Zachary S. Siegel , Jiahai Feng , Noa Korneev , Joshua B. Tenenbaum , Jacob Andreas

Large Language Models (LLMs) have recently empowered agentic frameworks to exhibit advanced reasoning and planning capabilities. However, their integration in robotic control pipelines remains limited in two aspects: (1) prior…

Large language models (LLMs) have fueled many intelligent web agents, but most existing ones perform far from satisfying in real-world web navigation tasks due to three factors: (1) the complexity of HTML text data (2) versatility of…

Computation and Language · Computer Science 2024-10-15 Hanyu Lai , Xiao Liu , Iat Long Iong , Shuntian Yao , Yuxuan Chen , Pengbo Shen , Hao Yu , Hanchen Zhang , Xiaohan Zhang , Yuxiao Dong , Jie Tang

Large Language Models (LLMs) have advanced the field of Combinatorial Optimization through automated heuristic generation. Instead of relying on manual design, this LLM-Driven Heuristic Design (LHD) process leverages LLMs to iteratively…

Machine Learning · Computer Science 2026-04-17 Rongzheng Wang , Yihong Huang , Muquan Li , Jiakai Li , Di Liang , Bob Simons , Pei Ke , Shuang Liang , Ke Qin

Reinforcement learning has been successful in many tasks ranging from robotic control, games, energy management etc. In complex real world environments with sparse rewards and long task horizons, sample efficiency is still a major…

Artificial Intelligence · Computer Science 2021-10-12 Bharat Prakash , Nicholas Waytowich , Tim Oates , Tinoosh Mohsenin

Large language models (LLMs) can translate natural language instructions into executable action plans for robotics, autonomous driving, and other domains. Yet, deploying LLM-driven planning in the physical world demands strict adherence to…

Robotics · Computer Science 2026-05-27 Yunhao Yang , Junyuan Hong , Gabriel Jacob Perin , Zhiwen Fan , Li Yin , Zhangyang Wang , Ufuk Topcu

Autonomous driving technology, a catalyst for revolutionizing transportation and urban mobility, has the tend to transition from rule-based systems to data-driven strategies. Traditional module-based systems are constrained by cumulative…

Artificial Intelligence · Computer Science 2024-08-13 Zhenjie Yang , Xiaosong Jia , Hongyang Li , Junchi Yan

In high-conflict mixed-traffic scenarios involving human-driven and autonomous vehicles, most existing autonomous driving systems default to overly conservative behaviors, lack proactive interaction, and consequently suffer from limited…

Robotics · Computer Science 2026-04-28 Xinwei Dong , Jiyang Li , Jiabin Xie , Yang Yi , Tianshang Jia , Shiyu Fang , Ye Tian , Peng Hang

Large Language Models (LLMs) have revolutionized Natural Language Processing but exhibit limitations, particularly in autonomously addressing novel challenges such as reasoning and problem-solving. Traditional techniques like…

Multiagent Systems · Computer Science 2024-01-03 Sumedh Rasal

Recent advances have explored integrating large language models (LLMs) into end-to-end autonomous driving systems to enhance generalization and interpretability. However, most existing approaches are limited to either driving performance or…

Computer Vision and Pattern Recognition · Computer Science 2025-05-22 Yunsheng Ma , Burhaneddin Yaman , Xin Ye , Mahmut Yurt , Jingru Luo , Abhirup Mallik , Ziran Wang , Liu Ren

Despite significant recent progress in the field of autonomous driving, modern methods still struggle and can incur serious accidents when encountering long-tail unforeseen events and challenging urban scenarios. On the one hand, large…

Computer Vision and Pattern Recognition · Computer Science 2023-12-22 Hao Shao , Yuxuan Hu , Letian Wang , Steven L. Waslander , Yu Liu , Hongsheng Li

Powerful large language models (LLMs) from different providers have been expensively trained and finetuned to specialize across varying domains. In this work, we introduce a new kind of Conductor model trained with reinforcement learning to…

Machine Learning · Computer Science 2026-05-07 Stefan Nielsen , Edoardo Cetin , Peter Schwendeman , Qi Sun , Jinglue Xu , Yujin Tang

Large language models (LLMs) have demonstrated notable potential in medical applications, yet they face substantial challenges in handling complex real-world clinical diagnoses using conventional prompting methods. Current prompt…

Artificial Intelligence · Computer Science 2026-03-02 Wenliang Li , Rui Yan , Xu Zhang , Li Chen , Hongji Zhu , Jing Zhao , Junjun Li , Mengru Li , Wei Cao , Zihang Jiang , Wei Wei , Kun Zhang , Shaohua Kevin Zhou

Large Language Models (LLMs) have garnered significant attention for their ability to understand text and images, generate human-like text, and perform complex reasoning tasks. However, their ability to generalize this advanced reasoning…

Computer Vision and Pattern Recognition · Computer Science 2025-02-04 Mehdi Azarafza , Mojtaba Nayyeri , Charles Steinmetz , Steffen Staab , Achim Rettberg

Large Language Models (LLMs) have showcased remarkable proficiency in various information-processing tasks. These tasks span from extracting data and summarizing literature to generating content, predictive modeling, decision-making, and…

Systems and Control · Electrical Eng. & Systems 2024-09-17 Sonda Fourati , Wael Jaafar , Noura Baccar , Safwan Alfattani

To enable non-experts to specify long-horizon, multi-robot collaborative tasks, language models are increasingly used to translate natural language commands into formal specifications. However, because translation can occur in multiple…

Robotics · Computer Science 2024-12-06 Shaojun Xu , Xusheng Luo , Yutong Huang , Letian Leng , Ruixuan Liu , Changliu Liu

This paper introduces MeLA, a Metacognitive LLM-Driven Architecture that presents a new paradigm for Automatic Heuristic Design (AHD). Traditional evolutionary methods operate directly on heuristic code; in contrast, MeLA evolves the…

Artificial Intelligence · Computer Science 2025-09-08 Zishang Qiu , Xinan Chen , Long Chen , Ruibin Bai

Existing benchmarks for Large Language Model (LLM) agents focus on task completion under idealistic settings but overlook reliability in real-world, user-facing applications. In domains, such as in-car voice assistants, users often issue…

Artificial Intelligence · Computer Science 2026-01-30 Johannes Kirmayr , Lukas Stappen , Elisabeth André

While Vision-Language Models (VLMs) enable high-level semantic reasoning for end-to-end autonomous driving, particularly in unstructured environments, existing off-road datasets suffer from language annotations that are weakly aligned with…

Robotics · Computer Science 2026-04-24 Byounggun Park , Soonmin Hwang

With rapid advances in code generation, reasoning, and problem-solving, Large Language Models (LLMs) are increasingly applied in robotics. Most existing work focuses on high-level tasks such as task decomposition. A few studies have…

Robotics · Computer Science 2025-07-29 Zhongchao Zhou , Yuxi Lu , Yaonan Zhu , Yifan Zhao , Bin He , Liang He , Wenwen Yu , Yusuke Iwasawa