English
Related papers

Related papers: ET-Plan-Bench: Embodied Task-level Planning Benchm…

200 papers

Generating plans of action, and reasoning about change have long been considered a core competence of intelligent agents. It is thus no surprise that evaluating the planning and reasoning capabilities of large language models (LLMs) has…

Computation and Language · Computer Science 2023-11-28 Karthik Valmeekam , Matthew Marquez , Alberto Olmo , Sarath Sreedharan , Subbarao Kambhampati

Embodied scene understanding serves as the cornerstone for autonomous agents to perceive, interpret, and respond to open driving scenarios. Such understanding is typically founded upon Vision-Language Models (VLMs). Nevertheless, existing…

Computer Vision and Pattern Recognition · Computer Science 2024-03-08 Yunsong Zhou , Linyan Huang , Qingwen Bu , Jia Zeng , Tianyu Li , Hang Qiu , Hongzi Zhu , Minyi Guo , Yu Qiao , Hongyang Li

Embodied multimodal large models (EMLMs) have gained significant attention in recent years due to their potential to bridge the gap between perception, cognition, and action in complex, real-world environments. This comprehensive review…

Robotics · Computer Science 2025-02-24 Shoubin Chen , Zehao Wu , Kai Zhang , Chunyu Li , Baiyang Zhang , Fei Ma , Fei Richard Yu , Qingquan Li

Performing complex manipulation tasks in dynamic environments requires efficient Task and Motion Planning (TAMP) approaches that combine high-level symbolic plans with low-level motion control. Advances in Large Language Models (LLMs), such…

Robotics · Computer Science 2025-10-02 Muhayy Ud Din , Jan Rosell , Waseem Akram , Isiah Zaplana , Maximo A Roa , Irfan Hussain

With the development and widespread application of large language models (LLMs), the new paradigm of "Model as Product" is rapidly evolving, and demands higher capabilities to address complex user needs, often requiring precise workflow…

Computation and Language · Computer Science 2025-09-17 Tao Zou , Xinghua Zhang , Haiyang Yu , Minzheng Wang , Fei Huang , Yongbin Li

World models have emerged as a pivotal component in robot manipulation planning, enabling agents to predict future environmental states and reason about the consequences of actions before execution. While video-generation models are…

Robotics · Computer Science 2025-12-10 Wenjiang Xu , Cindy Wang , Rui Fang , Mingkang Zhang , Lusong Li , Jing Xu , Jiayuan Gu , Zecui Zeng , Rui Chen

It is unclear whether strong forecasting performance reflects genuine temporal understanding or the ability to reason under contextual and event-driven conditions. We introduce TemporalBench, a multi-domain benchmark designed to evaluate…

Artificial Intelligence · Computer Science 2026-02-17 Muyan Weng , Defu Cao , Wei Yang , Yashaswi Sharma , Yan Liu

In many-task optimization scenarios, surrogate models are valuable for mitigating the computational burden of repeated fitness evaluations across tasks. This study proposes a novel meta-surrogate framework to assist many-task optimization,…

Machine Learning · Computer Science 2026-02-05 Xian-Rong Zhang , Yue-Jiao Gong , Yuan-Ting Zhong , Ting Huang , Jun Zhang

Large Language Models (LLMs) present a promising frontier in robotic task planning by leveraging extensive human knowledge. Nevertheless, the current literature often overlooks the critical aspects of robots' adaptability and error…

Robotics · Computer Science 2024-11-27 Sthithpragya Gupta , Kunpeng Yao , Loïc Niederhauser , Aude Billard

In this work, we introduce SMART-LLM, an innovative framework designed for embodied multi-robot task planning. SMART-LLM: Smart Multi-Agent Robot Task Planning using Large Language Models (LLMs), harnesses the power of LLMs to convert…

Robotics · Computer Science 2024-03-26 Shyam Sundar Kannan , Vishnunandan L. N. Venkatesh , Byung-Cheol Min

Embodied agents face significant challenges when tasked with performing actions in diverse environments, particularly in generalizing across object types and executing suitable actions to accomplish tasks. Furthermore, agents should exhibit…

Artificial Intelligence · Computer Science 2023-06-05 Xiaotian Liu , Hector Palacios , Christian Muise

Large multimodal models exhibit remarkable intelligence, yet their embodied cognitive abilities during motion in open-ended urban 3D space remain to be explored. We introduce a benchmark to evaluate whether video-large language models…

Computer Vision and Pattern Recognition · Computer Science 2025-12-29 Baining Zhao , Jianjie Fang , Zichao Dai , Ziyou Wang , Jirong Zha , Weichen Zhang , Chen Gao , Yue Wang , Jinqiang Cui , Xinlei Chen , Yong Li

Recent progress in embodied AI has produced a growing ecosystem of robot policies, foundation models, and modular runtimes. However, current evaluation remains dominated by task success metrics such as completion rate or manipulation…

Robotics · Computer Science 2026-04-14 Xue Qin , Simin Luan , John See , Cong Yang , Zhijun Li

Large Language Models (LLM) have emerged as a tool for robots to generate task plans using common sense reasoning. For the LLM to generate actionable plans, scene context must be provided, often through a map. Recent works have shifted from…

Robotics · Computer Science 2024-09-25 Mike Zhang , Kaixian Qu , Vaishakh Patil , Cesar Cadena , Marco Hutter

Large Language Models (LLMs) are increasingly excelling and outpacing human performance on many tasks. However, to improve LLM reasoning, researchers either rely on ad-hoc generated datasets or formal mathematical proof systems such as the…

Artificial Intelligence · Computer Science 2025-11-03 Nikolaus Holzer , William Fishell , Baishakhi Ray , Mark Santolucito

Intelligent systems powered by large-scale sensor networks are shifting from predefined monitoring to intent-driven operation, revealing a critical Semantic-to-Physical Mapping Gap. While large language models (LLMs) excel at semantic…

Artificial Intelligence · Computer Science 2026-04-10 Zhaomeng Zhou , Lan Zhang , Junyang Wang , Mu Yuan , Junda Lin , Jinke Song

Language-guided robots performing home and office tasks must navigate in and interact with the world. Grounding language instructions against visual observations and actions to take in an environment is an open challenge. We present…

Computer Vision and Pattern Recognition · Computer Science 2021-11-05 Alessandro Suglia , Qiaozi Gao , Jesse Thomason , Govind Thattai , Gaurav Sukhatme

Traditional text embedding benchmarks primarily evaluate embedding models' capabilities to capture semantic similarity. However, more advanced NLP tasks require a deeper understanding of text, such as safety and factuality. These tasks…

Computation and Language · Computer Science 2025-03-05 Simeng Han , Frank Palma Gomez , Tu Vu , Zefei Li , Daniel Cer , Hansi Zeng , Chris Tar , Arman Cohan , Gustavo Hernandez Abrego

Planning is a fundamental capability for large language models (LLMs) because such complex tasks require models to coordinate goals, constraints, resources, and long-term consequences into executable and verifiable solutions. Existing…

Artificial Intelligence · Computer Science 2026-05-21 Ziliang Zhao , Zenan Xu , Shuting Wang , Hongjin Qian , Yan Lei , Minda Hu , Zhao Wang , Shihan Dou , Zhicheng Dou , Pluto Zhou

As Multimodal Large Language Models (MLLMs) advance, multimodal agents show promise in real-world tasks like web navigation and embodied intelligence. However, due to limitations in a lack of external feedback, these agents struggle with…

Computation and Language · Computer Science 2025-06-27 Tianyi Men , Zhuoran Jin , Pengfei Cao , Yubo Chen , Kang Liu , Jun Zhao
‹ Prev 1 4 5 6 7 8 10 Next ›