English
Related papers

Related papers: Structured Task Solving via Modular Embodied Intel…

200 papers

Existing combinatorial search methods are often complex and require some level of expertise. This work introduces a simple and efficient deep learning method for solving combinatorial problems with a predefined goal, represented by Rubik's…

Machine Learning · Computer Science 2023-05-24 Kyo Takano

In order to flexibly act in an everyday environment, a robotic agent needs a variety of cognitive capabilities that enable it to reason about plans and perform execution recovery. Large language models (LLMs) have been shown to demonstrate…

Robotics · Computer Science 2026-03-04 Shinas Shaji , Fabian Huppertz , Alex Mitrevski , Sebastian Houben

The theoretical ability of modular robots to reconfigure in response to complex tasks in a priori unknown environments has frequently been cited as an advantage and remains a major motivator for work in the field. We present a modular robot…

Robotics · Computer Science 2018-12-14 Jonathan Daudelin , Gangyuan Jing , Tarik Tosun , Mark Yim , Hadas Kress-Gazit , Mark Campbell

We introduce an interactive LLM-based framework designed to enhance the autonomy and robustness of domestic robots, targeting embodied intelligence. Our approach reduces reliance on large-scale data and incorporates a robot-agnostic…

Robotics · Computer Science 2026-01-27 Kim Tien Ly , Kai Lu , Ioannis Havoutis

Spatial intelligence spans a rich suite of abilities, including visualising and transforming shapes, mentally rotating objects, judging relational positions and containment, and estimating numerosity. However, it still remains a critical…

Computer Vision and Pattern Recognition · Computer Science 2025-11-20 Shijie Lian , Changti Wu , Laurence Tianruo Yang , Hang Yuan , Bin Yu , Lei Zhang , Kai Chen

Standard Chain-of-Thought (CoT) prompting empowers Large Language Models (LLMs) with reasoning capabilities, yet its reliance on linear natural language is inherently insufficient for effective world modeling in embodied tasks. While text…

Artificial Intelligence · Computer Science 2026-04-14 Hongyu Chen , Liang Lin , Guangrun Wang

Spatial cognition enables adaptive goal-directed behavior by constructing internal models of space. Robust biological systems consolidate spatial knowledge into three interconnected forms: \textit{landmarks} for salient cues, \textit{route…

Artificial Intelligence · Computer Science 2025-08-26 Shouwei Ruan , Liyuan Wang , Caixin Kang , Qihui Zhu , Songming Liu , Xingxing Wei , Hang Su

This technical report presents our solution for the RoboSense Challenge at IROS 2025, which evaluates Vision-Language Models (VLMs) on autonomous driving scene understanding across perception, prediction, planning, and corruption detection…

Computer Vision and Pattern Recognition · Computer Science 2025-10-29 Aodi Wu , Xubo Luo

Foundation models, including large language models (LLMs) and vision-language models (VLMs), have recently enabled novel approaches to robot autonomy and human-robot interfaces. In parallel, vision-language-action models (VLAs) or large…

Solving complex, long-horizon robotic manipulation tasks requires a deep understanding of physical interactions, reasoning about their long-term consequences, and precise high-level planning. Vision-Language Models (VLMs) offer a general…

Robotics · Computer Science 2026-02-24 Yanting Yang , Shenyuan Gao , Qingwen Bu , Li Chen , Dimitris N. Metaxas

Dual-arm robots have great application prospects in intelligent manufacturing due to their human-like structure when deployed with advanced intelligence algorithm. However, the previous visuomotor policy suffers from perception deficiencies…

Robotics · Computer Science 2024-04-30 Jian Shen , Jiaxin Huang , Zhigong Song

Recent advances in multimodal large language models (LLMs) have shown extreme effectiveness in visual question answering (VQA). However, the design nature of these end-to-end models prevents them from being interpretable to humans,…

Computation and Language · Computer Science 2024-04-16 Xingyu Fu , Ben Zhou , Sihao Chen , Mark Yatskar , Dan Roth

Autonomous robots operating in dynamic environments should identify and report anomalies. Embodying proactive mitigation improves safety and operational continuity. This paper presents a multimodal anomaly detection and mitigation system…

Robotics · Computer Science 2025-09-09 Oluwadamilola Sotomi , Devika Kodi , Kiruthiga Chandra Shekar , Aliasghar Arab

Vision-language-action (VLA) models have achieved great success on general robotic tasks, but still face challenges in fine-grained spatiotemporal manipulation. Typically, existing methods mainly embed spatiotemporal knowledge into visual…

Robotics · Computer Science 2026-04-21 Chuanhao Ma , Hanyu Zhou , Shihan Peng , Yan Li , Tao Gu , Luxin Yan

Large language models (LLMs) have emerged as the dominant paradigm for robotic task planning using natural language instructions. However, trained on general internet data, LLMs are not inherently aligned with the embodiment, skill sets,…

Robot manipulation relies on accurately predicting contact points and end-effector directions to ensure successful operation. However, learning-based robot manipulation, trained on a limited category within a simulator, often struggles to…

Computer Vision and Pattern Recognition · Computer Science 2023-12-29 Xiaoqi Li , Mingxu Zhang , Yiran Geng , Haoran Geng , Yuxing Long , Yan Shen , Renrui Zhang , Jiaming Liu , Hao Dong

In complex embodied long-horizon manipulation tasks, effective task decomposition and execution require synergistic integration of textual logical reasoning and visual-spatial imagination to ensure efficient and accurate operation. Current…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Xinyan Cai , Shiguang Wu , Dafeng Chi , Yuzheng Zhuang , Xingyue Quan , Jianye Hao , Qiang Guan

Humanoid robots with behavioral autonomy have consistently been regarded as ideal collaborators in our daily lives and promising representations of embodied intelligence. Compared to fixed-based robotic arms, humanoid robots offer a larger…

Robotics · Computer Science 2024-09-04 Jin Wang , Nikos Tsagarakis

The potential of Vision-Language Models (VLMs) often remains underutilized in handling complex text-based problems, particularly when these problems could benefit from visual representation. Resonating with humans' ability to solve complex…

Artificial Intelligence · Computer Science 2024-02-23 Syeda Nahida Akter , Aman Madaan , Sangwu Lee , Yiming Yang , Eric Nyberg

Chain-of-Thought (CoT) prompting improves reasoning in large language models (LLMs), but its reliance on unstructured text limits interpretability and executability in embodied tasks. Prior work has explored structured CoTs using scene or…

Computer Vision and Pattern Recognition · Computer Science 2025-10-01 Hongyu Chen , Guangrun Wang