中文
相关论文

相关论文: Structured Task Solving via Modular Embodied Intel…

200 篇论文

Existing combinatorial search methods are often complex and require some level of expertise. This work introduces a simple and efficient deep learning method for solving combinatorial problems with a predefined goal, represented by Rubik's…

机器学习 · 计算机科学 2023-05-24 Kyo Takano

In order to flexibly act in an everyday environment, a robotic agent needs a variety of cognitive capabilities that enable it to reason about plans and perform execution recovery. Large language models (LLMs) have been shown to demonstrate…

机器人学 · 计算机科学 2026-03-04 Shinas Shaji , Fabian Huppertz , Alex Mitrevski , Sebastian Houben

The theoretical ability of modular robots to reconfigure in response to complex tasks in a priori unknown environments has frequently been cited as an advantage and remains a major motivator for work in the field. We present a modular robot…

机器人学 · 计算机科学 2018-12-14 Jonathan Daudelin , Gangyuan Jing , Tarik Tosun , Mark Yim , Hadas Kress-Gazit , Mark Campbell

We introduce an interactive LLM-based framework designed to enhance the autonomy and robustness of domestic robots, targeting embodied intelligence. Our approach reduces reliance on large-scale data and incorporates a robot-agnostic…

机器人学 · 计算机科学 2026-01-27 Kim Tien Ly , Kai Lu , Ioannis Havoutis

Spatial intelligence spans a rich suite of abilities, including visualising and transforming shapes, mentally rotating objects, judging relational positions and containment, and estimating numerosity. However, it still remains a critical…

计算机视觉与模式识别 · 计算机科学 2025-11-20 Shijie Lian , Changti Wu , Laurence Tianruo Yang , Hang Yuan , Bin Yu , Lei Zhang , Kai Chen

Standard Chain-of-Thought (CoT) prompting empowers Large Language Models (LLMs) with reasoning capabilities, yet its reliance on linear natural language is inherently insufficient for effective world modeling in embodied tasks. While text…

人工智能 · 计算机科学 2026-04-14 Hongyu Chen , Liang Lin , Guangrun Wang

Spatial cognition enables adaptive goal-directed behavior by constructing internal models of space. Robust biological systems consolidate spatial knowledge into three interconnected forms: \textit{landmarks} for salient cues, \textit{route…

人工智能 · 计算机科学 2025-08-26 Shouwei Ruan , Liyuan Wang , Caixin Kang , Qihui Zhu , Songming Liu , Xingxing Wei , Hang Su

This technical report presents our solution for the RoboSense Challenge at IROS 2025, which evaluates Vision-Language Models (VLMs) on autonomous driving scene understanding across perception, prediction, planning, and corruption detection…

计算机视觉与模式识别 · 计算机科学 2025-10-29 Aodi Wu , Xubo Luo

Foundation models, including large language models (LLMs) and vision-language models (VLMs), have recently enabled novel approaches to robot autonomy and human-robot interfaces. In parallel, vision-language-action models (VLAs) or large…

Solving complex, long-horizon robotic manipulation tasks requires a deep understanding of physical interactions, reasoning about their long-term consequences, and precise high-level planning. Vision-Language Models (VLMs) offer a general…

机器人学 · 计算机科学 2026-02-24 Yanting Yang , Shenyuan Gao , Qingwen Bu , Li Chen , Dimitris N. Metaxas

Dual-arm robots have great application prospects in intelligent manufacturing due to their human-like structure when deployed with advanced intelligence algorithm. However, the previous visuomotor policy suffers from perception deficiencies…

机器人学 · 计算机科学 2024-04-30 Jian Shen , Jiaxin Huang , Zhigong Song

Recent advances in multimodal large language models (LLMs) have shown extreme effectiveness in visual question answering (VQA). However, the design nature of these end-to-end models prevents them from being interpretable to humans,…

计算与语言 · 计算机科学 2024-04-16 Xingyu Fu , Ben Zhou , Sihao Chen , Mark Yatskar , Dan Roth

Autonomous robots operating in dynamic environments should identify and report anomalies. Embodying proactive mitigation improves safety and operational continuity. This paper presents a multimodal anomaly detection and mitigation system…

机器人学 · 计算机科学 2025-09-09 Oluwadamilola Sotomi , Devika Kodi , Kiruthiga Chandra Shekar , Aliasghar Arab

Vision-language-action (VLA) models have achieved great success on general robotic tasks, but still face challenges in fine-grained spatiotemporal manipulation. Typically, existing methods mainly embed spatiotemporal knowledge into visual…

机器人学 · 计算机科学 2026-04-21 Chuanhao Ma , Hanyu Zhou , Shihan Peng , Yan Li , Tao Gu , Luxin Yan

Large language models (LLMs) have emerged as the dominant paradigm for robotic task planning using natural language instructions. However, trained on general internet data, LLMs are not inherently aligned with the embodiment, skill sets,…

Robot manipulation relies on accurately predicting contact points and end-effector directions to ensure successful operation. However, learning-based robot manipulation, trained on a limited category within a simulator, often struggles to…

计算机视觉与模式识别 · 计算机科学 2023-12-29 Xiaoqi Li , Mingxu Zhang , Yiran Geng , Haoran Geng , Yuxing Long , Yan Shen , Renrui Zhang , Jiaming Liu , Hao Dong

In complex embodied long-horizon manipulation tasks, effective task decomposition and execution require synergistic integration of textual logical reasoning and visual-spatial imagination to ensure efficient and accurate operation. Current…

计算机视觉与模式识别 · 计算机科学 2025-11-11 Xinyan Cai , Shiguang Wu , Dafeng Chi , Yuzheng Zhuang , Xingyue Quan , Jianye Hao , Qiang Guan

Humanoid robots with behavioral autonomy have consistently been regarded as ideal collaborators in our daily lives and promising representations of embodied intelligence. Compared to fixed-based robotic arms, humanoid robots offer a larger…

机器人学 · 计算机科学 2024-09-04 Jin Wang , Nikos Tsagarakis

The potential of Vision-Language Models (VLMs) often remains underutilized in handling complex text-based problems, particularly when these problems could benefit from visual representation. Resonating with humans' ability to solve complex…

人工智能 · 计算机科学 2024-02-23 Syeda Nahida Akter , Aman Madaan , Sangwu Lee , Yiming Yang , Eric Nyberg

Chain-of-Thought (CoT) prompting improves reasoning in large language models (LLMs), but its reliance on unstructured text limits interpretability and executability in embodied tasks. Prior work has explored structured CoTs using scene or…

计算机视觉与模式识别 · 计算机科学 2025-10-01 Hongyu Chen , Guangrun Wang