English
Related papers

Related papers: RoboEvolve: Co-Evolving Planner-Simulator for Robo…

200 papers

Enabling reliable long-horizon robotic manipulation is a crucial step toward open-world embodied intelligence. However, VLM-based planners treat each step as an isolated observation-to-action mapping, forcing them to reinfer scene geometry…

Recent vision-language-action (VLA) systems have demonstrated strong capabilities in embodied manipulation. However, most existing VLA policies rely on limited observation windows and end-to-end action prediction, which makes them brittle…

Robotics · Computer Science 2026-04-16 Zhen Liu , Xinyu Ning , Zhe Hu , Xinxin Xie , Weize Li , Zhipeng Tang , Chongyu Wang , Zejun Yang , Hanlin Wang , Yitong Liu , Zhongzhu Pu

Large language models (LLMs) have shown remarkable performance on various tasks, but existing evaluation benchmarks are often static and insufficient to fully assess their robustness and generalization in realistic scenarios. Prior work…

Computation and Language · Computer Science 2025-07-01 JiaRu Wu , Mingwei Liu

Recent advancements in Large Language Models (LLMs) and Vision-Language Models (VLMs) have made them powerful tools in embodied navigation, enabling agents to leverage commonsense and spatial reasoning for efficient exploration in…

As the complexity of System-on-Chip (SoC) designs grows, the shift-left paradigm necessitates the rapid development of high-fidelity reference models (typically written in SystemC) for early architecture exploration and verification. While…

Software Engineering · Computer Science 2026-04-28 Yifan Zhang , Jianmin Ye , Jiahao Yang , Xi Wang

Visual navigation is an essential skill for home-assistance robots, providing the object-searching ability to accomplish long-horizon daily tasks. Many recent approaches use Large Language Models (LLMs) for commonsense inference to improve…

Robotics · Computer Science 2024-10-15 Xinxin Zhao , Wenzhe Cai , Likun Tang , Teng Wang

Reusable skills play a key role in improving LLM-based agents, but existing skill-evolution methods often fail to ensure that evolved skills both cover the knowledge required by the task and remain aligned with the target task. As a result,…

Computation and Language · Computer Science 2026-05-27 Dingzirui Wang , Xuanliang Zhang , Keyan Xu , Qingfu Zhu , Wanxiang Che , Yang Deng

Robotic systems that aspire to operate in uninstrumented real-world environments must perceive the world directly via onboard sensing. Vision-based learning systems aim to eliminate the need for environment instrumentation by building an…

Robotics · Computer Science 2024-05-14 Patrick Lancaster , Nicklas Hansen , Aravind Rajeswaran , Vikash Kumar

Improving the reasoning capabilities of embodied agents is crucial for robots to complete complex human instructions in long-view manipulation tasks successfully. Despite the success of large language models and vision language models based…

Artificial Intelligence · Computer Science 2025-10-23 Jinrui Liu , Bingyan Nie , Boyu Li , Yaran Chen , Yuze Wang , Shunsen He , Haoran Li

Evolutionary algorithms serve as a powerful paradigm for tackling optimization challenges, yet their reliance on manually engineered heuristics inherently limits their adaptability across diverse landscapes. However, the transition from the…

Neural and Evolutionary Computing · Computer Science 2026-03-04 Jiaxin Gao , Yaohua Liu , Ran Cheng , Kay Chen Tan

Effective planning requires strong world models, but high-level world models that can understand and reason about actions with semantic and temporal abstraction remain largely underdeveloped. We introduce the Vision Language World Model…

Artificial Intelligence · Computer Science 2025-09-09 Delong Chen , Theo Moutakanni , Willy Chung , Yejin Bang , Ziwei Ji , Allen Bolourchi , Pascale Fung

Robot swarms offer inherent robustness and the capacity to execute complex, collaborative tasks surpassing the capabilities of single-agent systems. Co-designing these systems is critical, as marginal improvements in individual performance…

Robotics · Computer Science 2026-05-08 Andrew Wilhelm , Josie Hughes

Modularity in robotics holds great potential. In principle, modular robots can be disassembled and reassembled in different robots, and possibly perform new tasks. Nevertheless, actually exploiting modularity is yet an unsolved problem:…

Robotics · Computer Science 2022-04-14 Federico Pigozzi , Yujin Tang , Eric Medvet , David Ha

Vision Language Models (VLMs) pretrained on Internet-scale vision-language data have demonstrated the potential to transfer their knowledge to robotic learning. However, the existing paradigm encounters three critical challenges: (1)…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Haoxuan Li , Sixu Yan , Yuhan Li , Xinggang Wang

The integration of vision-language models into robotic systems constitutes a significant advancement in enabling machines to interact with their surroundings in a more intuitive manner. While VLMs offer rich multimodal reasoning, existing…

Artificial Intelligence · Computer Science 2025-03-03 Hamed Rahimi , Adil Bahaj , Mouad Abrini , Mahdi Khoramshahi , Mounir Ghogho , Mohamed Chetouani

Vision-Language-Action (VLA) models have demonstrated remarkable performance on complex tasks through imitation learning in recent robotic manipulation works. Based on large-scale and high-quality demonstration datasets, existing imitation…

Robotics · Computer Science 2026-04-13 Yuquan Xue , Guanxing Lu , Zhenyu Wu , Chuanrui Zhang , Bofang Jia , Zhengyi Gu , Ziwei Wang

Prevalent Vision-Language-Action (VLA) models are typically built upon Multimodal Large Language Models (MLLMs) and demonstrate exceptional proficiency in semantic understanding, but they inherently lack the capability to deduce physical…

We propose a new Verbal Reinforcement Learning (VRL) framework for interpretable task-level planning in mobile robotic systems operating under execution uncertainty. The framework follows a closed-loop architecture that enables iterative…

The ability to autonomously explore and resolve tasks with minimal human guidance is crucial for the self-development of embodied intelligence. Although reinforcement learning methods can largely ease human effort, it's challenging to…

Robotics · Computer Science 2024-12-19 Changxin Huang , Yanbin Chang , Junfan Lin , Junyang Liang , Runhao Zeng , Jianqiang Li

The rapid advancement of generative AI and multi-modal foundation models has shown significant potential in advancing robotic manipulation. Vision-language-action (VLA) models, in particular, have emerged as a promising approach for…

Software Engineering · Computer Science 2025-05-13 Zhijie Wang , Zhehua Zhou , Jiayang Song , Yuheng Huang , Zhan Shu , Lei Ma