English
Related papers

Related papers: UniManip: General-Purpose Zero-Shot Robotic Manipu…

200 papers

Vision-Language-Action (VLA) models have recently emerged, demonstrating strong generalization in robotic scene understanding and manipulation. However, when confronted with long-horizon tasks that require defined goal states, such as LEGO…

Deploying autonomous robots that can learn new skills from demonstrations is an important challenge of modern robotics. Existing solutions often apply end-to-end imitation learning with Vision-Language Action (VLA) models or symbolic…

Robotics · Computer Science 2025-11-07 Maëlic Neau , Zoe Falomir , Paulo E. Santos , Anne-Gwenn Bosser , Cédric Buche

While specialized AI models excel at isolated video tasks like generation or understanding, real-world applications demand complex, iterative workflows that combine these capabilities. To bridge this gap, we introduce UniVA, an open-source,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-12 Zhengyang Liang , Daoan Zhang , Huichi Zhou , Rui Huang , Bobo Li , Yuechen Zhang , Shengqiong Wu , Xiaohan Wang , Jiebo Luo , Lizi Liao , Hao Fei

Unified multimodal models provide a natural and promising architecture for understanding diverse and complex real-world knowledge while generating high-quality images. However, they still rely primarily on frozen parametric knowledge, which…

We investigate multi-agent navigation tasks, where multiple agents need to reach initially unassigned goals in a limited time. Classical planning-based methods suffer from expensive computation overhead at each step and offer limited…

Machine Learning · Computer Science 2024-12-03 Xinyi Yang , Xinting Yang , Chao Yu , Jiayu Chen , Wenbo Ding , Huazhong Yang , Yu Wang

In embodied intelligence, the embodiment gap between robotic and human hands brings significant challenges for learning from human demonstrations. Although some studies have attempted to bridge this gap using reinforcement learning, they…

Garment manipulation (e.g., unfolding, folding and hanging clothes) is essential for future robots to accomplish home-assistant tasks, while highly challenging due to the diversity of garment configurations, geometries and deformations.…

Computer Vision and Pattern Recognition · Computer Science 2024-05-14 Ruihai Wu , Haoran Lu , Yiyan Wang , Yubo Wang , Hao Dong

To achieve a successful grasp, gripper attributes such as its geometry and kinematics play a role as important as the object geometry. The majority of previous work has focused on developing grasp methods that generalize over novel object…

Robotic manipulation systems that follow language instructions often execute grasp primitives in a largely single-shot manner: a model proposes an action, the robot executes it, and failures such as empty grasps, slips, stalls, timeouts, or…

Robotics · Computer Science 2026-04-10 Wenze Wang , Mehdi Hosseinzadeh , Feras Dayoub

Traditional AI-planning methods for task planning in robotics require a symbolically encoded domain description. While powerful in well-defined scenarios, as well as human-interpretable, setting this up requires substantial effort.…

Robotics · Computer Science 2025-02-21 Shijia Li , Tomas Kulvicius , Minija Tamosiunaite , Florentin Wörgötter

Autonomous agents powered by large language models (LLMs) have shown impressive capabilities in tool manipulation for complex task-solving. However, existing paradigms such as ReAct rely on sequential reasoning and execution, failing to…

Artificial Intelligence · Computer Science 2025-10-30 Jiaqi Wu , Qinlao Zhao , Zefeng Chen , Kai Qin , Yifei Zhao , Xueqian Wang , Yuhang Yao

Large Language Models (LLMs) have demonstrated remarkable planning abilities across various domains, including robotics manipulation and navigation. While recent efforts in robotics have leveraged LLMs both for high-level and low-level…

Robotics · Computer Science 2025-08-26 Harsh Singh , Rocktim Jyoti Das , Mingfei Han , Preslav Nakov , Ivan Laptev

Developing general-purpose navigation policies for unknown environments remains a core challenge in robotics. Most existing systems rely on task-specific neural networks and fixed information flows, limiting their generalizability. Large…

A long-standing objective in humanoid robotics is the realization of versatile agents capable of following diverse multimodal instructions with human-level flexibility. Despite advances in humanoid control, bridging high-level multimodal…

Computer Vision and Pattern Recognition · Computer Science 2026-01-01 Nan Jiang , Zimo He , Wanhe Yu , Lexi Pang , Yunhao Li , Hongjie Li , Jieming Cui , Yuhan Li , Yizhou Wang , Yixin Zhu , Siyuan Huang

Building general-purpose embodied agents across diverse hardware remains a central challenge in robotics, often framed as the ''one-brain, many-forms'' paradigm. Progress is hindered by fragmented data, inconsistent representations, and…

Computer Vision and Pattern Recognition · Computer Science 2026-04-15 Yandan Yang , Shuang Zeng , Tong Lin , Xinyuan Chang , Dekang Qi , Junjin Xiao , Haoyun Liu , Ronghan Chen , Yuzhi Chen , Dongjie Huo , Feng Xiong , Xing Wei , Zhiheng Ma , Mu Xu

In the realm of future home-assistant robots, 3D articulated object manipulation is essential for enabling robots to interact with their environment. Many existing studies make use of 3D point clouds as the primary input for manipulation…

Robotics · Computer Science 2023-10-16 Xiaoqi Li , Yanzi Wang , Yan Shen , Ponomarenko Iaroslav , Haoran Lu , Qianxu Wang , Boshi An , Jiaming Liu , Hao Dong

LLM-based agentic systems are rapidly evolving to perform complex autonomous tasks through dynamic tool invocation, stateful memory management, and multi-agent collaboration. However, this semantics-driven execution paradigm creates a…

Artificial Intelligence · Computer Science 2026-05-11 Chaofan Li , Lyuye Zhang , Jintao Zhai , Siyue Feng , Xichun Yang , Huahao Wang , Shihan Dou , Yu Ji , Yutao Hu , Yueming Wu , Yang Liu , Deqing Zou

This paper presents a framework that leverages pre-trained foundation models for robotic manipulation without domain-specific training. The framework integrates off-the-shelf models, combining multimodal perception from foundation models…

Robotics · Computer Science 2025-11-03 Sushil Samuel Dinesh , Shinkyu Park

We introduce Wonderful Team, a multi-agent Vision Large Language Model (VLLM) framework for executing high-level robotic planning in a zero-shot regime. In our context, zero-shot high-level planning means that for a novel environment, we…

Artificial Intelligence · Computer Science 2025-02-05 Zidan Wang , Rui Shen , Bradly Stadie

Vision-Language-Action (VLA) models and world models have recently emerged as promising paradigms for general-purpose robotic intelligence, yet their progress is hindered by the lack of reliable evaluation protocols that reflect real-world…