English
Related papers

Related papers: RoboMIND 2.0: A Multimodal, Bimanual Mobile Manipu…

200 papers

Generalizable manipulation skills, which can be composed to tackle long-horizon and complex daily chores, are one of the cornerstones of Embodied AI. However, existing benchmarks, mostly composed of a suite of simulatable environments, are…

In recent years, we have seen an emergence of data-driven approaches in robotics. However, most existing efforts and datasets are either in simulation or focus on a single task in isolation such as grasping, pushing or poking. In order to…

Robotics · Computer Science 2018-10-17 Pratyusha Sharma , Lekha Mohan , Lerrel Pinto , Abhinav Gupta

Bimanual manipulation with tactile feedback will be key to human-level robot dexterity. However, this topic is less explored than single-arm settings, partly due to the availability of suitable hardware along with the complexity of…

Robotics · Computer Science 2023-07-14 Yijiong Lin , Alex Church , Max Yang , Haoran Li , John Lloyd , Dandan Zhang , Nathan F. Lepora

We introduce BridgeData V2, a large and diverse dataset of robotic manipulation behaviors designed to facilitate research on scalable robot learning. BridgeData V2 contains 60,096 trajectories collected across 24 environments on a publicly…

Enabling physics-based humanoids to execute diverse behaviors from high-level textual commands remains a significant challenge. Existing methods typically follow either a two-stage paradigm that combines kinematic motion generation with…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Bin Li , Ruichi Zhang , Han Liang , Jingyan Zhang , Juze Zhang , Xin Chen , Jingya Wang

Humanoid robots are designed to perform diverse loco-manipulation tasks. However, they face challenges due to their high-dimensional and unstable dynamics, as well as the complex contact-rich nature of the tasks. Model-based optimal control…

Robotics · Computer Science 2025-10-02 Fukang Liu , Zhaoyuan Gu , Yilin Cai , Ziyi Zhou , Hyunyoung Jung , Jaehwi Jang , Shijie Zhao , Sehoon Ha , Yue Chen , Danfei Xu , Ye Zhao

We present a deep imitation learning framework for robotic bimanual manipulation in a continuous state-action space. A core challenge is to generalize the manipulation skills to objects in different locations. We hypothesize that modeling…

Recent advances in robotics have been largely driven by imitation learning, which depends critically on large-scale, high-quality demonstration data. However, collecting such data remains a significant challenge-particularly for mobile…

Robotics · Computer Science 2025-10-07 Yilin Mei , Peng Qiu , Wei Zhang , WenChao Zhang , Wenjie Song

Advances in large vision-language models (VLMs) have stimulated growing interest in vision-language-action (VLA) systems for robot manipulation. However, existing manipulation datasets remain costly to curate, highly embodiment-specific,…

Robotics · Computer Science 2026-02-11 Hao Li , Ziqin Wang , Zi-han Ding , Shuai Yang , Yilun Chen , Yang Tian , Xiaolin Hu , Tai Wang , Dahua Lin , Feng Zhao , Si Liu , Jiangmiao Pang

Learning motor control for muscle-driven musculoskeletal models is hindered by the computational cost of biomechanically accurate simulation and the scarcity of validated, open full-body models. Here we present MuscleMimic, an open-source…

Embodied intelligence seamlessly integrates vision, language, and action.~However, most multimodal robotic models rely on massive fine-tuning, incurring high time and hardware costs.~To address this, we introduce RoboBERT, an end-to-end…

Robotics · Computer Science 2025-05-02 Sicheng Wang , Sheng Liu , Weiheng Wang , Jianhua Shan , Bin Fang

Embodied intelligence has advanced rapidly in recent years; however, bimanual manipulation-especially in contact-rich tasks remains challenging. This is largely due to the lack of datasets with rich physical interaction signals, systematic…

Robotics · Computer Science 2026-04-23 Qianxi Hua , Xinyue Li , Zheng Yan , Yang Li , Chi Zhang , Yongyao Li , Yufei Liu

Human hands play a central role in interacting, motivating increasing research in dexterous robotic manipulation. Data-driven embodied AI algorithms demand precise, large-scale, human-like manipulation sequences, which are challenging to…

Robotics · Computer Science 2025-03-31 Kailin Li , Puhao Li , Tengyu Liu , Yuyang Li , Siyuan Huang

Embodied intelligence aims to enable robots to learn, reason, and generalize robustly across complex real-world environments. However, existing approaches often struggle with partial observability, fragmented spatial reasoning, and…

Optimizing and refining action execution through exploration and interaction is a promising way for robotic manipulation. However, practical approaches to interaction-driven robotic learning are still underexplored, particularly for…

Robotics · Computer Science 2025-09-24 Yibo Peng , Jiahao Yang , Shenhao Yan , Ziyu Huang , Shuang Li , Shuguang Cui , Yiming Zhao , Yatong Han

Large-scale data has driven breakthroughs in robotics, from language models to vision-language-action models in bimanual manipulation. However, humanoid robotics lacks equally effective data collection frameworks. Existing humanoid…

As artificial intelligence (AI) rapidly advances, especially in multimodal large language models (MLLMs), research focus is shifting from single-modality text processing to the more complex domains of multimodal and embodied AI. Embodied…

Deep reinforcement learning models are notoriously data hungry, yet real-world data is expensive and time consuming to obtain. The solution that many have turned to is to use simulation for training before deploying the robot in a real…

Robotics · Computer Science 2021-03-01 Joanne Truong , Sonia Chernova , Dhruv Batra

Vision-Language Models (VLMs) acquire real-world knowledge and general reasoning ability through Internet-scale image-text corpora. They can augment robotic systems with scene understanding and task planning, and assist visuomotor policies…

Robotics · Computer Science 2025-06-23 Kaiyuan Chen , Shuangyu Xie , Zehan Ma , Pannag R Sanketi , Ken Goldberg

Instructing a robot to complete an everyday task within our homes has been a long-standing challenge for robotics. While recent progress in language-conditioned imitation learning and offline reinforcement learning has demonstrated…

Robotics · Computer Science 2024-07-03 Federico Ceola , Lorenzo Natale , Niko Sünderhauf , Krishan Rana