English
Related papers

Related papers: ManiDP: Manipulability-Aware Diffusion Policy for …

200 papers

Contact-rich manipulation depends on applying the correct grasp forces throughout the manipulation task, especially when handling fragile or deformable objects. Most existing imitation learning approaches often treat visuotactile feedback…

Robotics · Computer Science 2025-10-16 Erik Helmut , Niklas Funk , Tim Schneider , Cristiana de Farias , Jan Peters

Intelligent surgical robots have the potential to revolutionize clinical practice by enabling more precise and automated surgical procedures. However, the automation of such robot for surgical tasks remains under-explored compared to recent…

Robotics · Computer Science 2026-03-10 Chonlam Ho , Jianshu Hu , Lei Song , Hesheng Wang , Qi Dou , Yutong Ban

We present Mixture of Discrete-time Gaussian Processes (MiDiGap), a novel approach for flexible policy representation and imitation learning in robot manipulation. MiDiGap enables learning from as few as five demonstrations using only…

Robotics · Computer Science 2025-05-07 Jan Ole von Hartz , Adrian Röfer , Joschka Boedecker , Abhinav Valada

Dynamic in air handover is a fundamental challenge for dual-arm robots, requiring accurate perception, precise coordination, and natural motion. Prior methods often rely on dynamics models, strong priors, or depth sensing, limiting…

Robotics · Computer Science 2025-09-26 Haoran Zhou , Yangwei You , Shuaijun Wang

In this work, we aim to learn a unified vision-based policy for multi-fingered robot hands to manipulate a variety of objects in diverse poses. Though prior work has shown benefits of using human videos for policy learning, performance…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Zerui Chen , Shizhe Chen , Etienne Arlaud , Ivan Laptev , Cordelia Schmid

Robotic manipulation in everyday scenarios, especially in unstructured environments, requires skills in pose-aware object manipulation (POM), which adapts robots' grasping and handling according to an object's 6D pose. Recognizing an…

Robotics · Computer Science 2024-03-21 Qiaojun Yu , Ce Hao , Junbo Wang , Wenhai Liu , Liu Liu , Yao Mu , Yang You , Hengxu Yan , Cewu Lu

Video Generation Models (VGMs) have become powerful backbones for Vision-Language-Action (VLA) models, leveraging large-scale pretraining for robust dynamics modeling. However, current methods underutilize their distribution modeling…

Dynamic point cloud pretraining is still dominated by masked reconstruction objectives. However, these objectives inherit two key limitations. Existing methods inject ground-truth tube centers as decoder positional embeddings, causing…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Zhuoyue Zhang , Jihua Zhu , Chaowei Fang , Jian Liu , Ajmal Saeed Mian

Recently, Vision-Language-Action models (VLA) have advanced robot imitation learning, but high data collection costs and limited demonstrations hinder generalization and current imitation learning methods struggle in out-of-distribution…

Robotics · Computer Science 2026-02-24 Shichao Fan , Quantao Yang , Yajie Liu , Kun Wu , Zhengping Che , Qingjie Liu , Min Wan

We introduce UMI-on-Air, a framework for embodiment-aware deployment of embodiment-agnostic manipulation policies. Our approach leverages diverse, unconstrained human demonstrations collected with a handheld gripper (UMI) to train…

Robotics · Computer Science 2026-03-17 Harsh Gupta , Xiaofeng Guo , Huy Ha , Chuer Pan , Muqing Cao , Dongjae Lee , Sebastian Scherer , Shuran Song , Guanya Shi

Diffusion models are increasingly used for robot learning, but current designs face a clear trade-off. Action-chunking diffusion policies like ManiCM are fast to run, yet they only predict short segments of motion. This makes them reactive,…

Robotics · Computer Science 2026-03-27 Xirui Shi , Arya Ebrahimi , Yi Hu , Jun Jin

Most existing vision-language manipulation research targets rigid robotic arms, whose fixed morphology limits adaptability in cluttered or confined spaces. Soft robotic arms offer an appealing alternative due to their deformability, but…

Robotics · Computer Science 2026-05-19 Ziyu Wei , Luting Wang , Chen Gao , Li Wen , Si Liu

Diffusion models, such as diffusion policy, have achieved state-of-the-art results in robotic manipulation by imitating expert demonstrations. While diffusion models were originally developed for vision tasks like image and video…

Robotics · Computer Science 2025-10-28 Mateo Clemente , Leo Brunswic , Rui Heng Yang , Xuan Zhao , Yasser Khalil , Haoyu Lei , Amir Rasouli , Yinchuan Li

Mobile manipulation requires coordinated control of high-dimensional, bimanual robots. Imitation learning methods have been broadly used to solve these robotic tasks, yet typically ignore the bilateral morphological symmetry inherent in…

Generalist robot policies built upon 2D visual representations excel at semantic reasoning but inherently lack the explicit 3D spatial awareness required for high-precision tasks. Existing 3D integration methods struggle to bridge this gap…

Robotics · Computer Science 2026-03-23 Xinzhang Yang , Renjun Wu , Jinyan Liu , Xuesong Li

Learning from unstructured and uncurated data has become the dominant paradigm for generative approaches in language and vision. Such unstructured and unguided behavior data, commonly known as play, is also easier to collect in robotics but…

Robotics · Computer Science 2023-12-08 Lili Chen , Shikhar Bahl , Deepak Pathak

Imitation Learning offers a promising approach to learn directly from data without requiring explicit models, simulations, or detailed task definitions. During inference, actions are sampled from the learned distribution and executed on the…

Robotics · Computer Science 2025-10-28 Amirreza Razmjoo , Sylvain Calinon , Michael Gienger , Fan Zhang

Visual imitation learning is effective for robots to learn versatile tasks. However, many existing methods rely on behavior cloning with supervised historical trajectories, limiting their 3D spatial and 4D spatiotemporal awareness.…

Robotics · Computer Science 2025-07-15 Zhenyang Liu , Yikai Wang , Kuanning Wang , Longfei Liang , Xiangyang Xue , Yanwei Fu

We present a diffusion-based approach to quadrupedal locomotion that simultaneously addresses the limitations of learning and interpolating between multiple skills and of (modes) offline adapting to new locomotion behaviours after training.…

Robotics · Computer Science 2025-06-04 Reece O'Mahoney , Alexander L. Mitchell , Wanming Yu , Ingmar Posner , Ioannis Havoutis

Building effective imitation learning methods that enable robots to learn from limited data and still generalize across diverse real-world environments is a long-standing problem in robot learning. We propose Equibot, a robust,…

Robotics · Computer Science 2024-10-30 Jingyun Yang , Zi-ang Cao , Congyue Deng , Rika Antonova , Shuran Song , Jeannette Bohg