English
Related papers

Related papers: Dexterous Imitation Made Easy: A Learning-Based Fr…

200 papers

Effective execution of long-horizon tasks with dexterous robotic hands remains a significant challenge in real-world problems. While learning from human demonstrations have shown encouraging results, they require extensive data collection…

Dexterous multi-fingered robotic hands have a formidable action space, yet their morphological similarity to the human hand holds immense potential to accelerate robot learning. We propose DexVIP, an approach to learn dexterous robotic…

Robotics · Computer Science 2022-02-02 Priyanka Mandikal , Kristen Grauman

Reinforcement Learning (RL) training is predominantly conducted in cost-effective and controlled simulation environments. However, the transfer of these trained models to real-world tasks often presents unavoidable challenges. This research…

A dexterous hand capable of grasping any object is essential for the development of general-purpose embodied intelligent robots. However, due to the high degree of freedom in dexterous hands and the vast diversity of objects, generating…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Yiming Zhong , Qi Jiang , Jingyi Yu , Yuexin Ma

Imitation learning is a powerful paradigm for robot skill acquisition, yet conventional demonstration methods--such as kinesthetic teaching and teleoperation--are cumbersome, hardware-heavy, and disruptive to workflows. Recently, passive…

Robotics · Computer Science 2025-09-30 Rohan Walia , Yusheng Wang , Ralf Römer , Masahiro Nishio , Angela P. Schoellig , Jun Ota

Multi-step dexterous manipulation is a fundamental skill in household scenarios, yet remains an underexplored area in robotics. This paper proposes a modular approach, where each step of the manipulation process is addressed with dedicated…

A high-precision manipulation task, such as needle threading, is challenging. Physiological studies have proposed connecting low-resolution peripheral vision and fast movement to transport the hand into the vicinity of an object, and using…

Robotics · Computer Science 2025-05-23 Heecheol Kim , Yoshiyuki Ohmura , Yasuo Kuniyoshi

Dexterous manipulation is physics-intensive and highly sensitive to modeling errors and perception noise, making sim-to-real transfer prohibitively challenging. Domain randomization (DR) is commonly used to improve the robustness of learned…

Robotics · Computer Science 2026-05-12 Kejia Ren , Gaotian Wang , Andrew S. Morgan , Kaiyu Hang

This work presents DemoBot, a learning framework that enables a dual-arm, multi-finger robotic system to acquire complex manipulation skills from a single unannotated RGB-D video demonstration. The method extracts structured motion…

Robotics · Computer Science 2026-01-06 Yucheng Xu , Xiaofeng Mao , Elle Miller , Xinyu Yi , Yang Li , Zhibin Li , Robert B. Fisher

In imitation learning for robotic manipulation, decomposing object manipulation tasks into sub-tasks enables the reuse of learned skills and the combination of learned behaviors to perform novel tasks, rather than simply replicating…

Robotics · Computer Science 2025-02-28 Ryo Takizawa , Yoshiyuki Ohmura , Yasuo Kuniyoshi

Deep reinforcement learning has shown its advantages in real-time decision-making based on the state of the agent. In this stage, we solved the task of using a real robot to manipulate the cube to a given trajectory. The task is broken down…

Robotics · Computer Science 2021-12-10 Qingfeng Yao , Jilong Wang , Shuyu Yang

Manipulating objects with robotic hands is a complicated task. Not only the fingers of the hand, but also the pose of the robot's end effector need to be coordinated. Using human demonstrations of movements is an intuitive and…

We explore the dexterous manipulation transfer problem by designing simulators. The task wishes to transfer human manipulations to dexterous robot hand simulations and is inherently difficult due to its intricate, highly-constrained, and…

Robotics · Computer Science 2024-07-23 Xueyi Liu , Kangbo Lyu , Jieqiong Zhang , Tao Du , Li Yi

We explore learning-based approaches for feedback control of a dexterous five-finger hand performing non-prehensile manipulation. First, we learn local controllers that are able to perform the task starting at a predefined initial state.…

Machine Learning · Computer Science 2016-11-17 Vikash Kumar , Abhishek Gupta , Emanuel Todorov , Sergey Levine

As entertainment robots gain popularity, the demand for natural and expressive motion, particularly in dancing, continues to rise. Traditionally, dancing motions have been manually designed by artists, a process that is both labor-intensive…

Robotics · Computer Science 2025-02-26 Ryo Watanabe , Chenhao Li , Marco Hutter

Deformable linear object (DLO) manipulation is needed in many fields. Previous research on deformable linear object (DLO) manipulation has primarily involved parallel jaw gripper manipulation with fixed grasping positions. However, the…

Robotics · Computer Science 2023-12-27 Sun Zhaole , Jihong Zhu , Robert B. Fisher

Cross-embodiment learning seeks to build generalist robots that operate across diverse morphologies, but differences in action spaces and kinematics hinder data sharing and policy transfer. This raises a central question: Is there any…

Robotics · Computer Science 2025-11-11 Zihao He , Bo Ai , Tongzhou Mu , Yulin Liu , Weikang Wan , Jiawei Fu , Yilun Du , Henrik I. Christensen , Hao Su

Functional grasping with dexterous robotic hands is a key capability for enabling tool use and complex manipulation, yet progress has been constrained by two persistent bottlenecks: the scarcity of large-scale datasets and the absence of…

Robotics · Computer Science 2026-01-09 Xingyi He , Adhitya Polavaram , Yunhao Cao , Om Deshmukh , Tianrui Wang , Xiaowei Zhou , Kuan Fang

Dexterous robotic manipulation remains a longstanding challenge in robotics due to the high dimensionality of control spaces and the semantic complexity of object interaction. In this paper, we propose an object affordance-guided…

Most object manipulation strategies for robots are based on the assumption that the object is rigid (i.e., with fixed geometry) and the goal's details have been fully specified (e.g., the exact target pose). However, there are many tasks…

Robotics · Computer Science 2022-09-14 Shengzeng Huo , Fangyuan Wang , Luyin Hu , Peng Zhou , Jihong Zhu , Hesheng Wang , David Navarro-Alarcon