English
Related papers

Related papers: Learning a Universal Human Prior for Dexterous Man…

200 papers

Reinforcement Learning (RL) algorithms can in principle acquire complex robotic skills by learning from large amounts of data in the real world, collected via trial and error. However, most RL algorithms use a carefully engineered setup in…

Machine Learning · Computer Science 2021-04-23 Abhishek Gupta , Justin Yu , Tony Z. Zhao , Vikash Kumar , Aaron Rovinsky , Kelvin Xu , Thomas Devlin , Sergey Levine

Scalable learning of humanoid robots is crucial for their deployment in real-world applications. While traditional approaches primarily rely on reinforcement learning or teleoperation to achieve whole-body control, they are often limited by…

Human-robot object handover is a crucial element for assistive robots that aim to help people in their daily lives, including elderly care, hospitals, and factory floors. The existing approaches to solving these tasks rely on pre-selected…

Robotics · Computer Science 2025-08-06 Lucas Chen , Guna Avula , Hanwen Ren , Zixing Wang , Ahmed H. Qureshi

A dexterous hand capable of generalizable grasping objects is fundamental for the development of general-purpose embodied AI. However, previous methods focus narrowly on low-level grasp stability metrics, neglecting affordance-aware…

We propose a method of learning a policy for human-like locomotion via deep reinforcement learning based on a human anatomical model, muscle actuation, and biologically inspired rewards, without any inherent control rules or reference…

Graphics · Computer Science 2024-01-30 Minkwan Kim , Yoonsang Lee

Controlling contact forces during interactions is critical for locomotion and manipulation tasks. While sim-to-real reinforcement learning (RL) has succeeded in many contact-rich problems, current RL methods achieve forceful interactions…

Robotics · Computer Science 2024-05-21 Tifanny Portela , Gabriel B. Margolis , Yandong Ji , Pulkit Agrawal

Reinforcement Learning from Human Feedback (RLHF) is a powerful paradigm for aligning foundation models to human values and preferences. However, current RLHF techniques cannot account for the naturally occurring differences in individual…

Machine Learning · Computer Science 2024-08-20 Sriyash Poddar , Yanming Wan , Hamish Ivison , Abhishek Gupta , Natasha Jaques

Humanoid whole-body loco-manipulation promises transformative capabilities for daily service and warehouse tasks. While recent advances in general motion tracking (GMT) have enabled humanoids to reproduce diverse human motions, these…

Robotics · Computer Science 2025-10-09 Siheng Zhao , Yanjie Ze , Yue Wang , C. Karen Liu , Pieter Abbeel , Guanya Shi , Rocky Duan

This paper presents a novel approach for pretraining robotic manipulation Vision-Language-Action (VLA) models using a large corpus of unscripted real-life video recordings of human hand activities. Treating human hand as dexterous robot…

A promising approach to solving challenging long-horizon tasks has been to extract behavior priors (skills) by fitting generative models to large offline datasets of demonstrations. However, such generative models inherit the biases of the…

Machine Learning · Computer Science 2021-08-13 Xiaofei Wang , Kimin Lee , Kourosh Hakhamaneshi , Pieter Abbeel , Michael Laskin

Human videos offer a scalable way to train robot manipulation policies, but lack the action labels needed by standard imitation learning algorithms. Existing cross-embodiment approaches try to map human motion to robot actions, but often…

Reinforcement learning provides a general framework for flexible decision making and control, but requires extensive data collection for each new task that an agent needs to learn. In other machine learning fields, such as natural language…

Machine Learning · Computer Science 2020-11-20 Avi Singh , Huihan Liu , Gaoyue Zhou , Albert Yu , Nicholas Rhinehart , Sergey Levine

Socially aware robot navigation, where a robot is required to optimize its trajectory to maintain comfortable and compliant spatial interactions with humans in addition to reaching its goal without collisions, is a fundamental yet…

Robotics · Computer Science 2022-08-02 Ruiqi Wang , Weizheng Wang , Byung-Cheol Min

Dexterous in-hand manipulation is a unique and valuable human skill requiring sophisticated sensorimotor interaction with the environment while respecting stability constraints. Satisfying these constraints with generated motions is…

Humans can steadily and gently grasp unfamiliar objects based on tactile perception. Robots still face challenges in achieving similar performance due to the difficulty of learning accurate grasp-force predictions and force control…

Robotics · Computer Science 2025-02-05 Mingxuan Li , Lunwei Zhang , Tiemin Li , Yao Jiang

Enabling multi-fingered robots to grasp and manipulate objects with human-like dexterity is especially challenging during the dynamic, continuous hand-object interactions. Closed-loop feedback control is essential for dexterous hands to…

Robotics · Computer Science 2024-12-24 Dongying Tian , Xiangbo Lin , Yi Sun

Robots are extending their presence in domestic environments every day, being more common to see them carrying out tasks in home scenarios. In the future, robots are expected to increasingly perform more complex tasks and, therefore, be…

Artificial Intelligence · Computer Science 2020-09-22 Ithan Moreira , Javier Rivas , Francisco Cruz , Richard Dazeley , Angel Ayala , Bruno Fernandes

Conventional reinforcement learning (RL) approaches often struggle to learn effective policies under sparse reward conditions, necessitating the manual design of complex, task-specific reward functions. To address this limitation,…

Robotics · Computer Science 2025-12-02 Suzie Kim

When operating in service of people, robots need to optimize rewards aligned with end-user preferences. Since robots will rely on raw perceptual inputs like RGB images, their rewards will inevitably use visual representations. Recently…

Robotics · Computer Science 2024-01-17 Ran Tian , Chenfeng Xu , Masayoshi Tomizuka , Jitendra Malik , Andrea Bajcsy

Conveying complex objectives to reinforcement learning (RL) agents often requires meticulous reward engineering. Preference-based RL methods are able to learn a more flexible reward model based on human preferences by actively incorporating…

Machine Learning · Computer Science 2022-05-26 Xinran Liang , Katherine Shu , Kimin Lee , Pieter Abbeel