English
Related papers

Related papers: Learning Dexterous Manipulation from Suboptimal Ex…

200 papers

Deep reinforcement learning (RL) has emerged as a promising approach for autonomously acquiring complex behaviors from low level sensor observations. Although a large portion of deep RL research has focused on applications in video games…

Robotics · Computer Science 2021-02-08 Julian Ibarz , Jie Tan , Chelsea Finn , Mrinal Kalakrishnan , Peter Pastor , Sergey Levine

Reinforcement learning (RL) is a fundamental framework for sequential decision-making, in which an agent learns an optimal policy through interactions with an unknown environment. In settings with function approximation, many existing RL…

Machine Learning · Computer Science 2026-05-05 Ruiquan Huang , Donghao Li , Yingbin Liang , Jing Yang

Dexterous robotic hands enable robots to perform complex manipulations that require fine-grained control and adaptability. Achieving such manipulation is challenging because the high degrees of freedom tightly couple hand and arm motions,…

Robotics · Computer Science 2026-03-17 Ying Feng , Hongjie Fang , Yinong He , Jingjing Chen , Chenxi Wang , Zihao He , Ruonan Liu , Cewu Lu

Achieving human-level dexterity is an important open problem in robotics. However, tasks of dexterous hand manipulation, even at the baby level, are challenging to solve through reinforcement learning (RL). The difficulty lies in the high…

Many practical applications of reinforcement learning (RL) constrain the agent to learn from a fixed offline dataset of logged interactions, which has already been gathered, without offering further possibility for data collection. However,…

Machine Learning · Computer Science 2021-07-06 Zizhou Su

Dexterous multi-fingered robotic hands can perform a wide range of manipulation skills, making them an appealing component for general-purpose robotic manipulators. However, such hands pose a major challenge for autonomous control, due to…

Artificial Intelligence · Computer Science 2018-10-16 Henry Zhu , Abhishek Gupta , Aravind Rajeswaran , Sergey Levine , Vikash Kumar

Object handover is an important skill that we use daily when interacting with other humans. To deploy robots in collaborative setting, like houses, being able to receive and handing over objects safely and efficiently becomes a crucial…

Robotics · Computer Science 2025-06-23 Daniel Frau-Alfaro , Julio Castaño-Amoros , Santiago Puente , Pablo Gil , Roberto Calandra

Incorporating high-level knowledge is an effective way to expedite reinforcement learning (RL), especially for complex tasks with sparse rewards. We investigate an RL problem where the high-level knowledge is in the form of reward machines,…

Artificial Intelligence · Computer Science 2022-02-10 Zhe Xu , Ivan Gavran , Yousef Ahmad , Rupak Majumdar , Daniel Neider , Ufuk Topcu , Bo Wu

Dexterous manipulation tasks involving contact-rich interactions pose a significant challenge for both model-based control systems and imitation learning algorithms. The complexity arises from the need for multi-fingered robotic hands to…

Machine Learning · Computer Science 2023-09-08 Zheyuan Hu , Aaron Rovinsky , Jianlan Luo , Vikash Kumar , Abhishek Gupta , Sergey Levine

Real-world reinforcement learning (RL) offers a promising approach to training precise and dexterous robotic manipulation policies in an online manner, enabling robots to learn from their own experience while gradually reducing human labor.…

End-to-end learning robotic manipulation with high data efficiency is one of the key challenges in robotics. The latest methods that utilize human demonstration data and unsupervised representation learning has proven to be a promising…

Robotics · Computer Science 2021-10-22 Jin Li , Xianyuan Zhan , Zixu Xiao , Guyue Zhou

In recent years, industrial robots have been installed in various industries to handle advanced manufacturing and high precision tasks. However, further integration of industrial robots is hampered by their limited flexibility, adaptability…

Robotics · Computer Science 2020-10-27 Oren Spector , Miriam Zacksenhouse

Model-free reinforcement learning based methods such as Proximal Policy Optimization, or Q-learning typically require thousands of interactions with the environment to approximate the optimum controller which may not always be feasible in…

Machine Learning · Computer Science 2019-05-16 Narendra Patwardhan , Zequn Wang

Deep Reinforcement Learning (RL) has emerged as a powerful paradigm for training neural policies to solve complex control tasks. However, these policies tend to be overfit to the exact specifications of the task and environment they were…

Neural and Evolutionary Computing · Computer Science 2023-09-11 Felix Chalumeau , Raphael Boige , Bryan Lim , Valentin Macé , Maxime Allard , Arthur Flajolet , Antoine Cully , Thomas Pierrot

Recent research has shown that although Reinforcement Learning (RL) can benefit from expert demonstration, it usually takes considerable efforts to obtain enough demonstration. The efforts prevent training decent RL agents with expert…

Machine Learning · Computer Science 2021-07-09 Si-An Chen , Voot Tangkaratt , Hsuan-Tien Lin , Masashi Sugiyama

Muscle-actuated organisms are capable of learning an unparalleled diversity of dexterous movements despite their vast amount of muscles. Reinforcement learning (RL) on large musculoskeletal models, however, has not been able to show similar…

Robotics · Computer Science 2023-04-28 Pierre Schumacher , Daniel Häufle , Dieter Büchler , Syn Schmitt , Georg Martius

Offline reinforcement learning (RL) has increasingly become the focus of the artificial intelligent research due to its wide real-world applications where the collection of data may be difficult, time-consuming, or costly. In this paper, we…

Machine Learning · Computer Science 2021-05-13 Chenyang Xi , Bo Tang , Jiajun Shen , Xinfu Liu , Feiyu Xiong , Xueying Li

Dexterous multi-fingered hands are extremely versatile and provide a generic way to perform a multitude of tasks in human-centric environments. However, effectively controlling them remains challenging due to their high dimensionality and…

Machine Learning · Computer Science 2018-06-27 Aravind Rajeswaran , Vikash Kumar , Abhishek Gupta , Giulia Vezzani , John Schulman , Emanuel Todorov , Sergey Levine

Current end-to-end deep Reinforcement Learning (RL) approaches require jointly learning perception, decision-making and low-level control from very sparse reward signals and high-dimensional inputs, with little capability of incorporating…

Machine Learning · Computer Science 2019-10-10 Vibhavari Dasagi , Robert Lee , Serena Mou , Jake Bruce , Niko Sünderhauf , Jürgen Leitner

Many environments contain numerous available niches of variable value, each associated with a different local optimum in the space of behaviors (policy space). In such situations it is often difficult to design a learning process capable of…

Artificial Intelligence · Computer Science 2023-02-06 Peter Sunehag , Alexander Sasha Vezhnevets , Edgar Duéñez-Guzmán , Igor Mordach , Joel Z. Leibo