English
Related papers

Related papers: Learning Long-Horizon Robot Manipulation Skills vi…

200 papers

In this letter, we present an approach for learning in-hand manipulation skills with a low-cost, underactuated prosthetic hand in the presence of irreversible events. Our approach combines reinforcement learning based on visual perception…

Robotics · Computer Science 2019-11-21 Pietro Falco , Abdallah Attawia , Matteo Saveriano , Dongheui Lee

Robotic manipulation stands as a largely unsolved problem despite significant advances in robotics and machine learning in recent years. One of the key challenges in manipulation is the exploration of the dynamics of the environment when…

Robotics · Computer Science 2022-10-25 Tim Schneider , Boris Belousov , Georgia Chalvatzaki , Diego Romeres , Devesh K. Jha , Jan Peters

Practising and honing skills forms a fundamental component of how humans learn, yet artificial agents are rarely specifically trained to perform them. Instead, they are usually trained end-to-end, with the hope being that useful skills will…

Machine Learning · Computer Science 2022-08-17 Michael Matthews , Mikayel Samvelyan , Jack Parker-Holder , Edward Grefenstette , Tim Rocktäschel

Multi-robot manipulation tasks involve various control entities that can be separated into dynamically independent parts. A typical example of such real-world tasks is dual-arm manipulation. Learning to naively solve such tasks with…

Robotics · Computer Science 2022-11-30 Elie Aljalbout , Maximilian Karl , Patrick van der Smagt

Hierarchical Reinforcement Learning (HRL) is a promising approach to solving long-horizon problems with sparse and delayed rewards. Many existing HRL algorithms either use pre-trained low-level skills that are unadaptable, or require…

Machine Learning · Computer Science 2019-10-11 Siyuan Li , Rui Wang , Minxue Tang , Chongjie Zhang

In this work, we aim to learn a unified vision-based policy for multi-fingered robot hands to manipulate a variety of objects in diverse poses. Though prior work has shown benefits of using human videos for policy learning, performance…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Zerui Chen , Shizhe Chen , Etienne Arlaud , Ivan Laptev , Cordelia Schmid

We introduce LUMOS, a language-conditioned multi-task imitation learning framework for robotics. LUMOS learns skills by practicing them over many long-horizon rollouts in the latent space of a learned world model and transfers these skills…

Robotics · Computer Science 2025-03-14 Iman Nematollahi , Branton DeMoss , Akshay L Chandra , Nick Hawes , Wolfram Burgard , Ingmar Posner

Humanoid robots that autonomously interact with physical environments over extended horizons represent a central goal of embodied intelligence. Existing approaches rely on reference motions or task-specific rewards, tightly coupling…

Robotics · Computer Science 2026-02-26 Yutang Lin , Jieming Cui , Yixuan Li , Baoxiong Jia , Yixin Zhu , Siyuan Huang

Long-horizon robotic manipulation remains challenging for reinforcement learning (RL) because sparse rewards provide limited guidance for credit assignment. Practical policy improvement thus relies on richer intermediate supervision, such…

Robotics · Computer Science 2026-04-22 Yiming Mao , Zixi Yu , Weixin Mao , Yinhao Li , Qirui Hu , Zihan Lan , Minzhao Zhu , Hua Chen

Reinforcement learning provides a general framework for learning robotic skills while minimizing engineering effort. However, most reinforcement learning algorithms assume that a well-designed reward function is provided, and learn a single…

Robotics · Computer Science 2020-04-28 Archit Sharma , Michael Ahn , Sergey Levine , Vikash Kumar , Karol Hausman , Shixiang Gu

We present a method for reproducing complex multi-character interactions for physically simulated humanoid characters using deep reinforcement learning. Our method learns control policies for characters that imitate not only individual…

Graphics · Computer Science 2023-06-01 Yunbo Zhang , Deepak Gopinath , Yuting Ye , Jessica Hodgins , Greg Turk , Jungdam Won

This study explores a learning-based tri-finger robotic arm manipulating task, which requires complex movements and coordination among the fingers. By employing reinforcement learning, we train an agent to acquire the necessary skills for…

Robotics · Computer Science 2024-03-27 Xinrui Wang , Yan Jin

Grasping an object when it is in an ungraspable pose is a challenging task, such as books or other large flat objects placed horizontally on a table. Inspired by human manipulation, we address this problem by pushing the object to the edge…

Robotics · Computer Science 2023-02-28 Hao Zhang , Hongzhuo Liang , Lin Cong , Jianzhi Lyu , Long Zeng , Pingfa Feng , Jianwei Zhang

General-purpose robots must master long-horizon manipulation, defined as tasks involving multiple kinematic structure changes (e.g., attaching or detaching objects) in unstructured environments. While Vision-Language-Action (VLA) models…

Robotics · Computer Science 2026-02-26 Yue Yang , Shuo Cheng , Yu Fang , Homanga Bharadhwaj , Mingyu Ding , Gedas Bertasius , Daniel Szafir

Reinforcement learning (RL) algorithms face significant challenges when dealing with long-horizon robot manipulation tasks in real-world environments due to sample inefficiency and safety issues. To overcome these challenges, we propose a…

Robotics · Computer Science 2023-08-03 Ayano Hiranaka , Minjune Hwang , Sharon Lee , Chen Wang , Li Fei-Fei , Jiajun Wu , Ruohan Zhang

Despite the significant success at enabling robots with autonomous behaviors makes deep reinforcement learning a promising approach for robotic object search task, the deep reinforcement learning approach severely suffers from the nature…

Robotics · Computer Science 2021-03-04 Xin Ye , Yezhou Yang

Successfully navigating a complex environment to obtain a desired outcome is a difficult task, that up to recently was believed to be capable only by humans. This perception has been broken down over time, especially with the introduction…

Machine Learning · Computer Science 2019-11-12 Joshua Hare

We present a strategy for designing and building very general robot manipulation systems involving the integration of a general-purpose task-and-motion planner with engineered and learned perception modules that estimate properties and…

Controlled execution of dynamic motions in quadrupedal robots, especially those with articulated soft bodies, presents a unique set of challenges that traditional methods struggle to address efficiently. In this study, we tackle these…

Robotics · Computer Science 2024-03-05 Francecso Vezzi , Jiatao Ding , Antonin Raffin , Jens Kober , Cosimo Della Santina

This work presents DemoBot, a learning framework that enables a dual-arm, multi-finger robotic system to acquire complex manipulation skills from a single unannotated RGB-D video demonstration. The method extracts structured motion…

Robotics · Computer Science 2026-01-06 Yucheng Xu , Xiaofeng Mao , Elle Miller , Xinyu Yi , Yang Li , Zhibin Li , Robert B. Fisher