English
Related papers

Related papers: Reinforcement Learning for Vision-based Object Man…

200 papers

Intelligent agents must be able to think fast and slow to perform elaborate manipulation tasks. Reinforcement Learning (RL) has led to many promising results on a range of challenging decision-making tasks. However, in real-world robotics,…

Robotics · Computer Science 2021-10-22 Maximilian Ulmer , Elie Aljalbout , Sascha Schwarz , Sami Haddadin

We present placing via picking (PvP), a method to autonomously collect real-world demonstrations for a family of placing tasks in which objects must be manipulated to specific, contact-constrained locations. With PvP, we approach the…

Robotics · Computer Science 2024-12-30 Oliver Limoyo , Abhisek Konar , Trevor Ablett , Jonathan Kelly , Francois R. Hogan , Gregory Dudek

Reinforcement learning methods as a promising technique have achieved superior results in the motion planning of free-floating space robots. However, due to the increase in planning dimension and the intensification of system dynamics…

Robotics · Computer Science 2022-09-07 Yuxue Cao , Shengjie Wang , Xiang Zheng , Wenke Ma , Xinru Xie , Lei Liu

Learning robotic manipulation tasks using reinforcement learning with sparse rewards is currently impractical due to the outrageous data requirements. Many practical tasks require manipulation of multiple objects, and the complexity of such…

Robotics · Computer Science 2019-12-24 Richard Li , Allan Jabri , Trevor Darrell , Pulkit Agrawal

In-Hand Manipulation, as many other dexterous tasks, remains a difficult challenge in robotics by combining complex dynamic systems with the capability to control and manoeuvre various objects using its actuators. This work presents the…

Robotics · Computer Science 2025-12-15 Alexandre Lopes , Catarina Barata , Plinio Moreno

Active perception describes a broad class of techniques that couple planning and perception systems to move the robot in a way to give the robot more information about the environment. In most robotic systems, perception is typically…

In real-world scenarios, many robotic manipulation tasks are hindered by occlusions and limited fields of view, posing significant challenges for passive observation-based models that rely on fixed or wrist-mounted cameras. In this paper,…

Robotics · Computer Science 2025-02-13 Guokang Wang , Hang Li , Shuyuan Zhang , Di Guo , Yanhong Liu , Huaping Liu

This paper introduces a challenging object grasping task and proposes a self-supervised learning approach. The goal of the task is to grasp an object which is not feasible with a single parallel gripper, but only with harnessing environment…

Robotics · Computer Science 2021-04-06 Hengyue Liang , Xibai Lou , Yang Yang , Changhyun Choi

Learning complex manipulation tasks in realistic, obstructed environments is a challenging problem due to hard exploration in the presence of obstacles and high-dimensional visual observations. Prior work tackles the exploration problem by…

Machine Learning · Computer Science 2021-11-12 I-Chun Arthur Liu , Shagun Uppal , Gaurav S. Sukhatme , Joseph J. Lim , Peter Englert , Youngwoon Lee

Reinforcement learning (RL) -- algorithms that teach artificial agents to interact with environments by maximising reward signals -- has achieved significant success in recent years. These successes have been facilitated by advances in…

Machine Learning · Computer Science 2025-04-03 Llewyn Salt , Marcus Gallagher

Close and precise placement of irregularly shaped objects requires a skilled robotic system. The manipulation of objects that have sensitive top surfaces and a fixed set of neighbors is particularly challenging. To avoid damaging the…

Robotics · Computer Science 2024-10-14 Benedikt Kreis , Nils Dengler , Jorge de Heuvel , Rohit Menon , Hamsa Perur , Maren Bennewitz

Developing robot controllers capable of achieving dexterous nonprehensile manipulation, such as pushing an object on a table, is challenging. The underactuated and hybrid-dynamics nature of the problem, further complicated by the…

Robotics · Computer Science 2023-08-07 Juan Del Aguila Ferrandis , João Moura , Sethu Vijayakumar

Robotic manipulation holds the potential to replace humans in the execution of tedious or dangerous tasks. However, control-based approaches are not suitable due to the difficulty of formally describing open-world manipulation in reality,…

Robotics · Computer Science 2023-11-21 Zihao Liu , Xing Liu , Yizhai Zhang , Zhengxiong Liu , Panfeng Huang

The subject of this paper is reinforcement learning. Policies are considered here that produce actions based on states and random elements autocorrelated in subsequent time instants. Consequently, an agent learns from experiments that are…

Machine Learning · Computer Science 2020-09-11 Marcin Szulc , Jakub Łyskawa , Paweł Wawrzyński

We investigate the problem of teaching a robot manipulator to perform dynamic non-prehensile object transport, also known as the `robot waiter' task, from a limited set of real-world demonstrations. We propose an approach that combines…

Robotics · Computer Science 2024-12-03 Neel Jawale , Byron Boots , Balakumar Sundaralingam , Mohak Bhardwaj

Reinforcement Learning (RL) offers a powerful paradigm for autonomous robots to master generalist manipulation skills through trial-and-error. However, its real-world application is stifled by low sample efficiency. Recent Human-in-the-Loop…

Robotics · Computer Science 2026-03-10 Haojun Chen , Zili Zou , Chengdong Ma , Yaoxiang Pu , Haotong Zhang , Yuanpei Chen , Yaodong Yang

A key challenge in scaling up robot learning to many skills and environments is removing the need for human supervision, so that robots can collect their own data and improve their own performance without being limited by the cost of…

Machine Learning · Computer Science 2017-03-14 Chelsea Finn , Sergey Levine

Contact-rich manipulation tasks are commonly found in modern manufacturing settings. However, manually designing a robot controller is considered hard for traditional control methods as the controller requires an effective combination of…

Robotics · Computer Science 2020-10-27 Yunlei Shi , Zhaopeng Chen , Hongxu Liu , Sebastian Riedel , Chunhui Gao , Qian Feng , Jun Deng , Jianwei Zhang

Real-world robotic tasks often require agents to achieve sequences of goals while respecting time-varying safety constraints. However, standard Reinforcement Learning (RL) paradigms are fundamentally limited in these settings. A natural…

Robotics · Computer Science 2025-12-02 Anastasios Manganaris , Vittorio Giammarino , Ahmed H. Qureshi

In this letter, we present an approach for learning in-hand manipulation skills with a low-cost, underactuated prosthetic hand in the presence of irreversible events. Our approach combines reinforcement learning based on visual perception…

Robotics · Computer Science 2019-11-21 Pietro Falco , Abdallah Attawia , Matteo Saveriano , Dongheui Lee