English
Related papers

Related papers: Multi-Stage Reinforcement Learning for Non-Prehens…

200 papers

A robot operating in unstructured environments must be able to discriminate between different grasping styles depending on the prospective manipulation task. Having a system that allows learning from remote non-expert demonstrations can…

Computer Vision and Pattern Recognition · Computer Science 2023-03-21 Furkan Kaynar , Sudarshan Rajagopalan , Shaobo Zhou , Eckehard Steinbach

Non-prehensile manipulation, encompassing ungraspable actions such as pushing, poking, pivoting, and wrapping, remains underexplored due to its contact-rich and analytically intractable nature. We revisit this problem from two perspectives.…

Robotics · Computer Science 2026-03-03 Huayi Zhou , Kui Jia

Object pushing presents a key non-prehensile manipulation problem that is illustrative of more complex robotic manipulation tasks. While deep reinforcement learning (RL) methods have demonstrated impressive learning capabilities using…

Robotics · Computer Science 2023-07-27 Max Yang , Yijiong Lin , Alex Church , John Lloyd , Dandan Zhang , David A. W. Barton , Nathan F. Lepora

This paper addresses the challenge of occluded robot grasping, i.e. grasping in situations where the desired grasp poses are kinematically infeasible due to environmental constraints such as surface collisions. Traditional robot…

Robotics · Computer Science 2025-02-17 Jun Yamada , Alexander L. Mitchell , Jack Collins , Ingmar Posner

This work explores non-prehensile manipulation (NPM) and whole-body interaction as strategies for enabling robotic manipulators to conduct manipulation tasks despite experiencing locked multi-joint (LMJ) failures. LMJs are critical system…

Long-horizon contact-rich tasks are challenging to learn with reinforcement learning, due to ineffective exploration of high-dimensional state spaces with sparse rewards. The learning process often gets stuck in local optimum and demands…

Robotics · Computer Science 2025-02-24 Xiaofeng Mao , Yucheng Xu , Zhaole Sun , Elle Miller , Daniel Layeghi , Michael Mistry

In robot manipulation, Reinforcement Learning (RL) often suffers from low sample efficiency and uncertain convergence, especially in large observation and action spaces. Foundation Models (FMs) offer an alternative, demonstrating promise in…

Robotics · Computer Science 2025-04-18 Runyu Ma , Jelle Luijkx , Zlatan Ajanovic , Jens Kober

This paper proposes a novel learning-free three-stage method that predicts grasping poses, enabling robots to pick up and transfer previously unseen objects. Our method first identifies potential structures that can afford the action of…

Robotics · Computer Science 2024-08-14 Wanze Li , Wan Su , Gregory S. Chirikjian

Robots are expected to replace menial tasks such as housework. Some of these tasks include nonprehensile manipulation performed without grasping objects. Nonprehensile manipulation is very difficult because it requires considering the…

Robotics · Computer Science 2022-06-23 Yuki Saigusa , Sho Sakaino , Toshiaki Tsuji

Robotic vision plays a key role for perceiving the environment in grasping applications. However, the conventional framed-based robotic vision, suffering from motion blur and low sampling rate, may not meet the automation needs of evolving…

The intricate kinematics of the human hand enable simultaneous grasping and manipulation of multiple objects, essential for tasks such as object transfer and in-hand manipulation. Despite its significance, the domain of robotic multi-object…

Robotics · Computer Science 2024-03-15 Yuyang Li , Bo Liu , Yiran Geng , Puhao Li , Yaodong Yang , Yixin Zhu , Tengyu Liu , Siyuan Huang

The mechanism of connecting multimodal signals through self-attention operation is a key factor in the success of multimodal Transformer networks in remote sensing data fusion tasks. However, traditional approaches assume access to all…

Computer Vision and Pattern Recognition · Computer Science 2023-04-25 Yuxing Chen , Maofan Zhao , Lorenzo Bruzzone

Mastering robotic manipulation skills through reinforcement learning (RL) typically requires the design of shaped reward functions. Recent developments in this area have demonstrated that using sparse rewards, i.e. rewarding the agent only…

Machine Learning · Computer Science 2021-11-12 Ozsel Kilinc , Giovanni Montana

Complex and contact-rich robotic manipulation tasks, particularly those that involve multi-fingered hands and underactuated object manipulation, present a significant challenge to any control method. Methods based on reinforcement learning…

Machine Learning · Computer Science 2022-12-21 Kelvin Xu , Zheyuan Hu , Ria Doshi , Aaron Rovinsky , Vikash Kumar , Abhishek Gupta , Sergey Levine

Robot manipulation relies on accurately predicting contact points and end-effector directions to ensure successful operation. However, learning-based robot manipulation, trained on a limited category within a simulator, often struggles to…

Computer Vision and Pattern Recognition · Computer Science 2023-12-29 Xiaoqi Li , Mingxu Zhang , Yiran Geng , Haoran Geng , Yuxing Long , Yan Shen , Renrui Zhang , Jiaming Liu , Hao Dong

Humans, this species expert in grasp detection, can grasp objects by taking into account hand-object positioning information. This work proposes a method to enable a robot manipulator to learn the same, grasping objects in the most optimal…

Goal-conditioned reinforcement learning (GCRL) allows agents to learn diverse objectives using a unified policy. The success of GCRL, however, is contingent on the choice of goal representation. In this work, we propose a mask-based goal…

Computer Vision and Pattern Recognition · Computer Science 2025-10-09 Fahim Shahriar , Cheryl Wang , Alireza Azimi , Gautham Vasan , Hany Hamed Elanwar , A. Rupam Mahmood , Colin Bellinger

The skill of pivoting an object with a robotic system is challenging for the external forces that act on the system, mainly given by contact interaction. The complexity increases when the same skills are required to generalize across…

Robotics · Computer Science 2023-05-05 Xiang Zhang , Siddarth Jain , Baichuan Huang , Masayoshi Tomizuka , Diego Romeres

Non-prehensile manipulation is challenging due to complex contact interactions between objects, the environment, and robots. Model-based approaches can efficiently generate complex trajectories of robots and objects under contact…

Robotics · Computer Science 2025-08-07 Yuki Shirai , Kei Ota , Devesh K. Jha , Diego Romeres

A simple gripper can solve more complex manipulation tasks if it can utilize the external environment such as pushing the object against the table or a vertical wall, known as "Extrinsic Dexterity." Previous work in extrinsic dexterity…

Robotics · Computer Science 2022-11-04 Wenxuan Zhou , David Held