English
Related papers

Related papers: Learning to Grasp Without Seeing

200 papers

Collocated tactile sensing is a fundamental enabling technology for dexterous manipulation. However, deformable sensors introduce complex dynamics between the robot, grasped object, and environment that must be considered for fine…

Robotics · Computer Science 2022-09-28 Miquel Oller , Mireia Planas , Dmitry Berenson , Nima Fazeli

This paper studies the task of any objects grasping from the known categories by free-form language instructions. This task demands the technique in computer vision, natural language processing, and robotics. We bring these disciplines…

Robotics · Computer Science 2022-05-10 Chilam Cheang , Haitao Lin , Yanwei Fu , Xiangyang Xue

In this work, we present a deep reinforcement learning based method to solve the problem of robotic grasping using visio-motor feedback. The use of a deep learning based approach reduces the complexity caused by the use of hand-designed…

Robotics · Computer Science 2020-07-10 Shirin Joshi , Sulabh Kumra , Ferat Sahin

Grasp pose estimation is an important issue for robots to interact with the real world. However, most of existing methods require exact 3D object models available beforehand or a large amount of grasp annotations for training. To avoid…

Robotics · Computer Science 2022-07-26 Hongtao Wen , Jianhang Yan , Wanli Peng , Yi Sun

Accurate object segmentation is a crucial task in the context of robotic manipulation. However, creating sufficient annotated training data for neural networks is particularly time consuming and often requires manual labeling. To this end,…

Computer Vision and Pattern Recognition · Computer Science 2020-11-09 Wout Boerdijk , Martin Sundermeyer , Maximilian Durner , Rudolph Triebel

Tactile sensing allows robots to gather detailed geometric information about objects through physical interaction, complementing vision-based approaches. However, efficiently acquiring useful tactile data remains challenging due to the…

Robotics · Computer Science 2026-02-27 Chung Hee Kim , Shivani Kamtikar , Tye Brady , Taskin Padir , Joshua Migdal

In order to explore robotic grasping in unstructured and dynamic environments, this work addresses the visual perception phase involved in the task. This phase involves the processing of visual data to obtain the location of the object to…

Robotics · Computer Science 2021-03-02 Eduardo Godinho Ribeiro , Raul de Queiroz Mendes , Valdir Grassi

This work deals with a practical everyday problem: stable object placement on flat surfaces starting from unknown initial poses. Common object-placing approaches require either complete scene specifications or extrinsic sensor measurements,…

The sense of touch is an essential ability for skillfully performing a variety of tasks, providing the capacity to search and manipulate objects without relying on visual information. In this paper, we introduce a multi-finger robot system…

Robotics · Computer Science 2024-11-27 Kang-Won Lee , Yuzhe Qin , Xiaolong Wang , Soo-Chul Lim

We present an adaptive grasping method that finds stable grasps on novel objects. The main contributions of this paper is in the computation of the probability of success of grasps in the vicinity of an already applied grasp. Our method…

Robotics · Computer Science 2017-04-20 Emil Hyttinen , Danica Kragic , Renaud Detry

Robust object pose estimation is essential for manipulation and interaction tasks in robotics, particularly in scenarios where visual data is limited or sensitive to lighting, occlusions, and appearances. Tactile sensors often offer limited…

We consider the problem of detecting robotic grasps in an RGB-D view of a scene containing objects. In this work, we apply a deep learning approach to solve this problem, which avoids time-consuming hand-design of features. This presents…

Machine Learning · Computer Science 2014-08-22 Ian Lenz , Honglak Lee , Ashutosh Saxena

Sensory substitution enables biological systems to perceive stimuli that are typically perceived by another organ, which is inspirational for physical agents. Multimodal perception of intrinsic and extrinsic interactions is critical in…

Robotics · Computer Science 2026-01-23 Fang Wan , Chaoyang Song

Robotic grasping for a diverse set of objects is essential in many robot manipulation tasks. One promising approach is to learn deep grasping models from large training datasets of object images and grasp labels. However, empirical grasping…

Robotics · Computer Science 2022-04-06 Xinghao Zhu , Yefan Zhou , Yongxiang Fan , Lingfeng Sun , Jianyu Chen , Masayoshi Tomizuka

Given the task of learning robotic grasping solely based on a depth camera input and gripper force feedback, we derive a learning algorithm from an applied point of view to significantly reduce the amount of required training data. Major…

Robotics · Computer Science 2019-03-04 Lars Berscheid , Thomas Rühr , Torsten Kröger

Tactile sensing represents a crucial technique that can enhance the performance of robotic manipulators in various tasks. This work presents a novel bioinspired neuromorphic vision-based tactile sensor that uses an event-based camera to…

Robotics · Computer Science 2024-03-18 Omar Faris , Mohammad I. Awad , Murana A. Awad , Yahya Zweiri , Kinda Khalaf

How can we segment varying numbers of objects where each specific object represents its own separate class? To make the problem even more realistic, how can we add and delete classes on the fly without retraining or fine-tuning? This is the…

Computer Vision and Pattern Recognition · Computer Science 2023-11-28 Anas Gouda , Moritz Roidl

This paper proposes a controller for stable grasping of unknown-shaped objects by two robotic fingers with tactile fingertips. The grasp is stabilised by rolling the fingertips on the contact surface and applying a desired grasping force to…

Object pose estimation methods allow finding locations of objects in unstructured environments. This is a highly desired skill for autonomous robot manipulation as robots need to estimate the precise poses of the objects in order to…

Robotics · Computer Science 2022-03-22 Tarik Kelestemur , Robert Platt , Taskin Padir

The ability to adapt to uncertainties, recover from failures, and coordinate between hand and fingers are essential sensorimotor skills for fully autonomous robotic grasping. In this paper, we aim to study a unified feedback control policy…

Robotics · Computer Science 2020-03-02 Wenbin Hu , Chuanyu Yang , Kai Yuan , Zhibin Li