English
Related papers

Related papers: Object Pose Estimation through Dexterous Touch

200 papers

Tactile perception is a crucial sensing modality in robotics, particularly in scenarios that require precise manipulation and safe interaction with other objects. Previous research in this area has focused extensively on tactile perception…

Robotics · Computer Science 2023-06-27 John Lloyd , Nathan Lepora

During in-hand manipulation, robots must be able to continuously estimate the pose of the object in order to generate appropriate control actions. The performance of algorithms for pose estimation hinges on the robot's sensors being able to…

Tactile sensing has proven to be an invaluable tool for enhancing robotic perception, particularly in scenarios where visual data is limited or unavailable. However, traditional methods for pose estimation using tactile data often rely on…

Robotics · Computer Science 2024-09-24 Jose A. Eyzaguirre , Miquel Oller , Nima Fazeli

This work deals with a practical everyday problem: stable object placement on flat surfaces starting from unknown initial poses. Common object-placing approaches require either complete scene specifications or extrinsic sensor measurements,…

Many manipulation tasks, such as placement or within-hand manipulation, require the object's pose relative to a robot hand. The task is difficult when the hand significantly occludes the object. It is especially hard for adaptive hands, for…

Robotics · Computer Science 2021-12-20 Bowen Wen , Chaitanya Mitash , Sruthi Soorian , Andrew Kimmel , Avishai Sintov , Kostas E. Bekris

In this paper, we address the problem of estimating the in-hand 6D pose of an object in contact with multiple vision-based tactile sensors. We reason on the possible spatial configurations of the sensors along the object surface.…

Robotics · Computer Science 2023-02-01 Gabriele M. Caddeo , Nicola A. Piga , Fabrizio Bottarel , Lorenzo Natale

Prehensile autonomous manipulation, such as peg insertion, tool use, or assembly, require precise in-hand understanding of the object pose and the extrinsic contacts made during interactions. Providing accurate estimation of pose and…

Robotics · Computer Science 2026-01-01 Mark Van der Merwe , Kei Ota , Dmitry Berenson , Nima Fazeli , Devesh K. Jha

In recent times, object detection and pose estimation have gained significant attention in the context of robotic vision applications. Both the identification of objects of interest as well as the estimation of their pose remain important…

Robotics · Computer Science 2021-01-20 S. K. Paul , M. T. Chowdhury , M. Nicolescu , M. Nicolescu

The sense of touch plays a key role in enabling humans to understand and interact with surrounding environments. For robots, tactile sensing is also irreplaceable. While interacting with objects, tactile sensing provides useful information…

Robotics · Computer Science 2021-12-30 Jiaqi Jiang , Shan Luo

State-of-the-art object pose estimation methods are prone to generating geometrically infeasible pose hypotheses. This problem is prevalent in dexterous manipulation, where estimated poses often intersect with the robotic hand or are not…

Robotics · Computer Science 2026-03-24 Anil Zeybek , Rhys Newbury , Snehal Dikhale , Nawid Jamali , Soshi Iba , Akansel Cosgun

Tactile perception is central to robot manipulation in unstructured environments. However, it requires contact, and a mature implementation must infer object models while also accounting for the motion induced by the interaction. In this…

In the industrial domain, the pose estimation of multiple texture-less shiny parts is a valuable but challenging task. In this particular scenario, it is impractical to utilize keypoints or other texture information because most of them are…

Robotics · Computer Science 2019-09-27 Chen Chen , Xin Jiang , Weiguo Zhou , Yun-Hui Liu

We present a novel appearance-based approach for pose estimation of a human hand using the point clouds provided by the low-cost Microsoft Kinect sensor. Both the free-hand case, in which the hand is isolated from the surrounding…

Computer Vision and Pattern Recognition · Computer Science 2016-04-08 Pasquale Coscia , Francesco A. N. Palmieri , Francesco Castaldo , Alberto Cavallo

We're interested in the problem of estimating object states from touch during manipulation under occlusions. In this work, we address the problem of estimating object poses from touch during planar pushing. Vision-based tactile sensors…

Robotics · Computer Science 2021-03-30 Paloma Sodhi , Michael Kaess , Mustafa Mukadam , Stuart Anderson

This work proposes a process for efficiently training a point-wise object detector that enables localizing objects and computing their 6D poses in cluttered and occluded scenes. Accurate pose estimation is typically a requirement for robust…

Computer Vision and Pattern Recognition · Computer Science 2019-02-22 Jean-Philippe Mercier , Chaitanya Mitash , Philippe Giguère , Abdeslam Boularias

Precise perception of contact interactions is essential for fine-grained manipulation skills for robots. In this paper, we present the design of feedback skills for robots that must learn to stack complex-shaped objects on top of each other…

We propose a method to track the 6D pose of an object over time, while the object is under non-prehensile manipulation by a robot. At any given time during the manipulation of the object, we assume access to the robot joint controls and an…

Robotics · Computer Science 2023-10-25 Zisong Xu , Rafael Papallas , Mehmet Dogar

This article describes a new way of controlling robots using soft tactile sensors: pose-based tactile servo (PBTS) control. The basic idea is to embed a tactile perception model for estimating the sensor pose within a servo control loop…

Robotics · Computer Science 2021-07-05 Nathan F. Lepora , John Lloyd

For many robotic manipulation and contact tasks, it is crucial to accurately estimate uncertain object poses, for which certain geometry and sensor information are fused in some optimal fashion. Previous results for this problem primarily…

Robotics · Computer Science 2023-05-29 Jeongmin Lee , Minji Lee , Dongjun Lee

In order to meaningfully interact with the world, robot manipulators must be able to interpret objects they encounter. A critical aspect of this interpretation is pose estimation: inferring quantities that describe the position and…

Robotics · Computer Science 2023-05-23 Walter Goodwin , Ioannis Havoutis , Ingmar Posner