English
Related papers

Related papers: Tactile-Sensitive NewtonianVAE for High-Accuracy I…

200 papers

Tactile sensing is a crucial perception mode for robots and human amputees in need of controlling a prosthetic device. Today robotic and prosthetic systems are still missing the important feature of accurate tactile sensing. This lack is…

Robotics · Computer Science 2022-03-30 Xiaying Wang , Fabian Geiger , Vlad Niculescu , Michele Magno , Luca Benini

This paper presents a novel vision-based proprioception approach for a soft robotic finger that can estimate and reconstruct tactile interactions in both terrestrial and aquatic environments. The key to this system lies in the finger's…

Robotics · Computer Science 2024-07-23 Ning Guo , Xudong Han , Shuqiao Zhong , Zhiyuan Zhou , Jian Lin , Jian S. Dai , Fang Wan , Chaoyang Song

Accurate in-hand pose estimation is crucial for robotic object manipulation, but visual occlusion remains a major challenge for vision-based approaches. This paper presents an approach to robotic in-hand object pose estimation, combining…

Robotics · Computer Science 2025-06-13 Felix Nonnengießer , Alap Kshirsagar , Boris Belousov , Jan Peters

In this paper, we address the problem of estimating the in-hand 6D pose of an object in contact with multiple vision-based tactile sensors. We reason on the possible spatial configurations of the sensors along the object surface.…

Robotics · Computer Science 2023-02-01 Gabriele M. Caddeo , Nicola A. Piga , Fabrizio Bottarel , Lorenzo Natale

Visual Servoing (VS), where images taken from a camera typically attached to the robot end-effector are used to guide the robot motions, is an important technique to tackle robotic tasks that require a high level of accuracy. We propose a…

Robotics · Computer Science 2019-03-13 Cunjun Yu , Zhongang Cai , Hung Pham , Quang-Cuong Pham

Unlike traditional robotic hands, underactuated compliant hands are challenging to model due to inherent uncertainties. Consequently, pose estimation of a grasped object is usually performed based on visual perception. However, visual…

Robotics · Computer Science 2024-01-18 Osher Azulay , Inbar Ben-David , Avishai Sintov

The vision-based grasp detection method is an important research direction in the field of robotics. However, due to the rectangle metric of the grasp detection rectangle's limitation, a false-positive grasp occurs, resulting in the failure…

Robotics · Computer Science 2022-05-10 Yuanhao Li , Yu Liu , Zhiqiang Ma , Panfeng Huang

We present an active tactile exploration framework for joint object recognition and 6D pose estimation. The proposed method integrates wrist force/torque sensing, GelSight tactile sensing, and free-space constraints within a Bayesian…

In this paper, we present an approach to tactile pose estimation from the first touch for known objects. First, we create an object-agnostic map from real tactile observations to contact shapes. Next, for a new object with known geometry,…

Robotics · Computer Science 2020-12-10 Maria Bauza , Eric Valls , Bryan Lim , Theo Sechopoulos , Alberto Rodriguez

To use robots in more unstructured environments, we have to accommodate for more complexities. Robotic systems need more awareness of the environment to adapt to uncertainty and variability. Although cameras have been predominantly used in…

Robotics · Computer Science 2025-06-23 Viral Rasik Galaiya

Collocated tactile sensing is a fundamental enabling technology for dexterous manipulation. However, deformable sensors introduce complex dynamics between the robot, grasped object, and environment that must be considered for fine…

Robotics · Computer Science 2022-09-28 Miquel Oller , Mireia Planas , Dmitry Berenson , Nima Fazeli

The exploration of robotic dexterous hands utilizing tools has recently attracted considerable attention. A significant challenge in this field is the precise awareness of a tool's pose when grasped, as occlusion by the hand often degrades…

Robotics · Computer Science 2024-09-13 Yunlong Wang , Lei Zhang , Yuyang Tu , Hui Zhang , Kaixin Bai , Zhaopeng Chen , Jianwei Zhang

Tactile sensing is critical in advanced interactive systems by emulating the human sense of touch to detect stimuli. Vision-based tactile sensors are promising for providing multimodal capabilities and high robustness, yet existing…

Robotics · Computer Science 2025-04-07 Mayue Shi , Yongqi Zhang , Xiaotong Guo , Eric M. Yeatman

The missing signal caused by the objects being occluded or an unstable sensor is a common challenge during data collection. Such missing signals will adversely affect the results obtained from the data, and this issue is observed more…

Robotics · Computer Science 2023-07-17 Guanqun Cao , Jiaqi Jiang , Danushka Bollegala , Shan Luo

Accurate 3D pose estimation of grasped objects is an important prerequisite for robots to perform assembly or in-hand manipulation tasks, but object occlusion by the robot's own hand greatly increases the difficulty of this perceptual task.…

Tactile sensing represents a crucial technique that can enhance the performance of robotic manipulators in various tasks. This work presents a novel bioinspired neuromorphic vision-based tactile sensor that uses an event-based camera to…

Robotics · Computer Science 2024-03-18 Omar Faris , Mohammad I. Awad , Murana A. Awad , Yahya Zweiri , Kinda Khalaf

Robust object pose estimation is essential for manipulation and interaction tasks in robotics, particularly in scenarios where visual data is limited or sensitive to lighting, occlusions, and appearances. Tactile sensors often offer limited…

Tactile perception is central to robot manipulation in unstructured environments. However, it requires contact, and a mature implementation must infer object models while also accounting for the motion induced by the interaction. In this…

Tactile sensing has proven to be an invaluable tool for enhancing robotic perception, particularly in scenarios where visual data is limited or unavailable. However, traditional methods for pose estimation using tactile data often rely on…

Robotics · Computer Science 2024-09-24 Jose A. Eyzaguirre , Miquel Oller , Nima Fazeli

Accurate estimation of the in-hand pose of an object based on its CAD model is crucial in both industrial applications and everyday tasks, ranging from positioning workpieces and assembling components to seamlessly inserting devices like…

Machine Learning · Computer Science 2025-09-22 Mingdong Wu , Long Yang , Jin Liu , Weiyao Huang , Lehong Wu , Zelin Chen , Daolin Ma , Hao Dong