English
Related papers

Related papers: Minsight: A Fingertip-Sized Vision-Based Tactile S…

200 papers

Soft robotic fingers can improve adaptability in grasping and manipulation, compensating for geometric variation in object or environmental contact, but today lack force capacity and fine dexterity. Integrated tactile sensors can provide…

Robotics · Computer Science 2024-10-28 Hun Jang , Joonbum Bae , Kevin Haninger

Reliably planning fingertip grasps for multi-fingered hands lies as a key challenge for many tasks including tool use, insertion, and dexterous in-hand manipulation. This task becomes even more difficult when the robot lacks an accurate…

Robotics · Computer Science 2022-12-19 Martin Matak , Tucker Hermans

Having the ability to estimate an object's properties through interaction will enable robots to manipulate novel objects. Object's dynamics, specifically the friction and inertial parameters have only been estimated in a lab environment…

Robotics · Computer Science 2021-01-20 Balakumar Sundaralingam , Tucker Hermans

Tactile sensing provides robots with rich feedback during manipulation, enabling a host of perception and controls capabilities. Here, we present a new open-source, vision-based tactile sensor designed to promote reproducibility and…

Robotics · Computer Science 2024-10-01 Andrea Sipos , William van den Bogert , Nima Fazeli

Detection of slip during object grasping and manipulation plays a vital role in object handling. Existing solutions primarily rely on visual information to devise a strategy for grasping. However, for robotic systems to attain a level of…

Tactile and visual perception are both crucial for humans to perform fine-grained interactions with their environment. Developing similar multi-modal sensing capabilities for robots can significantly enhance and expand their manipulation…

Robotics · Computer Science 2025-01-08 Binghao Huang , Yixuan Wang , Xinyi Yang , Yiyue Luo , Yunzhu Li

Increasing the performance of tactile sensing in robots enables versatile, in-hand manipulation. Vision-based tactile sensors have been widely used as rich tactile feedback has been shown to be correlated with increased performance in…

Robotics · Computer Science 2022-03-10 Won Kyung Do , Monroe Kennedy

To adapt to constantly changing environments and be safe for human interaction, robots should have compliant and soft characteristics as well as the ability to sense the world around them. Even so, the incorporation of tactile sensing into…

Robotics · Computer Science 2022-04-15 Sandra Q. Liu , Edward H. Adelson

Tactile sensing is crucial in robotics and wearable devices for safe perception and interaction with the environment. Optical tactile sensors have emerged as promising solutions, as they are immune to electromagnetic interference and have…

Vision-based Tactile Sensors (VBTSs) show significant promise in that they can leverage image measurements to provide high-spatial-resolution human-like performance. However, current VBTS designs, typically confined to the fingertips of…

Robotics · Computer Science 2024-08-06 Meng Wang , Wanlin Li , Hao Liang , Boren Li , Kaspar Althoefer , Yao Su , Hangxin Liu

This paper has introduced a novel approach for the real-time estimation of 3D tactile forces exerted by human fingertips via vision only. The introduced approach is entirely monocular vision-based and does not require any physical force…

Computer Vision and Pattern Recognition · Computer Science 2021-10-18 Navid Fallahinia , Stephen Mascaro

In this work, we introduce the EyeSight Hand, a novel 7 degrees of freedom (DoF) humanoid hand featuring integrated vision-based tactile sensors tailored for enhanced whole-hand manipulation. Additionally, we introduce an actuation scheme…

Robotics · Computer Science 2024-08-13 Branden Romero , Hao-Shu Fang , Pulkit Agrawal , Edward Adelson

Tactile sensing can provide access to information about the contact (i.e. slippage, surface feature, friction), which is out of reach of vision but crucial for manipulation. To access this information, a dense measurement of the deformation…

Robotics · Computer Science 2022-05-04 Rob B. N. Scharff , Dirk-Jan Boonstra , Laurence Willemet , Xi Lin , Michaël Wiertlewski

We introduce a spherical fingertip sensor for dynamic manipulation. It is based on barometric pressure and time-of-flight proximity sensors and is low-latency, compact, and physically robust. The sensor uses a trained neural network to…

Robotics · Computer Science 2023-03-08 Andrew SaLoutos , Elijah Stanger-Jones , Menglong Guo , Hongmin Kim , Sangbae Kim

Tactile sensing is a crucial perception mode for robots and human amputees in need of controlling a prosthetic device. Today robotic and prosthetic systems are still missing the important feature of accurate tactile sensing. This lack is…

Robotics · Computer Science 2022-03-30 Xiaying Wang , Fabian Geiger , Vlad Niculescu , Michele Magno , Luca Benini

We present a novel underactued humanoid five finger soft hand, the KIT \softhand, which is equipped with cameras in the fingertips and integrates a high performance embedded system for visual processing and control. We describe the…

Robotics · Computer Science 2020-06-08 Felix Hundhausen , Julia Starke , Tamim Asfour

The synthesis of tactile sensing with compliance is essential to many fields, from agricultural usages like fruit picking, to sustainability practices such as sorting recycling, to the creation of safe home-care robots for the elderly to…

Robotics · Computer Science 2023-03-28 Sandra Q. Liu , Yuxiang Ma , Edward H. Adelson

This work describes the development of a high-resolution tactile-sensing finger for robot grasping. This finger, inspired by previous GelSight sensing techniques, features an integration that is slimmer, more robust, and with more…

Robotics · Computer Science 2018-05-16 Elliott Donlon , Siyuan Dong , Melody Liu , Jianhua Li , Edward Adelson , Alberto Rodriguez

Robotic manipulation tasks such as inserting a key into a lock or plugging a USB device into a port can fail when visual perception is insufficient to detect misalignment. In these situations, touch sensing is crucial for the robot to…

Robotics · Computer Science 2025-09-23 Yinghao Wu , Shuhong Hou , Haowen Zheng , Yichen Li , Weiyi Lu , Xun Zhou , Yitian Shao

In the human hand, high-density contact information provided by afferent neurons is essential for many human grasping and manipulation capabilities. In contrast, robotic tactile sensors, including the state-of-the-art SynTouch BioTac, are…

Robotics · Computer Science 2021-01-15 Yashraj S. Narang , Balakumar Sundaralingam , Karl Van Wyk , Arsalan Mousavian , Dieter Fox