English
Related papers

Related papers: Minsight: A Fingertip-Sized Vision-Based Tactile S…

200 papers

Bringing tactile sensation to robotic hands will allow for more effective grasping, along with the wide range of benefits of human-like touch. Here we present a 3D-printed, three-fingered tactile robot hand comprising an OpenHand Model O…

Robotics · Computer Science 2020-08-17 Jasper W. James , Alex Church , Luke Cramphorn , Nathan F. Lepora

In robotic manipulation, tactile sensors are indispensable, especially when dealing with soft objects, objects of varying dimensions, or those out of the robot's direct line of sight. Traditional tactile sensors often grapple with…

Robotics · Computer Science 2024-05-24 Abraham George , Yibo Chen , Atharva Dikshit , Peter Pak , Amir Barati Farimani

Deep learning combined with high-resolution tactile sensing could lead to highly capable dexterous robots. However, progress is slow because of the specialist equipment and expertise. The DIGIT tactile sensor offers low-cost entry to…

Robotics · Computer Science 2022-07-19 Nathan F. Lepora , Yijiong Lin , Ben Money-Coomes , John Lloyd

Reproducing the capabilities of the human sense of touch in machines is an important step in enabling robot manipulation to have the ease of human dexterity. A combination of robotic technologies will be needed, including soft robotics,…

Robotics · Computer Science 2021-07-23 Nathan F. Lepora

This work presents NeuroTouch, an optical-based tactile sensor that combines a highly deformable dome-shaped soft material with an integrated neuromorphic camera, leveraging frame-based and dynamic vision for gesture detection. Our approach…

Human-Computer Interaction · Computer Science 2025-02-03 Victor Hoffmann , Federico Paredes-Valles , Valentina Cavinato

Robot-assisted minimally invasive surgery (RAMIS) provides substantial benefits over traditional open and laparoscopic methods. However, a significant limitation of RAMIS is the surgeon's inability to palpate tissues, a crucial technique…

Robotics · Computer Science 2025-09-15 Wanlin Li , Zihang Zhao , Leiyao Cui , Weiyi Zhang , Hangxin Liu , Li-An Li , Yixin Zhu

A GelSight sensor uses an elastomeric slab covered with a reflective membrane to measure tactile signals. It measures the 3D geometry and contact force information with high spacial resolution, and successfully helped many challenging robot…

Robotics · Computer Science 2018-03-01 Siyuan Dong , Wenzhen Yuan , Edward Adelson

Tactile sensing is critical to fine-grained, contact-rich manipulation tasks, such as insertion and assembly. Prior research has shown the possibility of learning tactile-guided policy from teleoperated demonstration data. However, to…

Robotics · Computer Science 2025-02-07 Kelin Yu , Yunhai Han , Qixian Wang , Vaibhav Saxena , Danfei Xu , Ye Zhao

Tactile sensing is of great importance during human hand usage such as object exploration, grasping and manipulation. Different types of tactile sensors have been designed during the past decades, which are mainly focused on either the…

Robotics · Computer Science 2023-08-11 Fuqiang Zhao , Bidan Huang , Mingchang Li , Mengde Li , Zhongtao Fu , Ziwei Lei , Miao Li

Compared to fully-actuated robotic end-effectors, underactuated ones are generally more adaptive, robust, and cost-effective. However, state estimation for underactuated hands is usually more challenging. Vision-based tactile sensors, like…

Robotics · Computer Science 2024-03-27 Yuxiang Ma , Jialiang Zhao , Edward Adelson

Endowing robots with tactile capabilities opens up new possibilities for their interaction with the environment, including the ability to handle fragile and/or soft objects. In this work, we equip the robot gripper with low-cost…

Robotics · Computer Science 2023-06-12 Michael C. Welle , Martina Lippi , Haofei Lu , Jens Lundell , Andrea Gasparri , Danica Kragic

This work details the design of a novel two finger robot gripper with multiple Gelsight based optical-tactile sensors covering the inner surface of the hand. The multiple Gelsight sensors can gather the surface topology of the object from…

Robotics · Computer Science 2020-02-10 Achu Wilson , Shaoxiong Wang , Branden Romero , Edward Adelson

Vision-based tactile sensors that can measure 3D geometry of the contacting objects are crucial for robots to perform dexterous manipulation tasks. However, the existing sensors are usually complicated to fabricate and delicate to extend.…

Robotics · Computer Science 2022-09-29 Changyi Lin , Ziqi Lin , Shaoxiong Wang , Huazhe Xu

The applications of fingertip haptic devices have spread to various fields from revolutionizing virtual reality and medical training simulations to facilitating remote robotic operations, proposing great potential for enhancing user…

Robotics · Computer Science 2025-07-11 Daria Trinitatova , Dzmitry Tsetserukou

While passive surfaces offer numerous benefits for interaction in mixed reality, reliably detecting touch input solely from head-mounted cameras has been a long-standing challenge. Camera specifics, hand self-occlusion, and rapid movements…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Paul Streli , Mark Richardson , Fadi Botros , Shugao Ma , Robert Wang , Christian Holz

This work presents a new version of the tactile-sensing finger GelSlim 3.0, which integrates the ability to sense high-resolution shape, force, and slip in a compact form factor for use with small parallel jaw grippers in cluttered…

Robotics · Computer Science 2021-03-24 Ian Taylor , Siyuan Dong , Alberto Rodriguez

Robotic palpation relies on force sensing, but force signals in soft-tissue environments are variable and cannot reliably reveal subtle subsurface features. We present a compact multimodal sensor that integrates high-resolution vision-based…

Knowledge of 3-D object shape is of great importance to robot manipulation tasks, but may not be readily available in unstructured environments. While vision is often occluded during robot-object interaction, high-resolution tactile sensors…

Robotics · Computer Science 2022-03-11 Sudharshan Suresh , Zilin Si , Joshua G. Mangelson , Wenzhen Yuan , Michael Kaess

In this paper, a novel tactile sensing mechanism for soft robotic fingers is proposed. Inspired by the proprioception mechanism found in mammals, the proposed approach infers tactile information from a strain sensor attached on the finger's…

Robotics · Computer Science 2021-07-07 Chang Cheng , Yadong Yan , Mingjun Guan , Jianan Zhang , Yu Wang

Combining 3D vision with tactile sensing could unlock a greater level of dexterity for robots and improve several manipulation tasks. However, obtaining a close-up 3D view of the location where manipulation contacts occur can be…

Robotics · Computer Science 2023-03-14 Etienne Roberge , Guillaume Fornes , Jean-Philippe Roberge