English
Related papers

Related papers: Sim-to-Real Transfer for Optical Tactile Sensing

200 papers

High-resolution tactile sensors have become critical for embodied perception and robotic manipulation. However, a key challenge in the field is the lack of transferability between sensors due to design and manufacturing variations, which…

Robotics · Computer Science 2025-03-14 Harsh Gupta , Yuchen Mo , Shengmiao Jin , Wenzhen Yuan

Having the ability to estimate an object's properties through interaction will enable robots to manipulate novel objects. Object's dynamics, specifically the friction and inertial parameters have only been estimated in a lab environment…

Robotics · Computer Science 2021-01-20 Balakumar Sundaralingam , Tucker Hermans

The field of robotic manipulation has advanced significantly in recent years. At the sensing level, several novel tactile sensors have been developed, capable of providing accurate contact information. On a methodological level, learning…

Robotics · Computer Science 2026-04-21 Niklas Funk , Changqi Chen , Tim Schneider , Georgia Chalvatzaki , Roberto Calandra , Jan Peters

Research on tactile sensing has been progressing at constant pace. In robotics, tactile sensing is typically studied in the context of object grasping and manipulation. In this domain, the development of robust, multi-modal, tactile sensors…

Robotics · Computer Science 2022-06-29 Lorenzo Natale , Giorgio Cannata

Robots which make use of soft or compliant inter- actions often leverage tendon-driven actuation which enables actuators to be placed more flexibly, and compliance to be maintained. However, controlling complex tendon systems is…

Robotics · Computer Science 2026-03-05 Valentin Yuryev , Josie Hughes

Vision-based tactile sensors use structured light to measure deformation in their elastomeric interface. Until now, vision-based tactile sensors such as DIGIT and GelSight have been using a single, static pattern of structured light tuned…

Computer Vision and Pattern Recognition · Computer Science 2025-04-02 Artemii Redkin , Zdravko Dugonjic , Mike Lambeta , Roberto Calandra

Tactile sensing is vital for human dexterous manipulation, however, it has not been widely used in robotics. Compact, low-cost sensing platforms can facilitate a change, but unlike their popular optical counterparts, they are difficult to…

Robotics · Computer Science 2025-03-10 Adrian Röfer , Nick Heppert , Abdallah Ayad , Eugenio Chisari , Abhinav Valada

Finger-tip tactile sensors are increasingly used for robotic sensing to establish stable grasps and to infer object properties. Promising performance has been shown in a number of works for inferring adjectives that describe the object, but…

Robotics · Computer Science 2023-03-14 Fangyi Zhang , Peter Corke

Tactile predictive models can be useful across several robotic manipulation tasks, e.g. robotic pushing, robotic grasping, slip avoidance, and in-hand manipulation. However, available tactile prediction models are mostly studied for…

Robotics · Computer Science 2024-05-13 Willow Mandil , Kiyanoush Nazari , Amir Ghalamzan E

This paper presents a novel regrasp control policy that makes use of tactile sensing to plan local grasp adjustments. Our approach determines regrasp actions by virtually searching for local transformations of tactile measurements that…

Robotics · Computer Science 2018-10-10 Francois R. Hogan , Maria Bauza , Oleguer Canal , Elliott Donlon , Alberto Rodriguez

For humans, the process of grasping an object relies heavily on rich tactile feedback. Most recent robotic grasping work, however, has been based only on visual input, and thus cannot easily benefit from feedback after initiating contact.…

Bridging the 'reality gap' that separates simulated robotics from experiments on hardware could accelerate robotic research through improved data availability. This paper explores domain randomization, a simple technique for training models…

Robotics · Computer Science 2017-03-22 Josh Tobin , Rachel Fong , Alex Ray , Jonas Schneider , Wojciech Zaremba , Pieter Abbeel

Tactile sensing is essential for dexterous manipulation, yet large-scale human demonstration datasets lack tactile feedback, limiting their effectiveness in skill transfer to robots. To address this, we introduce TacCap, a wearable Fiber…

Tactile sensing is fundamental to robotic systems, enabling interactions through physical contact in multiple tasks. Despite its importance, achieving high-resolution, large-area tactile sensing remains challenging. Electrical Impedance…

Robotics · Computer Science 2025-09-18 Huazhi Dong , Ronald B. Liu , Sihao Teng , Delin Hu , Peisan , E , Francesco Giorgio-Serchi , Yunjie Yang

One of the fundamental requirements for an artificial hand to successfully grasp and manipulate an object is to be able to distinguish different objects' shapes and, more specifically, the objects' surface curvatures. In this study, we…

Medical Physics · Physics 2011-09-19 Saba Salehi , John-John Cabibihan , Shuzhi Sam Ge

We have seen much recent progress in rigid object manipulation, but interaction with deformable objects has notably lagged behind. Due to the large configuration space of deformable objects, solutions using traditional modelling approaches…

Robotics · Computer Science 2018-10-09 Jan Matas , Stephen James , Andrew J. Davison

Brain-computer interface allows people who have lost their motor skills to control robot limbs based on electroencephalography. Most BCIs are guided only by visual feedback and do not have somatosensory feedback, which is an important…

Human-Computer Interaction · Computer Science 2020-12-14 Myoung-Ki Kim , Jeong-Hyun Cho , Ji-Hoon Jeong

This paper presents the Dynamic Tactile Sensing System that utilizes robotic tactile sensing in conjunction with reinforcement learning to locate and characterize embedded inclusions. A dual arm robot is integrated with an optical Tactile…

Systems and Control · Electrical Eng. & Systems 2026-01-23 John Bannan , Nazia Rahman , Chang-Hee Won

Contact-rich manipulation remains a major challenge in robotics. Optical tactile sensors like GelSight Mini offer a low-cost solution for contact sensing by capturing soft-body deformations of the silicone gel. However, accurately inferring…

Robotics · Computer Science 2026-01-14 Erik Helmut , Luca Dziarski , Niklas Funk , Boris Belousov , Jan Peters

Distinguishing the feel of smooth silk from coarse cotton is a trivial everyday task for humans. When exploring such fabrics, fingertip skin senses both spatio-temporal force patterns and texture-induced vibrations that are integrated to…