English
Related papers

Related papers: DOT-Sim: Differentiable Optical Tactile Simulation…

200 papers

Vision-Based Tactile Sensors (VBTS) are essential for achieving dexterous robotic manipulation, yet the tactile sim-to-real gap remains a fundamental bottleneck. Current tactile simulations suffer from a persistent dilemma: simplified…

Robotics · Computer Science 2026-05-13 Lei Su , Zhijie Peng , Renyuan Ren , Shengping Mao , Juan Du , Kaifeng Zhang , Xuezhou Zhu

Tactile sensing is one of the modalities humans rely on heavily to perceive the world. Working with vision, this modality refines local geometry structure, measures deformation at the contact area, and indicates the hand-object contact…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Wenqiang Xu , Zhenjun Yu , Han Xue , Ruolin Ye , Siqiong Yao , Cewu Lu

We want to enable fine manipulation with a multi-fingered robotic hand by using modern deep reinforcement learning methods. Key for fine manipulation is a spatially resolved tactile sensor. Here, we present a novel model of a tactile skin…

Robotics · Computer Science 2024-09-20 Ulf Kasolowsky , Berthold Bäuml

Electrical Impedance Tomography (EIT)-based tactile sensors offer cost-effective and scalable solutions for robotic sensing, especially promising for soft robots. However a major issue of EIT-based tactile sensors when applied in highly…

Robotics · Computer Science 2025-04-09 Huazhi Dong , Xiaopeng Wu , Delin Hu , Zhe Liu , Francesco Giorgio-Serchi , Yunjie Yang

We present a tactile sensing method enabled by the mechanical compliance of soft robots; an externally attachable photoreflective module reads surface deformation of silicone skin to estimate contact force without embedding tactile…

Optical tactile sensors provide robots with rich force information for robot grasping in unstructured environments. The fast and accurate calibration of three-dimensional contact forces holds significance for new sensors and existing…

Robotics · Computer Science 2024-07-22 Zhuo Chen , Ni Ou , Jiaqi Jiang , Shan Luo

Robot simulation has been an essential tool for data-driven manipulation tasks. However, most existing simulation frameworks lack either efficient and accurate models of physical interactions with tactile sensors or realistic tactile…

Robotics · Computer Science 2022-08-08 Zilin Si , Zirui Zhu , Arpit Agarwal , Stuart Anderson , Wenzhen Yuan

In conjunction with huge recent progress in camera and computer vision technology, camera-based sensors have increasingly shown considerable promise in relation to tactile sensing. In comparison to competing technologies (be they resistive,…

Signal Processing · Electrical Eng. & Systems 2023-03-07 Kaspar Althoefer , Yonggen Ling , Wanlin Li , Xinyuan Qian , Wang Wei Lee , Peng Qi

Tactile sensing is inherently contact based. To use tactile data, robots need to make contact with the surface of an object. This is inefficient in applications where an agent needs to make a decision between multiple alternatives that…

Robotics · Computer Science 2021-10-19 Karankumar Patel , Soshi Iba , Nawid Jamali

Tactile sensing is critical for robotic grasping and manipulation of objects under visual occlusion. However, in contrast to simulations of robot arms and cameras, current simulations of tactile sensors have limited accuracy, speed, and…

Robotics · Computer Science 2021-04-01 Yashraj Narang , Balakumar Sundaralingam , Miles Macklin , Arsalan Mousavian , Dieter Fox

Recently simulation methods have been developed for optical tactile sensors to enable the Sim2Real learning, i.e., firstly training models in simulation before deploying them on the real robot. However, some artefacts in the real objects…

Robotics · Computer Science 2021-12-06 Tudor Jianu , Daniel Fernandes Gomes , Shan Luo

Tactile sensing can provide access to information about the contact (i.e. slippage, surface feature, friction), which is out of reach of vision but crucial for manipulation. To access this information, a dense measurement of the deformation…

Robotics · Computer Science 2022-05-04 Rob B. N. Scharff , Dirk-Jan Boonstra , Laurence Willemet , Xi Lin , Michaël Wiertlewski

Human skin can accurately sense the self-decoupled normal and shear forces when in contact with objects of different sizes. Although there exist many soft and conformable tactile sensors on robotic applications able to decouple the normal…

Robotics · Computer Science 2023-03-02 Wentao Chen , Youcan Yan , Zeqing Zhang , Lei Yang , Jia Pan

Most current works in Sim2Real learning for robotic manipulation tasks leverage camera vision that may be significantly occluded by robot hands during the manipulation. Tactile sensing offers complementary information to vision and can…

Robotics · Computer Science 2021-01-19 Daniel Fernandes Gomes , Paolo Paoletti , Shan Luo

Vision-based tactile sensors use structured light to measure deformation in their elastomeric interface. Until now, vision-based tactile sensors such as DIGIT and GelSight have been using a single, static pattern of structured light tuned…

Computer Vision and Pattern Recognition · Computer Science 2025-04-02 Artemii Redkin , Zdravko Dugonjic , Mike Lambeta , Roberto Calandra

Research in manipulation of deformable objects is typically conducted on a limited range of scenarios, because handling each scenario on hardware takes significant effort. Realistic simulators with support for various types of deformations…

Robotics · Computer Science 2025-05-15 Priya Sundaresan , Rika Antonova , Jeannette Bohg

Thanks to recent advancements in the development of inexpensive, high-resolution tactile sensors, touch sensing has become popular in contact-rich robotic manipulation tasks. With the surge of data-driven methods and their requirement for…

Robotics · Computer Science 2025-01-15 David P. Leins , Florian Patzelt , Robert Haschke

Distributed tactile sensing for multi-force detection is crucial for various aerial robot interaction tasks. However, current contact sensing solutions on drones only exploit single end-effector sensors and cannot provide distributed…

Robotics · Computer Science 2024-10-28 Emanuele Aucone , Carmelo Sferrazza , Manuel Gregor , Raffaello D'Andrea , Stefano Mintchev

Deformable object manipulation (DOM) represents a critical challenge in robotics, with applications spanning healthcare, manufacturing, food processing, and beyond. Unlike rigid objects, deformable objects exhibit infinite dimensionality,…

Robotics · Computer Science 2026-02-27 Ryan Paul McKennaa , John Oyekan

In vivo application of dynamic optical coherence tomography (DOCT) is hindered by bulk motion of the sample. We demonstrate DOCT imaging of \invivo human skin by adopting a sample-fixation attachment to suppress bulk motion and a subsequent…