English
Related papers

Related papers: DelTact: A Vision-based Tactile Sensor Using Dense…

200 papers

GelSight family of vision-based tactile sensors has proven to be effective for multiple robot perception and manipulation tasks. These sensors are based on an internal optical system and an embedded camera to capture the deformation of the…

Robotics · Computer Science 2025-04-22 Arpit Agarwal , Mohammad Amin Mirzaee , Xiping Sun , Wenzhen Yuan

The sense of touch is an essential ability for skillfully performing a variety of tasks, providing the capacity to search and manipulate objects without relying on visual information. In this paper, we introduce a multi-finger robot system…

Robotics · Computer Science 2024-11-27 Kang-Won Lee , Yuzhe Qin , Xiaolong Wang , Soo-Chul Lim

Vision and touch are two of the important sensing modalities for humans and they offer complementary information for sensing the environment. Robots could also benefit from such multi-modal sensing ability. In this paper, addressing for the…

Robotics · Computer Science 2018-03-14 Shan Luo , Wenzhen Yuan , Edward Adelson , Anthony G. Cohn , Raul Fuentes

Tactile sensors, which provide information about the physical properties of objects, are an essential component of robotic systems. The visuotactile sensing technology with the merits of high resolution and low cost has facilitated the…

Robotics · Computer Science 2024-06-19 Shoujie Li , Zihan Wang , Changsheng Wu , Xiang Li , Shan Luo , Bin Fang , Fuchun Sun , Xiao-Ping Zhang , Wenbo Ding

Data-driven approaches to tactile sensing aim to overcome the complexity of accurately modeling contact with soft materials. However, their widespread adoption is impaired by concerns about data efficiency and the capability to generalize…

Robotics · Computer Science 2020-03-06 Carmelo Sferrazza , Thomas Bi , Raffaello D'Andrea

For contact-intensive tasks, the ability to generate policies that produce comprehensive tactile-aware motions is essential. However, existing data collection and skill learning systems for dexterous manipulation often suffer from…

Robotics · Computer Science 2026-01-30 Xingyu Zhang , Chaofan Zhang , Boyue Zhang , Zhinan Peng , Shaowei Cui , Shuo Wang

Retrieving rich contact information from robotic tactile sensing has been a challenging, yet significant task for the effective perception of object properties that the robot interacts with. This work is dedicated to developing an algorithm…

Robotics · Computer Science 2019-06-25 Yazhan Zhang , Zicheng Kan , Yang Yang , Alexander Yu Tse , Michael Yu Wang

Sensing contacts throughout the fingers is an essential capability for a robot to perform manipulation tasks in cluttered environments. However, existing tactile sensors either only have a flat sensing surface or a compliant tip with a…

Robotics · Computer Science 2021-02-26 Daniel Fernandes Gomes , Zhonglin Lin , Shan Luo

The images captured by vision-based tactile sensors carry information about high-resolution tactile fields, such as the distribution of the contact forces applied to their soft sensing surface. However, extracting the information encoded in…

Robotics · Computer Science 2021-10-01 Carmelo Sferrazza , Raffaello D'Andrea

Tactile sensing for robotics is achieved through a variety of mechanisms, including magnetic, optical-tactile, and conductive fluid. Currently, the fluid-based sensors have struck the right balance of anthropomorphic sizes and shapes and…

Tactile sensing in biological organisms is deeply intertwined with morphological form, such as human fingers, cat paws, and elephant trunks, which enables rich and adaptive interactions through a variety of geometrically complex structures.…

Deformable objects often appear in unstructured configurations. Tracing deformable objects helps bringing them into extended states and facilitating the downstream manipulation tasks. Due to the requirements for object-specific modeling or…

Tactile perception is essential for human interaction with the environment and is becoming increasingly crucial in robotics. Tactile sensors like the BioTac mimic human fingertips and provide detailed interaction data. Despite its utility…

Robotics · Computer Science 2026-04-29 Wadhah Zai El Amri , Malte Kuhlmann , Nicolás Navarro-Guerrero

Tactile sensing is critical in advanced interactive systems by emulating the human sense of touch to detect stimuli. Vision-based tactile sensors are promising for providing multimodal capabilities and high robustness, yet existing…

Robotics · Computer Science 2025-04-07 Mayue Shi , Yongqi Zhang , Xiaotong Guo , Eric M. Yeatman

The sense of touch is essential for reliable mapping between the environment and a robot which interacts physically with objects. Presumably, an artificial tactile skin would facilitate safe interaction of the robots with the environment.…

The importance of force perception in interacting with the environment was proven years ago. However, it is still a challenge to measure the contact force distribution accurately in real-time. In order to break through this predicament, we…

Robotics · Computer Science 2022-02-15 Lunwei Zhang , Yue Wang , Yao Jiang

Simulating optical tactile sensors presents significant challenges due to their high deformability and intricate optical properties. To address these issues and enable a physically accurate simulation, we propose DOT-Sim: Differentiable…

Robotics · Computer Science 2026-05-01 Yang You , Won Kyung Do , Aiden Swann , Rika Antonova , Monroe Kennedy , Leonidas Guibas

Distributed tactile sensing for multi-force detection is crucial for various aerial robot interaction tasks. However, current contact sensing solutions on drones only exploit single end-effector sensors and cannot provide distributed…

Robotics · Computer Science 2024-10-28 Emanuele Aucone , Carmelo Sferrazza , Manuel Gregor , Raffaello D'Andrea , Stefano Mintchev

Vision-based tactile sensors (VBTSs) provide high-resolution tactile images crucial for robot in-hand manipulation. However, force sensing in VBTSs is underutilized due to the costly and time-intensive process of acquiring paired tactile…

Robotics · Computer Science 2025-02-27 Zhuo Chen , Ni Ou , Xuyang Zhang , Shan Luo

Camera-based tactile sensors are emerging as a promising inexpensive solution for tactile-enhanced manipulation tasks. A recently introduced FingerVision sensor was shown capable of generating reliable signals for force estimation, object…