English
Related papers

Related papers: Tactile Beyond Pixels: Multisensory Touch Represen…

200 papers

Tactile sensing is an essential perception for robots to complete dexterous tasks. As a promising tactile sensing technique, vision-based tactile sensors have been developed to improve robot performance in manipulation and grasping. Here we…

Robotics · Computer Science 2022-06-01 Guanlan Zhang , Yipai Du , Hongyu Yu , Michael Yu Wang

Robotics research has long sought to give robots the ability to perceive the physical world through touch in an analogous manner to many biological systems. Developing such tactile capabilities is important for numerous emerging…

Robotics · Computer Science 2025-08-18 Shan Luo , Nathan F. Lepora , Wenzhen Yuan , Kaspar Althoefer , Gordon Cheng , Ravinder Dahiya

In this work, we propose a novel method to supervise 3D Gaussian Splatting (3DGS) scenes using optical tactile sensors. Optical tactile sensors have become widespread in their use in robotics for manipulation and object representation;…

Robotics · Computer Science 2024-08-19 Aiden Swann , Matthew Strong , Won Kyung Do , Gadiel Sznaier Camps , Mac Schwager , Monroe Kennedy

High-resolution tactile sensing can provide accurate information about local contact in contact-rich robotic tasks. However, the deployment of such tasks in unstructured environments remains under-investigated. To improve the robustness of…

Robotics · Computer Science 2023-08-03 Yijiong Lin , Mauro Comi , Alex Church , Dandan Zhang , Nathan F. Lepora

The user's palm plays an important role in object detection and manipulation. The design of a robust multi-contact tactile display must consider the sensation and perception of of the stimulated area aiming to deliver the right stimuli at…

Human-Computer Interaction · Computer Science 2020-06-23 Miguel Altamirano Cabrera , Juan Heredia , Dzmitry Tsetserukou

Estimating human pose, classifying actions, and predicting movement progress are essential for human-robot interaction. While vision-based methods suffer from occlusion and privacy concerns in realistic environments, tactile sensing avoids…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Isaac Han , Seoyoung Lee , Sangyeon Park , Ecehan Akan , Yiyue Luo , Joseph DelPreto , Kyung-Joong Kim

Tactile sensing in biological organisms is deeply intertwined with morphological form, such as human fingers, cat paws, and elephant trunks, which enables rich and adaptive interactions through a variety of geometrically complex structures.…

Touch holds a pivotal position in enhancing the perceptual and interactive capabilities of both humans and robots. Despite its significance, current tactile research mainly focuses on visual and tactile modalities, overlooking the language…

Robotics · Computer Science 2024-06-07 Ning Cheng , Changhao Guan , Jing Gao , Weihao Wang , You Li , Fandong Meng , Jie Zhou , Bin Fang , Jinan Xu , Wenjuan Han

Research on tactile sensing has been progressing at constant pace. In robotics, tactile sensing is typically studied in the context of object grasping and manipulation. In this domain, the development of robust, multi-modal, tactile sensors…

Robotics · Computer Science 2022-06-29 Lorenzo Natale , Giorgio Cannata

Tactile feedback is critical for understanding the dynamics of both rigid and deformable objects in many manipulation tasks, such as non-prehensile manipulation and dense packing. We introduce an approach that combines visual and tactile…

Robotics · Computer Science 2024-07-02 Bo Ai , Stephen Tian , Haochen Shi , Yixuan Wang , Cheston Tan , Yunzhu Li , Jiajun Wu

Tactile perception is essential for human interaction with the environment and is becoming increasingly crucial in robotics. Tactile sensors like the BioTac mimic human fingertips and provide detailed interaction data. Despite its utility…

Robotics · Computer Science 2024-10-21 Wadhah Zai El Amri , Malte Kuhlmann , Nicolás Navarro-Guerrero

This paper aims to show that robots equipped with a vision-based tactile sensor can perform dynamic manipulation tasks without prior knowledge of all the physical attributes of the objects to be manipulated. For this purpose, a robotic…

Robotics · Computer Science 2021-05-07 Thomas Bi , Carmelo Sferrazza , Raffaello D'Andrea

Tactile sensors have been developed since the early '70s and have greatly improved, but there are still no widely adopted solutions. Various technologies, such as capacitive, piezoelectric, piezoresistive, optical, and magnetic, are used in…

Robotics · Computer Science 2026-04-29 Oscar Alberto Juiña Quilachamín , Nicolás Navarro-Guerrero

Vision-based tactile sensors, through high-resolution optical measurements, can effectively perceive the geometric shape of objects and the force information during the contact process, thus helping robots acquire higher-dimensional tactile…

Robotics · Computer Science 2026-03-06 Xi Lin , Weiliang Xu , Yixian Mao , Jing Wang , Meixuan Lv , Lu Liu , Xihui Luo , Xinming Li

Objects we interact with and manipulate often share similar parts, such as handles, that allow us to transfer our actions flexibly due to their shared functionality. This work addresses the problem of transferring a grasp experience or a…

Robotics · Computer Science 2023-08-21 Ahmet Tekden , Marc Peter Deisenroth , Yasemin Bekiroglu

This article illustrates the application of deep learning to robot touch by considering a basic yet fundamental capability: estimating the relative pose of part of an object in contact with a tactile sensor. We begin by surveying deep…

Robotics · Computer Science 2020-03-31 Nathan F. Lepora , John Lloyd

Tactile sensing is critical in advanced interactive systems by emulating the human sense of touch to detect stimuli. Vision-based tactile sensors are promising for providing multimodal capabilities and high robustness, yet existing…

Robotics · Computer Science 2025-04-07 Mayue Shi , Yongqi Zhang , Xiaotong Guo , Eric M. Yeatman

Tactile feedback is generally recognized to be crucial for effective interaction with the physical world. However, state-of-the-art Vision-Language-Action (VLA) models lack the ability to interpret and use tactile signals, limiting their…

Robotics · Computer Science 2025-07-30 Jianxin Bi , Kevin Yuchen Ma , Ce Hao , Mike Zheng Shou , Harold Soh

Despite significant advances in touch and force transduction, tactile sensing is still far from ubiquitous in robotic manipulation. Existing methods for building touch sensors have proven difficult to integrate into robot fingers due to…

Robotics · Computer Science 2020-04-03 Pedro Piacenza , Keith Behrman , Benedikt Schifferer , Ioannis Kymissis , Matei Ciocarlie

Real-world contact-rich manipulation demands robots to perceive temporal tactile feedback, capture subtle surface deformations, and reason about object properties as well as force dynamics. Although optical tactile sensors are uniquely…

Robotics · Computer Science 2026-02-11 Ruoxuan Feng , Yuxuan Zhou , Siyu Mei , Dongzhan Zhou , Pengwei Wang , Shaowei Cui , Bin Fang , Guocai Yao , Di Hu