English
Related papers

Related papers: ACROSS: A Deformation-Based Cross-Modal Representa…

200 papers

Tactile sensing plays a crucial role in robot grasping and manipulation by providing essential contact information between the robot and the environment. In this paper, we present AllTact Fin Ray, a novel compliant gripper design with…

Robotics · Computer Science 2025-04-28 Siwei Liang , Yixuan Guan , Jing Xu , Hongyu Qian , Xiangjun Zhang , Dan Wu , Wenbo Ding , Rui Chen

In this paper, we present the design and benchmark of an innovative sensor, ViTacTip, which fulfills the demand for advanced multi-modal sensing in a compact design. A notable feature of ViTacTip is its transparent skin, which incorporates…

Robotics · Computer Science 2025-01-07 Dandan Zhang , Wen Fan , Jialin Lin , Haoran Li , Qingzheng Cong , Weiru Liu , Nathan F. Lepora , Shan Luo

Humans achieve stable and dexterous object manipulation by coordinating grasp forces across multiple fingers and palms, facilitated by a unified tactile memory system in the somatosensory cortex. This system encodes and stores tactile…

Reusing the tactile knowledge of some previously-explored objects helps us humans to easily recognize the tactual properties of new objects. In this master thesis, we enable arobotic arm equipped with multi-modal artificial skin, like…

Robotics · Computer Science 2018-07-04 Di Feng

Deep learning has the potential to have the impact on robot touch that it has had on robot vision. Optical tactile sensors act as a bridge between the subjects by allowing techniques from vision to be applied to touch. In this paper, we…

Robotics · Computer Science 2020-12-07 Nathan F. Lepora , Alex Church , Conrad De Kerckhove , Raia Hadsell , John Lloyd

Tactile sensing provides robots with rich feedback during manipulation, enabling a host of perception and controls capabilities. Here, we present a new open-source, vision-based tactile sensor designed to promote reproducibility and…

Robotics · Computer Science 2024-10-01 Andrea Sipos , William van den Bogert , Nima Fazeli

Perception using whisker-inspired tactile sensors currently faces a major challenge: the lack of active control in robots based on direct contact information from the whisker. To accurately reconstruct object contours, it is crucial for the…

The tactile sensation of clothing is critical to wearer comfort. To reveal physical properties that make clothing comfortable, systematic collection of tactile data during sliding motion is required. We propose a robotic arm-based system…

Robotics · Computer Science 2025-11-18 Michikuni Eguchi , Takekazu Kitagishi , Yuichi Hiroi , Takefumi Hiraki

Tactile sensors play a crucial role in enabling robots to interact effectively and safely with objects in everyday tasks. In particular, visuotactile sensors have seen increasing usage in two and three-fingered grippers due to their…

Robotics · Computer Science 2024-10-22 Yifan Wu , Yuzhou Chen , Zhengying Zhu , Xuhao Qin , Chenxi Xiao

Electrical Impedance Tomography (EIT) offers a promising solution for distributed tactile sensing with minimal wiring and full-surface coverage in robotic applications. However, EIT-based tactile sensors face significant challenges during…

Robotics · Computer Science 2025-09-03 Haofeng Chen , Bedrich Himmel , Bin Li , Xiaojie Wang , Matej Hoffmann

Tactile sensing is crucial for achieving human-level robotic capabilities in manipulation tasks. As a promising solution, Vision-Based Tactile Sensors (VBTSs) offer high spatial resolution and cost-effectiveness, but present unique…

Robotics · Computer Science 2025-09-15 Yuyang Li , Wenxin Du , Chang Yu , Puhao Li , Zihang Zhao , Tengyu Liu , Chenfanfu Jiang , Yixin Zhu , Siyuan Huang

Training machine learning models for robotic tactile sensing requires vast amounts of data, yet obtaining realistic interaction data remains a challenge due to physical complexity and variability. Simulating tactile sensors is thus a…

Robotics · Computer Science 2026-04-28 Wadhah Zai El Amri , Nicolás Navarro-Guerrero

Tactile sensing is one of the modalities humans rely on heavily to perceive the world. Working with vision, this modality refines local geometry structure, measures deformation at the contact area, and indicates the hand-object contact…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Wenqiang Xu , Zhenjun Yu , Han Xue , Ruolin Ye , Siqiong Yao , Cewu Lu

We present a tactile sensing method enabled by the mechanical compliance of soft robots; an externally attachable photoreflective module reads surface deformation of silicone skin to estimate contact force without embedding tactile…

Vision-Based Tactile Sensors (VBTS) are essential for achieving dexterous robotic manipulation, yet the tactile sim-to-real gap remains a fundamental bottleneck. Current tactile simulations suffer from a persistent dilemma: simplified…

Robotics · Computer Science 2026-05-13 Lei Su , Zhijie Peng , Renyuan Ren , Shengping Mao , Juan Du , Kaifeng Zhang , Xuezhou Zhu

Simulation is widely used in robotics for system verification and large-scale data collection. However, simulating sensors, including tactile sensors, has been a long-standing challenge. In this paper, we propose Taxim, a realistic and…

Robotics · Computer Science 2021-12-15 Zilin Si , Wenzhen Yuan

Tactile sensing is essential for dexterous manipulation, yet large-scale human demonstration datasets lack tactile feedback, limiting their effectiveness in skill transfer to robots. To address this, we introduce TacCap, a wearable Fiber…

Achieving robust dexterous manipulation in unstructured domestic environments remains a significant challenge in robotics. Even with state-of-the-art robot learning methods, haptic-oblivious control strategies (i.e. those relying only on…

Robotics · Computer Science 2025-04-29 Jialiang Zhao , Naveen Kuppuswamy , Siyuan Feng , Benjamin Burchfiel , Edward Adelson

Dexterous manipulation is a cornerstone capability for robotic systems aiming to interact with the physical world in a human-like manner. Although vision-based methods have advanced rapidly, tactile sensing remains crucial for fine-grained…

Robotics · Computer Science 2026-05-14 Liang Heng , Haoran Geng , Kaifeng Zhang , Pieter Abbeel , Jitendra Malik

Human demonstrations collected by wearable devices (e.g., tactile gloves) provide fast and dexterous supervision for policy learning, and are guided by rich, natural tactile feedback. However, a key challenge is how to transfer…