English
Related papers

Related papers: Learning Tactile Insertion in the Real World

200 papers

This paper presents T3: Transferable Tactile Transformers, a framework for tactile representation learning that scales across multi-sensors and multi-tasks. T3 is designed to overcome the contemporary issue that camera-based tactile sensing…

Robotics · Computer Science 2024-10-08 Jialiang Zhao , Yuxiang Ma , Lirui Wang , Edward H. Adelson

Tactile sensors are breaking into the field of robotics to provide direct information related to contact surfaces, including contact events, slip events and even texture identification. These events are especially important for robotic hand…

Robotics · Computer Science 2026-01-16 Eszter Birtalan , Miklós Koller

Tactile sensing is a crucial perception mode for robots and human amputees in need of controlling a prosthetic device. Today robotic and prosthetic systems are still missing the important feature of accurate tactile sensing. This lack is…

Robotics · Computer Science 2022-03-30 Xiaying Wang , Fabian Geiger , Vlad Niculescu , Michele Magno , Luca Benini

Tactile sensors have been introduced to a wide range of robotic tasks such as robot manipulation to mimic the sense of human touch. However, there has only been a few works that integrate tactile sensing into robot navigation. This paper…

Robotics · Computer Science 2022-11-24 Zhen Hao Gan , Yangwei You , Meng Yee , Chuah

When humans perform complex insertion tasks such as pushing a cup into a cupboard, routing a cable, or putting a key in a lock, they wiggle the object and adapt the process through tactile feedback. A similar robotic approach has not been…

Humans rely on touch and tactile sensing for a lot of dexterous manipulation tasks. Our tactile sensing provides us with a lot of information regarding contact formations as well as geometric information about objects during any…

Robotics · Computer Science 2023-06-06 Kei Ota , Devesh K. Jha , Hsiao-Yu Tung , Joshua B. Tenenbaum

Tactile sensors can provide detailed contact in-formation that can facilitate robots to perform dexterous, in-hand manipulation tasks. One of the primitive but important tasks is surface following that is a key feature for robots while…

Robotics · Computer Science 2019-12-03 Chen Lu , Jing Wang , Shan Luo

Equipping multi-fingered robots with tactile sensing is crucial for achieving the precise, contact-rich, and dexterous manipulation that humans excel at. However, relying solely on tactile sensing fails to provide adequate cues for…

Robotics · Computer Science 2023-09-22 Irmak Guzey , Yinlong Dai , Ben Evans , Soumith Chintala , Lerrel Pinto

Bimanual manipulation with tactile feedback will be key to human-level robot dexterity. However, this topic is less explored than single-arm settings, partly due to the availability of suitable hardware along with the complexity of…

Robotics · Computer Science 2023-07-14 Yijiong Lin , Alex Church , Max Yang , Haoran Li , John Lloyd , Dandan Zhang , Nathan F. Lepora

Robust grasping represents an essential task in robotics, necessitating tactile feedback and reactive grasping adjustments for robust grasping of objects. Previous research has extensively combined tactile sensing with grasping, primarily…

Robotics · Computer Science 2024-11-22 Yueming Hu , Mengde Li , Songhua Yang , Xuetao Li , Sheng Liu , Miao Li

Can a robot grasp an unknown object without seeing it? In this paper, we present a tactile-sensing based approach to this challenging problem of grasping novel objects without prior knowledge of their location or physical properties. Our…

Robotics · Computer Science 2018-05-14 Adithyavairavan Murali , Yin Li , Dhiraj Gandhi , Abhinav Gupta

Tactile sensing presents a promising opportunity for enhancing the interaction capabilities of today's robots. BioTac is a commonly used tactile sensor that enables robots to perceive and respond to physical tactile stimuli. However, the…

Robotics · Computer Science 2026-04-29 Wadhah Zai El Amri , Nicolás Navarro-Guerrero

We investigate how high-resolution tactile sensors can be utilized in combination with vision and depth sensing, to improve grasp stability prediction. Recent advances in simulating high-resolution tactile sensing, in particular the TACTO…

Robotics · Computer Science 2022-06-14 Lachlan Chumbley , Morris Gu , Rhys Newbury , Jurgen Leitner , Akansel Cosgun

Rapid deployment of new tactile sensors is essential for scalable robotic manipulation, especially in multi-fingered hands equipped with vision-based tactile sensors. However, current methods for inferring contact properties rely heavily on…

Robotics · Computer Science 2026-04-02 Christopher J. Ford , Kaichen Shi , Laura Butcher , Nathan F. Lepora , Efi Psomopoulou

Deep learning has provided new ways of manipulating, processing and analyzing data. It sometimes may achieve results comparable to, or surpassing human expert performance, and has become a source of inspiration in the era of artificial…

This work presents a novel tactile perception-based method, named T-NT, for performing the needle-threading task, an application of deformable linear object (DLO) manipulation. This task is divided into two main stages: Tail-end Finding and…

Robotics · Computer Science 2023-11-07 Zhenjun Yu , Wenqiang Xu , Siqiong Yao , Jieji Ren , Tutian Tang , Yutong Li , Guoying Gu , Cewu Lu

Robot skill acquisition processes driven by reinforcement learning often rely on simulations to efficiently generate large-scale interaction data. However, the absence of simulation models for tactile sensors has hindered the use of tactile…

Robotics · Computer Science 2025-09-15 Xiyan Huang , Zhe Xu , Chenxi Xiao

Robotic manipulation requires both rich multimodal perception and effective learning frameworks to handle complex real-world tasks. See-through-skin (STS) sensors, which combine tactile and visual perception, offer promising sensing…

Robotics · Computer Science 2026-02-10 Yuyang Li , Yinghan Chen , Zihang Zhao , Puhao Li , Tengyu Liu , Siyuan Huang , Yixin Zhu

Palpation, the use of touch in medical examination, is almost exclusively performed by humans. We investigate a proof of concept for an artificial palpation method based on self-supervised learning. Our key idea is that an encoder-decoder…

Machine Learning · Computer Science 2025-11-21 Zohar Rimon , Elisei Shafer , Tal Tepper , Efrat Shimron , Aviv Tamar

Inspired by the human ability to perform complex manipulation in the complete absence of vision (like retrieving an object from a pocket), the robotic manipulation field is motivated to develop new methods for tactile-based object…

Robotics · Computer Science 2022-07-22 Jingxi Xu , Shuran Song , Matei Ciocarlie