English
Related papers

Related papers: Transfer learning for vision-based tactile sensing

200 papers

In this paper, a novel tactile sensing mechanism for soft robotic fingers is proposed. Inspired by the proprioception mechanism found in mammals, the proposed approach infers tactile information from a strain sensor attached on the finger's…

Robotics · Computer Science 2021-07-07 Chang Cheng , Yadong Yan , Mingjun Guan , Jianan Zhang , Yu Wang

Robotics research has long sought to give robots the ability to perceive the physical world through touch in an analogous manner to many biological systems. Developing such tactile capabilities is important for numerous emerging…

Robotics · Computer Science 2025-08-18 Shan Luo , Nathan F. Lepora , Wenzhen Yuan , Kaspar Althoefer , Gordon Cheng , Ravinder Dahiya

Tactile sensing is a widely-studied means of implicit communication between robot and human. In this paper, we investigate how tactile sensing can help bridge differences between robotic embodiments in the context of collaborative…

Robotics · Computer Science 2025-09-17 William van den Bogert , Madhavan Iyengar , Nima Fazeli

The potential of large tactile arrays to improve robot perception for safe operation in human-dominated environments and of high-resolution tactile arrays to enable human-level dexterous manipulation is well accepted. However, the increase…

Robotics · Computer Science 2017-05-16 Brayden Hollis , Stacy Patterson , Jeff Trinkle

Tactile sensing represents a crucial technique that can enhance the performance of robotic manipulators in various tasks. This work presents a novel bioinspired neuromorphic vision-based tactile sensor that uses an event-based camera to…

Robotics · Computer Science 2024-03-18 Omar Faris , Mohammad I. Awad , Murana A. Awad , Yahya Zweiri , Kinda Khalaf

The potential of large tactile arrays to improve robot perception for safe operation in human-dominated environments and of high-resolution tactile arrays to enable human-level dexterous manipulation is well accepted. However, the increase…

Robotics · Computer Science 2016-09-27 Brayden Hollis , Stacy Patterson , Jeff Trinkle

Collocated tactile sensing is a fundamental enabling technology for dexterous manipulation. However, deformable sensors introduce complex dynamics between the robot, grasped object, and environment that must be considered for fine…

Robotics · Computer Science 2022-09-28 Miquel Oller , Mireia Planas , Dmitry Berenson , Nima Fazeli

Research on tactile sensing has been progressing at constant pace. In robotics, tactile sensing is typically studied in the context of object grasping and manipulation. In this domain, the development of robust, multi-modal, tactile sensors…

Robotics · Computer Science 2022-06-29 Lorenzo Natale , Giorgio Cannata

Tactile sensing is important for robots to perceive the world as it captures the texture and hardness of the object in contact and is robust to illumination and colour variances. However, due to the limited sensing area and the resistance…

Robotics · Computer Science 2021-03-02 Guanqun Cao , Jiaqi Jiang , Chen Lu , Daniel Fernandes Gomes , Shan Luo

We want to enable fine manipulation with a multi-fingered robotic hand by using modern deep reinforcement learning methods. Key for fine manipulation is a spatially resolved tactile sensor. Here, we present a novel model of a tactile skin…

Robotics · Computer Science 2024-09-20 Ulf Kasolowsky , Berthold Bäuml

Real-time prediction of deformation in highly compliant soft materials remains a significant challenge in soft robotics. While vision-based soft tactile sensors can track internal marker displacements, learning-based models for 3D contact…

Robotics · Computer Science 2026-02-24 Junhui Lee , Hyosung Kim , Saekwang Nam

Tactile perception is an essential ability of intelligent robots in interaction with their surrounding environments. This perception as an intermediate level acts between sensation and action and has to be defined properly to generate…

Robotics · Computer Science 2019-07-24 Masoud Baghbahari , Aman Behal

How are robots becoming smarter at interacting with their surroundings? Recent advances have reshaped how robots use tactile sensing to perceive and engage with the world. Tactile sensing is a game-changer, allowing robots to embed…

Robotics · Computer Science 2025-02-10 Enrico Donato , Matteo Lo Preti , Lucia Beccai , Egidio Falotico

As an integral part of contemporary manufacturing, monitoring systems obtain valuable information during machining to oversee the condition of both the process and the machine. Recently, diverse algorithms have been employed to detect tool…

Machine Learning · Computer Science 2024-10-10 Zongshuo Li , Markus Meurer , Thomas Bergs

This article illustrates the application of deep learning to robot touch by considering a basic yet fundamental capability: estimating the relative pose of part of an object in contact with a tactile sensor. We begin by surveying deep…

Robotics · Computer Science 2020-03-31 Nathan F. Lepora , John Lloyd

We present a tactile sensing method enabled by the mechanical compliance of soft robots; an externally attachable photoreflective module reads surface deformation of silicone skin to estimate contact force without embedding tactile…

This paper explores active sensing strategies that employ vision-based tactile sensors for robotic perception and classification of fabric textures. We formalize the active sampling problem in the context of tactile fabric recognition and…

High-resolution multi-modality information acquired by vision-based tactile sensors can support more dexterous manipulations for robot fingers. Optical flow is low-level information directly obtained by vision-based tactile sensors, which…

Computer Vision and Pattern Recognition · Computer Science 2023-09-14 Zhiyuan Zhang , Hua Yang , Zhouping Yin

Tactile information is important for gripping, stable grasp, and in-hand manipulation, yet the complexity of tactile data prevents widespread use of such sensors. We make use of an unsupervised learning algorithm that transforms the complex…

Robotics · Computer Science 2016-06-24 Maximilian Karl , Justin Bayer , Patrick van der Smagt

While visuomotor policy learning has advanced robotic manipulation, precisely executing contact-rich tasks remains challenging due to the limitations of vision in reasoning about physical interactions. To address this, recent work has…

Robotics · Computer Science 2024-10-29 Venkatesh Pattabiraman , Yifeng Cao , Siddhant Haldar , Lerrel Pinto , Raunaq Bhirangi