English
Related papers

Related papers: Simulation of Vision-based Tactile Sensors using P…

200 papers

The potential of large tactile arrays to improve robot perception for safe operation in human-dominated environments and of high-resolution tactile arrays to enable human-level dexterous manipulation is well accepted. However, the increase…

Robotics · Computer Science 2017-05-16 Brayden Hollis , Stacy Patterson , Jeff Trinkle

Tactile sensing is a crucial perception mode for robots and human amputees in need of controlling a prosthetic device. Today robotic and prosthetic systems are still missing the important feature of accurate tactile sensing. This lack is…

Robotics · Computer Science 2022-03-30 Xiaying Wang , Fabian Geiger , Vlad Niculescu , Michele Magno , Luca Benini

Inspecting large-scale industrial surfaces like aircraft fuselages for quality control requires capturing their precise 3D surface geometry at high resolution. Vision-based tactile sensors (VBTSs) offer high local resolution but require…

While autonomous Uncrewed Aerial Vehicles (UAVs) have grown rapidly, most applications only focus on passive visual tasks. Aerial interaction aims to execute tasks involving physical interactions, which offers a way to assist humans in…

Robotics · Computer Science 2023-10-03 Xiaofeng Guo , Guanqi He , Mohammadreza Mousaei , Junyi Geng , Guanya Shi , Sebastian Scherer

Vision-based tactile sensors that can measure 3D geometry of the contacting objects are crucial for robots to perform dexterous manipulation tasks. However, the existing sensors are usually complicated to fabricate and delicate to extend.…

Robotics · Computer Science 2022-09-29 Changyi Lin , Ziqi Lin , Shaoxiong Wang , Huazhe Xu

In this paper, we address the Sim2Real gap in the field of vision-based tactile sensors for classifying object surfaces. We train a Diffusion Model to bridge this gap using a relatively small dataset of real-world images randomly collected…

Tactile perception is an essential ability of intelligent robots in interaction with their surrounding environments. This perception as an intermediate level acts between sensation and action and has to be defined properly to generate…

Robotics · Computer Science 2019-07-24 Masoud Baghbahari , Aman Behal

Tactile sensing can enable robots to perform complex, contact-rich tasks. Magnetic sensors offer accurate three-axis force measurements while using affordable materials. Calibrating such a sensor involves either manual data collection, or…

Robotics · Computer Science 2024-05-30 Lowiek Van den Stockt , Remko Proesmans , Francis wyffels

Contact-rich manipulation remains a major challenge in robotics. Optical tactile sensors like GelSight Mini offer a low-cost solution for contact sensing by capturing soft-body deformations of the silicone gel. However, accurately inferring…

Robotics · Computer Science 2026-01-14 Erik Helmut , Luca Dziarski , Niklas Funk , Boris Belousov , Jan Peters

Tactile sensing is critical for humans to perform everyday tasks. While significant progress has been made in analyzing object grasping from vision, it remains unclear how we can utilize tactile sensing to reason about and model the…

Tactile sensing plays a key role in robotic manipulation, particularly in tasks like surface inspection. Successful execution requires maintaining contact while accurately tracking object contours. In this work, we propose a Vision-Based…

Robotics · Computer Science 2026-05-21 Edison Velasco-Sanchez , Luis F. Recalde , Guanrui Li , Pablo Gil

Tactile sensors are breaking into the field of robotics to provide direct information related to contact surfaces, including contact events, slip events and even texture identification. These events are especially important for robotic hand…

Robotics · Computer Science 2026-01-16 Eszter Birtalan , Miklós Koller

We propose an optical tactile sensor using self-healing materials. The proposed tactile sensor consists of a structure that includes a diode, a phototransistor, and an optical waveguide made from self-healing materials. This design offers…

Human-Computer Interaction · Computer Science 2024-11-11 Seiichi Yamamoto , Hiroki Ishizuka , Sei Ikeda , Osamu Oshiro

Robotic manipulation requires both rich multimodal perception and effective learning frameworks to handle complex real-world tasks. See-through-skin (STS) sensors, which combine tactile and visual perception, offer promising sensing…

Robotics · Computer Science 2026-02-10 Yuyang Li , Yinghan Chen , Zihang Zhao , Puhao Li , Tengyu Liu , Siyuan Huang , Yixin Zhu

Recently simulation methods have been developed for optical tactile sensors to enable the Sim2Real learning, i.e., firstly training models in simulation before deploying them on the real robot. However, some artefacts in the real objects…

Robotics · Computer Science 2021-12-06 Tudor Jianu , Daniel Fernandes Gomes , Shan Luo

The development of tactile sensing and its fusion with computer vision is expected to enhance robotic systems in handling complex tasks like deformable object manipulation. However, readily available industrial grippers typically lack…

Robotics · Computer Science 2023-06-12 Remko Proesmans , Francis wyffels

Coordinating proximity and tactile imaging by collocating cameras with tactile sensors can 1) provide useful information before contact such as object pose estimates and visually servo a robot to a target with reduced occlusion and higher…

Robotics · Computer Science 2022-04-29 Arkadeep Narayan Chaudhury , Timothy Man , Wenzhen Yuan , Christopher G. Atkeson

Much of the literature on robotic perception focuses on the visual modality. Vision provides a global observation of a scene, making it broadly useful. However, in the domain of robotic manipulation, vision alone can sometimes prove…

Robotics · Computer Science 2019-03-11 Justin Lin , Roberto Calandra , Sergey Levine

We present a tactile sensing method enabled by the mechanical compliance of soft robots; an externally attachable photoreflective module reads surface deformation of silicone skin to estimate contact force without embedding tactile…

Past research has widely explored the design and fabrication of resistive matrix-based tactile sensors as a means of creating touch-sensitive devices. However, developing portable, adaptive, and long-lasting tactile sensing systems that…

Human-Computer Interaction · Computer Science 2025-04-25 Devin Murphy , Junyi Zhu , Paul Pu Liang , Wojciech Matusik , Yiyue Luo