English
Related papers

Related papers: Simulation of Vision-based Tactile Sensors using P…

200 papers

This paper introduces a new type of system for fabric defect detection with the tactile inspection system. Different from existed visual inspection systems, the proposed system implements a vision-based tactile sensor. The tactile sensor,…

Robotics · Computer Science 2023-01-18 Bin Fang , Xingming Long , Yifan Zhang , GuoYi Luo , Fuchun Sun , Huaping Liu

Tactile representation learning (TRL) equips robots with the ability to leverage touch information, boosting performance in tasks such as environment perception and object manipulation. However, the heterogeneity of tactile sensors results…

Robotics · Computer Science 2023-05-02 Ben Zandonati , Ruohan Wang , Ruihan Gao , Yan Wu

Tactile perception is essential for real-world manipulation tasks, yet the high cost and fragility of tactile sensors can limit their practicality. In this work, we explore BeadSight (a low-cost, open-source tactile sensor) alongside a…

Robotics · Computer Science 2025-03-14 Selam Gano , Abraham George , Amir Barati Farimani

Today's tactile sensors have a variety of different designs, making it challenging to develop general-purpose methods for processing touch signals. In this paper, we learn a unified representation that captures the shared information…

Today's touch sensors come in many shapes and sizes. This has made it challenging to develop general-purpose touch processing methods since models are generally tied to one specific sensor design. We address this problem by performing…

Robotics · Computer Science 2024-09-13 Samanta Rodriguez , Yiming Dou , Miquel Oller , Andrew Owens , Nima Fazeli

In recent years, advancements in optical tactile sensor technology have primarily centred on enhancing sensing precision and expanding the range of sensing modalities. To meet the requirements for more skilful manipulation, there should be…

Robotics · Computer Science 2025-02-04 Xuyang Zhang , Jiaqi Jiang , Shan Luo

This paper describes the design of a multi-camera optical tactile sensor that provides information about the contact force distribution applied to its soft surface. This information is contained in the motion of spherical particles spread…

Robotics · Computer Science 2020-06-24 Camill Trueeb , Carmelo Sferrazza , Raffaello D'Andrea

While visuomotor policy learning has advanced robotic manipulation, precisely executing contact-rich tasks remains challenging due to the limitations of vision in reasoning about physical interactions. To address this, recent work has…

Robotics · Computer Science 2024-10-29 Venkatesh Pattabiraman , Yifeng Cao , Siddhant Haldar , Lerrel Pinto , Raunaq Bhirangi

We study the problem of using high-resolution tactile sensors to control the insertion of objects in a box-packing scenario. We propose a new system based on a tactile sensor GelSlim for the dense packing task. In this paper, we propose an…

Robotics · Computer Science 2019-09-13 Siyuan Dong , Alberto Rodriguez

To assist robots in teleoperation tasks, haptic rendering which allows human operators access a virtual touch feeling has been developed in recent years. Most previous haptic rendering methods strongly rely on data collected by tactile…

Robotics · Computer Science 2023-01-18 Guanqun Cao , Jiaqi Jiang , Ningtao Mao , Danushka Bollegala , Min Li , Shan Luo

Reinforcement Learning (RL) methods have been widely applied for robotic manipulations via sim-to-real transfer, typically with proprioceptive and visual information. However, the incorporation of tactile sensing into RL for contact-rich…

Robotics · Computer Science 2021-07-28 Zihan Ding , Ya-Yen Tsai , Wang Wei Lee , Bidan Huang

This work deals with a practical everyday problem: stable object placement on flat surfaces starting from unknown initial poses. Common object-placing approaches require either complete scene specifications or extrinsic sensor measurements,…

Using tactile sensors for manipulation remains one of the most challenging problems in robotics. At the heart of these challenges is generalization: How can we train a tactile-based policy that can manipulate unseen and diverse objects? In…

Robotics · Computer Science 2024-03-20 Entong Su , Chengzhe Jia , Yuzhe Qin , Wenxuan Zhou , Annabella Macaluso , Binghao Huang , Xiaolong Wang

The majority of artificial intelligence research, as it relates from which to biological senses has been focused on vision. The recent explosion of machine learning and in particular, dee p learning, can be partially attributed to the…

Artificial Intelligence · Computer Science 2018-01-03 Jason Toy

This work details the design of a novel two finger robot gripper with multiple Gelsight based optical-tactile sensors covering the inner surface of the hand. The multiple Gelsight sensors can gather the surface topology of the object from…

Robotics · Computer Science 2020-02-10 Achu Wilson , Shaoxiong Wang , Branden Romero , Edward Adelson

This paper presents a novel framework for integration of vision and tactile sensing by localizing tactile readings in a visual object map. Intuitively, there are some correspondences, e.g., prominent features, between visual and tactile…

Robotics · Computer Science 2017-08-16 Shan Luo , Wenxuan Mou , Kaspar Althoefer , Hongbin Liu

Vision-based tactile sensing has been widely used in perception, reconstruction, and robotic manipulation. However, collecting large-scale tactile data remains costly due to the localized nature of sensor-object interactions and…

Computer Vision and Pattern Recognition · Computer Science 2025-05-29 Dongyu Luo , Kelin Yu , Amir-Hossein Shahidzadeh , Cornelia Fermüller , Yiannis Aloimonos , Ruohan Gao

Optical tactile sensing holds transformative potential for robotics, particularly in collaborative environments where touch perception enhances safety, adaptability, and cognitive interaction. However, traditional tactile technologies based…

Tactile perception is essential for human interaction with the environment and is becoming increasingly crucial in robotics. Tactile sensors like the BioTac mimic human fingertips and provide detailed interaction data. Despite its utility…

Robotics · Computer Science 2024-10-21 Wadhah Zai El Amri , Malte Kuhlmann , Nicolás Navarro-Guerrero

We address the problem of tactile localization, where the goal is to identify image regions that share the same material properties as a tactile input. Existing visuo-tactile methods rely on global alignment and thus fail to capture the…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Seongyu Kim , Seungwoo Lee , Hyeonggon Ryu , Joon Son Chung , Arda Senocak