English
Related papers

Related papers: Sim-to-Real for Robotic Tactile Sensing via Physic…

200 papers

Simulation is a widely used tool in robotics to reduce hardware consumption and gather large-scale data. Despite previous efforts to simulate optical tactile sensors, there remain challenges in efficiently synthesizing images and…

Robotics · Computer Science 2024-05-02 Yongqiang Zhao , Kun Qian , Boyi Duan , Shan Luo

Tactile sensing is vital for human dexterous manipulation, however, it has not been widely used in robotics. Compact, low-cost sensing platforms can facilitate a change, but unlike their popular optical counterparts, they are difficult to…

Robotics · Computer Science 2025-03-10 Adrian Röfer , Nick Heppert , Abdallah Ayad , Eugenio Chisari , Abhinav Valada

Tactile and visual perception are both crucial for humans to perform fine-grained interactions with their environment. Developing similar multi-modal sensing capabilities for robots can significantly enhance and expand their manipulation…

Robotics · Computer Science 2025-01-08 Binghao Huang , Yixuan Wang , Xinyi Yang , Yiyue Luo , Yunzhu Li

Collocated tactile sensing is a fundamental enabling technology for dexterous manipulation. However, deformable sensors introduce complex dynamics between the robot, grasped object, and environment that must be considered for fine…

Robotics · Computer Science 2022-09-28 Miquel Oller , Mireia Planas , Dmitry Berenson , Nima Fazeli

Tactile sensing is fundamental to robotic systems, enabling interactions through physical contact in multiple tasks. Despite its importance, achieving high-resolution, large-area tactile sensing remains challenging. Electrical Impedance…

Robotics · Computer Science 2025-09-18 Huazhi Dong , Ronald B. Liu , Sihao Teng , Delin Hu , Peisan , E , Francesco Giorgio-Serchi , Yunjie Yang

Simulating tactile perception could potentially leverage the learning capabilities of robotic systems in manipulation tasks. However, the reality gap of simulators for high-resolution tactile sensors remains large. Models trained on…

Robotics · Computer Science 2024-01-31 Osher Azulay , Alon Mizrahi , Nimrod Curtis , Avishai Sintov

Tactile sensing is crucial for achieving human-level robotic capabilities in manipulation tasks. As a promising solution, Vision-Based Tactile Sensors (VBTSs) offer high spatial resolution and cost-effectiveness, but present unique…

Robotics · Computer Science 2025-09-15 Yuyang Li , Wenxin Du , Chang Yu , Puhao Li , Zihang Zhao , Tengyu Liu , Chenfanfu Jiang , Yixin Zhu , Siyuan Huang

Deformable object manipulation is a classical and challenging research area in robotics. Compared with rigid object manipulation, this problem is more complex due to the deformation properties including elastic, plastic, and elastoplastic…

Tactile sensing has seen a rapid adoption with the advent of vision-based tactile sensors. Vision-based tactile sensors provide high resolution, compact and inexpensive data to perform precise in-hand manipulation and human-robot…

Robotics · Computer Science 2021-07-26 Arpit Agarwal , Tim Man , Wenzhen Yuan

The tactile sensing capabilities of human hands are essential in performing daily activities. Simultaneously perceiving normal and shear forces via the mechanoreceptors integrated into the hands enables humans to achieve daily tasks like…

Robotics · Computer Science 2022-06-20 Zeyu Lu , Xingyu Gao , Haoyong Yu

Training machine learning models for robotic tactile sensing requires vast amounts of data, yet obtaining realistic interaction data remains a challenge due to physical complexity and variability. Simulating tactile sensors is thus a…

Robotics · Computer Science 2026-04-28 Wadhah Zai El Amri , Nicolás Navarro-Guerrero

Tactile sensing for robotics is achieved through a variety of mechanisms, including magnetic, optical-tactile, and conductive fluid. Currently, the fluid-based sensors have struck the right balance of anthropomorphic sizes and shapes and…

The advent of tactile sensors in robotics has sparked many ideas on how robots can leverage direct contact measurements of their environment interactions to improve manipulation tasks. An important line of research in this regard is that of…

Robotics · Computer Science 2023-11-14 Luca Lach , Robert Haschke , Davide Tateo , Jan Peters , Helge Ritter , Júlia Borràs , Carme Torras

Bimanual manipulation with tactile feedback will be key to human-level robot dexterity. However, this topic is less explored than single-arm settings, partly due to the availability of suitable hardware along with the complexity of…

Robotics · Computer Science 2023-07-14 Yijiong Lin , Alex Church , Max Yang , Haoran Li , John Lloyd , Dandan Zhang , Nathan F. Lepora

Humans display the remarkable ability to sense the world through tools and other held objects. For example, we are able to pinpoint impact locations on a held rod and tell apart different textures using a rigid probe. In this work, we…

Skin-like tactile sensors provide robots with rich feedback related to the force distribution applied to their soft surface. The complexity of interpreting raw tactile information has driven the use of machine learning algorithms to convert…

Robotics · Computer Science 2019-12-12 Carmelo Sferrazza , Adam Wahlsten , Camill Trueeb , Raffaello D'Andrea

Robot skill acquisition processes driven by reinforcement learning often rely on simulations to efficiently generate large-scale interaction data. However, the absence of simulation models for tactile sensors has hindered the use of tactile…

Robotics · Computer Science 2025-09-15 Xiyan Huang , Zhe Xu , Chenxi Xiao

Tactile sensing plays a fundamental role in enabling robots to navigate dynamic and unstructured environments, particularly in applications such as delicate object manipulation, surface exploration, and human-robot interaction. In this…

Robotics · Computer Science 2025-09-18 Annan Zhang , Miguel Flores-Acton , Andy Yu , Anshul Gupta , Maggie Yao , Daniela Rus

Camera-based tactile sensors provide robots with a high-performance tactile sensing approach for environment perception and dexterous manipulation. However, achieving comprehensive environmental perception still requires cooperation with…

Robotics · Computer Science 2025-04-15 Yueshi Dong , Jieji Ren , Zhenle Liu , Zhanxuan Peng , Zihao Yuan , Ningbin Zhang , Guoying Gu

Vision based and event based tactile sensors are important in robotic manipulation research. However, they suffer from a fundamental tradeoff: vision based sensors have low sampling rates, while event based sensors are prone to drift during…

Image and Video Processing · Electrical Eng. & Systems 2026-05-19 Yihang Li , Yijin Chen , Junkai Xu , Na Ningguta , Peter B. Shull , Shuo Jiang , Bin He