English
Related papers

Related papers: Sim-to-Real for Robotic Tactile Sensing via Physic…

200 papers

Tactile sensing is an important sensing modality for robot manipulation. Among different types of tactile sensors, magnet-based sensors, like u-skin, balance well between high durability and tactile density. However, the large sim-to-real…

Robotics · Computer Science 2025-05-07 Beining Han , Abhishek Joshi , Jia Deng

Developing artificial tactile sensing capabilities that rival human touch is a long-term goal in robotics and prosthetics. Gradually more elaborate biomimetic tactile sensors are being developed and applied to grasping and manipulation…

Robotics · Computer Science 2020-10-28 Benjamin Ward-Cherrier , Nicholas Pestell , Nathan F. Lepora

Recently simulation methods have been developed for optical tactile sensors to enable the Sim2Real learning, i.e., firstly training models in simulation before deploying them on the real robot. However, some artefacts in the real objects…

Robotics · Computer Science 2021-12-06 Tudor Jianu , Daniel Fernandes Gomes , Shan Luo

Tactile sensors are believed to be essential in robotic manipulation, and prior works often rely on experts to reason the sensor feedback and design a controller. With the recent advancement in data-driven approaches, complicated…

Robotics · Computer Science 2023-05-24 Ya-Yen Tsai , Bidan Huang , Yu Zheng , Lei Han , Wang Wei Lee , Edward Johns

Deep learning has the potential to have the impact on robot touch that it has had on robot vision. Optical tactile sensors act as a bridge between the subjects by allowing techniques from vision to be applied to touch. In this paper, we…

Robotics · Computer Science 2020-12-07 Nathan F. Lepora , Alex Church , Conrad De Kerckhove , Raia Hadsell , John Lloyd

For both humans and robots, the sense of touch, known as tactile sensing, is critical for performing contact-rich manipulation tasks. Three key challenges in robotic tactile sensing are 1) interpreting sensor signals, 2) generating sensor…

Robotics · Computer Science 2025-03-11 Iretiayo Akinola , Jie Xu , Jan Carius , Dieter Fox , Yashraj Narang

Developing robotic hands that adapt to real-world dynamics remains a fundamental challenge in robotics and machine intelligence. Despite significant advances in replicating human hand kinematics and control algorithms, robotic systems still…

To achieve a dexterous robotic manipulation, we need to endow our robot with tactile feedback capability, i.e. the ability to drive action based on tactile sensing. In this paper, we specifically address the challenge of tactile servoing,…

Simulation has recently become key for deep reinforcement learning to safely and efficiently acquire general and complex control policies from visual and proprioceptive inputs. Tactile information is not usually considered despite its…

Robotics · Computer Science 2021-11-02 Alex Church , John Lloyd , Raia Hadsell , Nathan F. Lepora

Tactile perception is important for robotic systems that interact with the world through touch. Touch is an active sense in which tactile measurements depend on the contact properties of an interaction--e.g., velocity, force,…

Robotics · Computer Science 2024-05-21 Jake Ketchum , Ahalya Prabhakar , Todd D. Murphey

Tactile sensing has proven to be an invaluable tool for enhancing robotic perception, particularly in scenarios where visual data is limited or unavailable. However, traditional methods for pose estimation using tactile data often rely on…

Robotics · Computer Science 2024-09-24 Jose A. Eyzaguirre , Miquel Oller , Nima Fazeli

The research aims to expand tactile feedback beyond vibrations to various modes of stimuli, such as indentation, vibration, among others. By incorporating soft material into the design of a novel tactile actuator, we can achieve…

Human-Computer Interaction · Computer Science 2024-11-11 Heeju Mun , Seunggyeom Jung , Seung Mo Jeong , David Santiago Diaz Cortes , Ki-Uk Kyung

High-fidelity physics simulation is essential for scalable robotic learning, but the sim-to-real gap persists, especially for tasks involving complex, dynamic, and discontinuous interactions like physical contacts. Explicit system…

Robotics · Computer Science 2026-01-21 Changwei Jing , Jai Krishna Bandi , Jianglong Ye , Yan Duan , Pieter Abbeel , Xiaolong Wang , Sha Yi

Tactile sensing is critical to fine-grained, contact-rich manipulation tasks, such as insertion and assembly. Prior research has shown the possibility of learning tactile-guided policy from teleoperated demonstration data. However, to…

Robotics · Computer Science 2025-02-07 Kelin Yu , Yunhai Han , Qixian Wang , Vaibhav Saxena , Danfei Xu , Ye Zhao

Tactile sensing has been used for a variety of robotic exploration and manipulation tasks but a common constraint is a requirement for a large amount of training data. This paper addresses the issue of data-efficiency by proposing a novel…

Robotics · Computer Science 2020-08-13 Elizabeth A. Stone , Nathan F. Lepora , David A. W. Barton

Research on tactile sensing has been progressing at constant pace. In robotics, tactile sensing is typically studied in the context of object grasping and manipulation. In this domain, the development of robust, multi-modal, tactile sensors…

Robotics · Computer Science 2022-06-29 Lorenzo Natale , Giorgio Cannata

Robotic grasping of 3D deformable objects (e.g., fruits/vegetables, internal organs, bottles/boxes) is critical for real-world applications such as food processing, robotic surgery, and household automation. However, developing grasp…

Reinforcement Learning (RL) methods have been widely applied for robotic manipulations via sim-to-real transfer, typically with proprioceptive and visual information. However, the incorporation of tactile sensing into RL for contact-rich…

Robotics · Computer Science 2021-07-28 Zihan Ding , Ya-Yen Tsai , Wang Wei Lee , Bidan Huang

Robots have been brought to work close to humans in many scenarios. For coexistence and collaboration, robots should be safe and pleasant for humans to interact with. To this end, the robots could be both physically soft with multimodal…

Robotics · Computer Science 2022-11-08 Quan Khanh Luu , Dinh Quang Nguyen , Nhan Huu Nguyen , Van Anh Ho

Legged locomotion benefits from embodied sensing, where perception emerges from the physical interaction between body and environment. We present a soft-surfaced, vision-based tactile foot sensor that endows a bipedal robot with a skin-like…

Robotics · Computer Science 2026-02-25 Jaeeun Kim , Junhee Lim , Yu She