English
Related papers

Related papers: Taccel: Scaling Up Vision-based Tactile Robotics v…

200 papers

Most current works in Sim2Real learning for robotic manipulation tasks leverage camera vision that may be significantly occluded by robot hands during the manipulation. Tactile sensing offers complementary information to vision and can…

Robotics · Computer Science 2021-01-19 Daniel Fernandes Gomes , Paolo Paoletti , Shan Luo

Visuotactile sensors provide high-resolution tactile information but are incapable of perceiving the material features of objects. We present UltraTac, an integrated sensor that combines visuotactile imaging with ultrasound sensing through…

Robotics · Computer Science 2025-09-01 Junhao Gong , Kit-Wa Sou , Shoujie Li , Changqing Guo , Yan Huang , Chuqiao Lyu , Ziwu Song , Wenbo Ding

Tactile and visual perception are both crucial for humans to perform fine-grained interactions with their environment. Developing similar multi-modal sensing capabilities for robots can significantly enhance and expand their manipulation…

Robotics · Computer Science 2025-01-08 Binghao Huang , Yixuan Wang , Xinyi Yang , Yiyue Luo , Yunzhu Li

While autonomous Uncrewed Aerial Vehicles (UAVs) have grown rapidly, most applications only focus on passive visual tasks. Aerial interaction aims to execute tasks involving physical interactions, which offers a way to assist humans in…

Robotics · Computer Science 2023-10-03 Xiaofeng Guo , Guanqi He , Mohammadreza Mousaei , Junyi Geng , Guanya Shi , Sebastian Scherer

Rapid deployment of new tactile sensors is essential for scalable robotic manipulation, especially in multi-fingered hands equipped with vision-based tactile sensors. However, current methods for inferring contact properties rely heavily on…

Robotics · Computer Science 2026-04-02 Christopher J. Ford , Kaichen Shi , Laura Butcher , Nathan F. Lepora , Efi Psomopoulou

Visuo-tactile sensors aim to emulate human tactile perception, enabling robots to precisely understand and manipulate objects. Over time, numerous meticulously designed visuo-tactile sensors have been integrated into robotic systems, aiding…

Machine Learning · Computer Science 2025-04-02 Ruoxuan Feng , Jiangyu Hu , Wenke Xia , Tianci Gao , Ao Shen , Yuhao Sun , Bin Fang , Di Hu

High-resolution tactile sensing can provide accurate information about local contact in contact-rich robotic tasks. However, the deployment of such tasks in unstructured environments remains under-investigated. To improve the robustness of…

Robotics · Computer Science 2023-08-03 Yijiong Lin , Mauro Comi , Alex Church , Dandan Zhang , Nathan F. Lepora

Tactile perception has the potential to significantly enhance dexterous robotic manipulation by providing rich local information that can complement or substitute for other sensory modalities such as vision. However, because tactile sensing…

Robotics · Computer Science 2025-06-17 Tim Schneider , Guillaume Duret , Cristiana de Farias , Roberto Calandra , Liming Chen , Jan Peters

Tactile sensors are believed to be essential in robotic manipulation, and prior works often rely on experts to reason the sensor feedback and design a controller. With the recent advancement in data-driven approaches, complicated…

Robotics · Computer Science 2023-05-24 Ya-Yen Tsai , Bidan Huang , Yu Zheng , Lei Han , Wang Wei Lee , Edward Johns

Tactile sensing on human feet is crucial for motion control, however, has not been explored in robotic counterparts. This work is dedicated to endowing tactile sensing to legged robot's feet and showing that a single-legged robot can be…

Robotics · Computer Science 2021-03-30 Guanlan Zhang , Yipai Du , Yazhan Zhan , Michael Yu Wang

Tactile sensing is critical in advanced interactive systems by emulating the human sense of touch to detect stimuli. Vision-based tactile sensors are promising for providing multimodal capabilities and high robustness, yet existing…

Robotics · Computer Science 2025-04-07 Mayue Shi , Yongqi Zhang , Xiaotong Guo , Eric M. Yeatman

In general, robotic dexterous hands are equipped with various sensors for acquiring multimodal contact information such as position, force, and pose of the grasped object. This multi-sensor-based design adds complexity to the robotic…

Robotics · Computer Science 2024-08-12 Weiliang Xu , Guoyuan Zhou , Yuanzhi Zhou , Zhibin Zou , Jiali Wang , Wenfeng Wu , Xinming Li

The importance of force perception in interacting with the environment was proven years ago. However, it is still a challenge to measure the contact force distribution accurately in real-time. In order to break through this predicament, we…

Robotics · Computer Science 2022-02-15 Lunwei Zhang , Yue Wang , Yao Jiang

With the development of embodied artificial intelligence, robotic research has increasingly focused on complex tasks. Existing simulation platforms, however, are often limited to idealized environments, simple task scenarios and lack data…

Robotics · Computer Science 2025-04-29 Zijie Zheng , Zeshun Li , Yunpeng Wang , Qinghongbing Xie , Long Zeng

Tactile sensing plays an important role in robotic perception and manipulation tasks. To overcome the real-world limitations of data collection, simulating tactile response in a virtual environment comes as a desirable direction of robotic…

Robotics · Computer Science 2021-08-21 Yikai Wang , Wenbing Huang , Bin Fang , Fuchun Sun , Chang Li

Due to the complexity of modeling the elastic properties of materials, the use of machine learning algorithms is continuously increasing for tactile sensing applications. Recent advances in deep neural networks applied to computer vision…

Robotics · Computer Science 2020-06-05 Carmelo Sferrazza , Raffaello D'Andrea

Tactile sensing provides robots with rich feedback during manipulation, enabling a host of perception and controls capabilities. Here, we present a new open-source, vision-based tactile sensor designed to promote reproducibility and…

Robotics · Computer Science 2024-10-01 Andrea Sipos , William van den Bogert , Nima Fazeli

Development of large-area, high-speed electronic skins is a grand challenge for robotics, prosthetics, and human-machine interfaces, but is fundamentally limited by wiring complexity and data bottlenecks. Here, we introduce Single-Pixel…

Robotics · Computer Science 2025-11-24 Ariel Slepyan , Laura Xing , Rudy Zhang , Nitish Thakor

In the pursuit of deeper immersion in human-machine interaction, achieving higher-dimensional tactile input and output on a single interface has become a key research focus. This study introduces the Visual-Electronic Tactile (VET) System,…

Robotics · Computer Science 2025-04-02 Cong Zhang , Yisheng Yang , Shilong Mu , Chuqiao Lyu , Shoujie Li , Xinyue Chai , Wenbo Ding

Vision-based tactile sensors (VBTSs) are a promising technology for robots, providing them with dense signals that can be translated into a multi-faceted understanding of contact. However, existing VBTS tactile surfaces make use of silicone…

Robotics · Computer Science 2026-04-10 Benjamin Davis , Hannah Stuart