English
Related papers

Related papers: Design and Benchmarking of A Multi-Modality Sensor…

200 papers

Combining 3D vision with tactile sensing could unlock a greater level of dexterity for robots and improve several manipulation tasks. However, obtaining a close-up 3D view of the location where manipulation contacts occur can be…

Robotics · Computer Science 2023-03-14 Etienne Roberge , Guillaume Fornes , Jean-Philippe Roberge

Contact-rich manipulation in unstructured environments demands precise, multimodal perception to enable robust and adaptive control. Vision-based tactile sensors (VBTSs) have emerged as an effective solution; however, conventional VBTSs…

Robotics · Computer Science 2025-06-02 Wen Fan , Haoran Li , Dandan Zhang

Embodied intelligence has advanced rapidly in recent years; however, bimanual manipulation-especially in contact-rich tasks remains challenging. This is largely due to the lack of datasets with rich physical interaction signals, systematic…

Robotics · Computer Science 2026-04-23 Qianxi Hua , Xinyue Li , Zheng Yan , Yang Li , Chi Zhang , Yongyao Li , Yufei Liu

To enable robots to develop human-like fine manipulation, it is essential to understand how mechanical compliance, multi-modal sensing, and purposeful interaction jointly shape tactile perception. In this study, we use a dedicated modular…

Robotics · Computer Science 2025-08-14 Anirvan Dutta , Alexis WM Devillard , Zhihuan Zhang , Xiaoxiao Cheng , Etienne Burdet

Tactile perception is essential for human interaction with the environment and is becoming increasingly crucial in robotics. Tactile sensors like the BioTac mimic human fingertips and provide detailed interaction data. Despite its utility…

Robotics · Computer Science 2024-10-21 Wadhah Zai El Amri , Malte Kuhlmann , Nicolás Navarro-Guerrero

Visuotactile sensors typically employ sparse marker arrays that limit spatial resolution and lack clear analytical force-to-image relationships. To solve this problem, we present \textbf{Moir\'eTac}, a dual-mode sensor that generates dense…

Robotics · Computer Science 2025-09-17 Kit-Wa Sou , Junhao Gong , Shoujie Li , Chuqiao Lyu , Ziwu Song , Shilong Mu , Wenbo Ding

Traditional vision-based material perception methods often experience substantial performance degradation under visually impaired conditions, thereby motivating the shift toward non-visual multimodal material perception. Despite this,…

Machine Learning · Computer Science 2025-11-26 Kailin Lyu , Long Xiao , Jianing Zeng , Junhao Dong , Xuexin Liu , Zhuojun Zou , Haoyue Yang , Lin Shu , Jie Hao

Optical tactile sensors play a pivotal role in robot perception and manipulation tasks. The membrane of these sensors can be painted with markers or remain markerless, enabling them to function in either marker or markerless mode. However,…

Robotics · Computer Science 2024-08-16 Ni Ou , Zhuo Chen , Shan Luo

Tactile sensing represents a crucial technique that can enhance the performance of robotic manipulators in various tasks. This work presents a novel bioinspired neuromorphic vision-based tactile sensor that uses an event-based camera to…

Robotics · Computer Science 2024-03-18 Omar Faris , Mohammad I. Awad , Murana A. Awad , Yahya Zweiri , Kinda Khalaf

Humans make extensive use of vision and touch as complementary senses, with vision providing global information about the scene and touch measuring local information during manipulation without suffering from occlusions. While prior work…

Robotics · Computer Science 2023-08-01 Justin Kerr , Huang Huang , Albert Wilcox , Ryan Hoque , Jeffrey Ichnowski , Roberto Calandra , Ken Goldberg

Robots operating in dynamic and shared environments benefit from anticipating contact before it occurs. We present GenTact-Prox, a fully 3D-printed artificial skin that integrates tactile and proximity sensing for contact detection and…

Existing psychophysical studies have revealed that the cross-modal visual-tactile perception is common for humans performing daily activities. However, it is still challenging to build the algorithmic mapping from one modality space to…

Computer Vision and Pattern Recognition · Computer Science 2021-07-13 Shaoyu Cai , Kening Zhu , Yuki Ban , Takuji Narumi

The field of robotic manipulation has advanced significantly in recent years. At the sensing level, several novel tactile sensors have been developed, capable of providing accurate contact information. On a methodological level, learning…

Robotics · Computer Science 2026-04-21 Niklas Funk , Changqi Chen , Tim Schneider , Georgia Chalvatzaki , Roberto Calandra , Jan Peters

Tactile perception is essential for human interaction with the environment and is becoming increasingly crucial in robotics. Tactile sensors like the BioTac mimic human fingertips and provide detailed interaction data. Despite its utility…

Robotics · Computer Science 2026-04-29 Wadhah Zai El Amri , Malte Kuhlmann , Nicolás Navarro-Guerrero

Tactile sensing in biological organisms is deeply intertwined with morphological form, such as human fingers, cat paws, and elephant trunks, which enables rich and adaptive interactions through a variety of geometrically complex structures.…

Vision and touch are two fundamental sensory modalities for robots, offering complementary information that enhances perception and manipulation tasks. Previous research has attempted to jointly learn visual-tactile representations to…

Computer Vision and Pattern Recognition · Computer Science 2025-06-27 Zhiyuan Wu , Yongqiang Zhao , Shan Luo

Tactile sensors can significantly enhance the perception of humanoid robotics systems by providing contact information that facilitates human-like interactions. However, existing commercial tactile sensors focus on improving the resolution…

Robotics · Computer Science 2026-01-09 Haoran Guo , Haoyang Wang , Zhengxiong Li , Lingfeng Tao

Capacitive technology allows building sensors that are small, compact and have high sensitivity. For this reason it has been widely adopted in robotics. In a previous work we presented a compliant skin system based on capacitive technology…

Robotics · Computer Science 2021-06-30 Perla Maiolino , Marco Maggiali , Giorgio Cannata , Giorgio Metta , Lorenzo Natale

Tactile sensing for robotics is achieved through a variety of mechanisms, including magnetic, optical-tactile, and conductive fluid. Currently, the fluid-based sensors have struck the right balance of anthropomorphic sizes and shapes and…

Tactile sensors, which provide information about the physical properties of objects, are an essential component of robotic systems. The visuotactile sensing technology with the merits of high resolution and low cost has facilitated the…

Robotics · Computer Science 2024-06-19 Shoujie Li , Zihan Wang , Changsheng Wu , Xiang Li , Shan Luo , Bin Fang , Fuchun Sun , Xiao-Ping Zhang , Wenbo Ding