English
Related papers

Related papers: TransForce: Transferable Force Prediction for Visi…

200 papers

Tactile sensing plays a vital role in enabling robots to perform fine-grained, contact-rich tasks. However, the high dimensionality of tactile data, due to the large coverage on dexterous hands, poses significant challenges for effective…

Robotics · Computer Science 2025-06-17 Tianhao Wu , Jinzhou Li , Jiyao Zhang , Mingdong Wu , Hao Dong

Humans make extensive use of vision and touch as complementary senses, with vision providing global information about the scene and touch measuring local information during manipulation without suffering from occlusions. While prior work…

Robotics · Computer Science 2023-08-01 Justin Kerr , Huang Huang , Albert Wilcox , Ryan Hoque , Jeffrey Ichnowski , Roberto Calandra , Ken Goldberg

This paper presents a novel six-axis force/torque (F/T) sensor based on inductive sensing technology. Unlike conventional strain gauge-based sensors that require direct contact and external amplification, the proposed sensor utilizes…

Robotics · Computer Science 2025-05-15 Hyun-Bin Kim , Kyung-Soo Kim

Robotic manipulation tasks such as inserting a key into a lock or plugging a USB device into a port can fail when visual perception is insufficient to detect misalignment. In these situations, touch sensing is crucial for the robot to…

Robotics · Computer Science 2025-09-23 Yinghao Wu , Shuhong Hou , Haowen Zheng , Yichen Li , Weiyi Lu , Xun Zhou , Yitian Shao

Real-time prediction of deformation in highly compliant soft materials remains a significant challenge in soft robotics. While vision-based soft tactile sensors can track internal marker displacements, learning-based models for 3D contact…

Robotics · Computer Science 2026-02-24 Junhui Lee , Hyosung Kim , Saekwang Nam

Tactile sensing is critical in advanced interactive systems by emulating the human sense of touch to detect stimuli. Vision-based tactile sensors are promising for providing multimodal capabilities and high robustness, yet existing…

Robotics · Computer Science 2025-04-07 Mayue Shi , Yongqi Zhang , Xiaotong Guo , Eric M. Yeatman

The images captured by vision-based tactile sensors carry information about high-resolution tactile fields, such as the distribution of the contact forces applied to their soft sensing surface. However, extracting the information encoded in…

Robotics · Computer Science 2021-10-01 Carmelo Sferrazza , Raffaello D'Andrea

This paper has introduced a novel approach for the real-time estimation of 3D tactile forces exerted by human fingertips via vision only. The introduced approach is entirely monocular vision-based and does not require any physical force…

Computer Vision and Pattern Recognition · Computer Science 2021-10-18 Navid Fallahinia , Stephen Mascaro

Vision-based Tactile Sensors (VBTSs) show significant promise in that they can leverage image measurements to provide high-spatial-resolution human-like performance. However, current VBTS designs, typically confined to the fingertips of…

Robotics · Computer Science 2024-08-06 Meng Wang , Wanlin Li , Hao Liang , Boren Li , Kaspar Althoefer , Yao Su , Hangxin Liu

Measuring grasp stability is an important skill for dexterous robot manipulation tasks, which can be inferred from haptic information with a tactile sensor. Control policies have to detect rotational displacement and slippage from tactile…

Robotics · Computer Science 2024-08-01 En Yen Puang , Zechen Li , Chee Meng Chew , Shan Luo , Yan Wu

Force estimation is the core indicator for evaluating the performance of tactile sensors, and it is also the key technical path to achieve precise force feedback mechanisms. This study proposes a design method for a visual tactile sensor…

Robotics · Computer Science 2025-04-01 Jianhua Shan , Jie Zhao , Jiangduo Liu , Xiangbo Wang , Ziwei Xia , Guangyuan Xu , Bin Fang

Tactile perception is essential for real-world manipulation tasks, yet the high cost and fragility of tactile sensors can limit their practicality. In this work, we explore BeadSight (a low-cost, open-source tactile sensor) alongside a…

Robotics · Computer Science 2025-03-14 Selam Gano , Abraham George , Amir Barati Farimani

Reliable perception during fast motion maneuvers or in high dynamic range environments is crucial for robotic systems. Since event cameras are robust to these challenging conditions, they have great potential to increase the reliability of…

Computer Vision and Pattern Recognition · Computer Science 2022-02-04 Nico Messikommer , Daniel Gehrig , Mathias Gehrig , Davide Scaramuzza

Tactile perception is essential for human interaction with the environment and is becoming increasingly crucial in robotics. Tactile sensors like the BioTac mimic human fingertips and provide detailed interaction data. Despite its utility…

Robotics · Computer Science 2024-10-21 Wadhah Zai El Amri , Malte Kuhlmann , Nicolás Navarro-Guerrero

The field of robotic manipulation has advanced significantly in recent years. At the sensing level, several novel tactile sensors have been developed, capable of providing accurate contact information. On a methodological level, learning…

Robotics · Computer Science 2026-04-21 Niklas Funk , Changqi Chen , Tim Schneider , Georgia Chalvatzaki , Roberto Calandra , Jan Peters

Compliance is a critical parameter for describing objects in engineering, agriculture, and biomedical applications. Traditional compliance detection methods are limited by their lack of portability and scalability, rely on specialized,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-29 Ziteng Li , Malte Kuhlmann , Ilana Nisky , Nicolás Navarro-Guerrero

Inspecting large-scale industrial surfaces like aircraft fuselages for quality control requires capturing their precise 3D surface geometry at high resolution. Vision-based tactile sensors (VBTSs) offer high local resolution but require…

Tactile sensors, which provide information about the physical properties of objects, are an essential component of robotic systems. The visuotactile sensing technology with the merits of high resolution and low cost has facilitated the…

Robotics · Computer Science 2024-06-19 Shoujie Li , Zihan Wang , Changsheng Wu , Xiang Li , Shan Luo , Bin Fang , Fuchun Sun , Xiao-Ping Zhang , Wenbo Ding

Tactile sensation is essential for contact-rich manipulation tasks. It provides direct feedback on object geometry, surface properties, and interaction forces, enhancing perception and enabling fine-grained control. An inherent limitation…

High-resolution multi-modality information acquired by vision-based tactile sensors can support more dexterous manipulations for robot fingers. Optical flow is low-level information directly obtained by vision-based tactile sensors, which…

Computer Vision and Pattern Recognition · Computer Science 2023-09-14 Zhiyuan Zhang , Hua Yang , Zhouping Yin