English
Related papers

Related papers: Visual Tactile Sensor Based Force Estimation for P…

200 papers

Contact force is a natural way for humans to interact with the physical world around us. However, most of our interactions with the digital world are largely based on a simple binary sense of touch (contact or no contact). Similarly, when…

Signal Processing · Electrical Eng. & Systems 2021-06-17 Agrim Gupta , Cedric Girerd , Manideep Dunna , Qiming Zhang , Raghav Subbaraman , Tania Morimoto , Dinesh Bharadia

Coordinating proximity and tactile imaging by collocating cameras with tactile sensors can 1) provide useful information before contact such as object pose estimates and visually servo a robot to a target with reduced occlusion and higher…

Robotics · Computer Science 2022-04-29 Arkadeep Narayan Chaudhury , Timothy Man , Wenzhen Yuan , Christopher G. Atkeson

Combining 3D vision with tactile sensing could unlock a greater level of dexterity for robots and improve several manipulation tasks. However, obtaining a close-up 3D view of the location where manipulation contacts occur can be…

Robotics · Computer Science 2023-03-14 Etienne Roberge , Guillaume Fornes , Jean-Philippe Roberge

We present a tactile-sensorized Fin-Ray finger that enables simultaneous detection of contact location and indentation depth through an indirect sensing approach. A hinge mechanism is integrated between the soft Fin-Ray structure and a…

Robotics · Computer Science 2025-12-09 Saekwang Nam , Bowen Deng , Loong Yi Lee , Jonathan M. Rossiter , Nathan F. Lepora

Vision-only grasping systems are fundamentally constrained by calibration errors, sensor noise, and grasp pose prediction inaccuracies, leading to unavoidable contact uncertainty in the final stage of grasping. High-bandwidth tactile…

Robotics · Computer Science 2025-09-22 Yonghyeon Lee , Tzu-Yuan Lin , Alexander Alexiev , Sangbae Kim

A novel sensory substitution technique is presented. Kinesthetic and cutaneous force feedback are substituted by cutaneous feedback (CF) only, provided by two wearable devices able to apply forces to the index finger and the thumb, while…

Robotics · Computer Science 2012-11-28 Domenico Prattichizzo , Claudio Pacchierotti , Giulio Rosati

Force-aware grasping is an essential capability for most robots in practical applications. Especially for compliant grippers, such as Fin-Ray grippers, it still remains challenging to build a bidirectional mathematical model that mutually…

Robotics · Computer Science 2023-06-21 Huixu Dong , Ziyi Zheng , Haotian Guo , Sihao Yang , Chen Qiu , Jiansheng Dai , I-Ming Chen

A successful grasp requires careful balancing of the contact forces. Deducing whether a particular grasp will be successful from indirect measurements, such as vision, is therefore quite challenging, and direct sensing of contacts through…

Robots which interact with the physical world will benefit from a fine-grained tactile understanding of objects and surfaces. Additionally, for certain tasks, robots may need to know the haptic properties of an object before touching it. To…

Robotics · Computer Science 2016-04-13 Yang Gao , Lisa Anne Hendricks , Katherine J. Kuchenbecker , Trevor Darrell

Legged systems need to optimize contact force in order to maintain contacts. For this, the controller needs to have the knowledge of the surface geometry and how slippery the terrain is. We can use a vision system to realize the terrain,…

Robotics · Computer Science 2020-03-05 Hsiu-Chin Lin , Michael Mistry

Soft robotic grippers demonstrate great potential for gently and safely handling objects; however, their full potential for executing precise and secure grasping has been limited by the lack of integrated sensors, leading to problems such…

Robotics · Computer Science 2025-02-07 Wenjie Lai , Huu Duoc Nguyen , Jiajun Liu , Xingyu Chen , Soo Jay Phee

Vision-based tactile sensors (VBTS) have gained widespread application in robotic hands, grippers and prosthetics due to their high spatial resolution, low manufacturing costs, and ease of customization. While VBTSs have common design…

Robotics · Computer Science 2025-09-05 Haoran Li , Yijiong Lin , Chenghua Lu , Max Yang , Efi Psomopoulou , Nathan F Lepora

Scanning large-scale surfaces is widely demanded in surface reconstruction applications and detecting defects in industries' quality control and maintenance stages. Traditional vision-based tactile sensors have shown promising performance…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 Mohammad Amin Mirzaee , Hung-Jui Huang , Wenzhen Yuan

Direct physical guidance is a natural means of teaching and interacting with robots, and robotic skins make a key contribution by enabling sensitive contact sensing and localization. This paper presents a tactile-proprioceptive sensor…

Robotics · Computer Science 2026-05-28 Junha Min , Junghyeon Ma , Jiwung Kwon , Sunggyu Bae , Joohyung Kim , Kyungseo Park

Tactile sensing is a crucial capability for Vision-Language-Action (VLA) architectures, as it enables dexterous and safe manipulation in contact-rich tasks. However, reliance on dedicated tactile hardware increases cost and reduces…

To perform complex tasks, robots must be able to interact with and manipulate their surroundings. One of the key challenges in accomplishing this is robust state estimation during physical interactions, where the state involves not only the…

Accurate estimation of fruit hardness is essential for automated classification and handling systems, particularly in determining fruit variety, assessing ripeness, and ensuring proper harvesting force. This study presents an innovative…

Robotics · Computer Science 2025-05-12 Zhongyuan Liao , Yipai Du , Jianghua Duan , Haobo Liang , Michael Yu Wang

Research on tactile sensing has been progressing at constant pace. In robotics, tactile sensing is typically studied in the context of object grasping and manipulation. In this domain, the development of robust, multi-modal, tactile sensors…

Robotics · Computer Science 2022-06-29 Lorenzo Natale , Giorgio Cannata

The connection between visual input and tactile sensing is critical for object manipulation tasks such as grasping and pushing. In this work, we introduce the challenging task of estimating a set of tactile physical properties from visual…

Computer Vision and Pattern Recognition · Computer Science 2021-09-22 Matthew Purri , Kristin Dana

Detection of slip during object grasping and manipulation plays a vital role in object handling. Existing solutions primarily rely on visual information to devise a strategy for grasping. However, for robotic systems to attain a level of…