English
Related papers

Related papers: HumanFT: A Human-like Fingertip Multimodal Visuo-T…

200 papers

Robotic palpation relies on force sensing, but force signals in soft-tissue environments are variable and cannot reliably reveal subtle subsurface features. We present a compact multimodal sensor that integrates high-resolution vision-based…

Complex robotic tasks require human collaboration to benefit from their high dexterity. Frequent human-robot interaction is mentally demanding and time-consuming. Intuitive and easy-to-use robot control interfaces reduce the negative…

Human-Computer Interaction · Computer Science 2022-11-03 Sautenkov Oleg , Altamirano Cabrera Miguel , Rakhmatulin Viktor , Tsetserukou Dzmitry

Tactile sensing is essential to the human perception system, so as to robot. In this paper, we develop a novel optical-based tactile sensor "FingerVision" with effective signal processing algorithms. This sensor is composed of soft skin…

Robotics · Computer Science 2018-10-08 Yazhan Zhang , Zicheng Kan , Yu Alexander Tse , Yang Yang , Michael Yu Wang

Tactile sensing is critical to fine-grained, contact-rich manipulation tasks, such as insertion and assembly. Prior research has shown the possibility of learning tactile-guided policy from teleoperated demonstration data. However, to…

Robotics · Computer Science 2025-02-07 Kelin Yu , Yunhai Han , Qixian Wang , Vaibhav Saxena , Danfei Xu , Ye Zhao

Tactile sensing represents a crucial technique that can enhance the performance of robotic manipulators in various tasks. This work presents a novel bioinspired neuromorphic vision-based tactile sensor that uses an event-based camera to…

Robotics · Computer Science 2024-03-18 Omar Faris , Mohammad I. Awad , Murana A. Awad , Yahya Zweiri , Kinda Khalaf

This article investigates the challenge of achieving functional tool-use grasping with high-DoF anthropomorphic hands, with the aim of enabling anthropomorphic hands to perform tasks that require human-like manipulation and tool-use.…

Robotics · Computer Science 2023-04-03 Wei Wei , Peng Wang , Sizhe Wang

Tactile sensors, which provide information about the physical properties of objects, are an essential component of robotic systems. The visuotactile sensing technology with the merits of high resolution and low cost has facilitated the…

Robotics · Computer Science 2024-06-19 Shoujie Li , Zihan Wang , Changsheng Wu , Xiang Li , Shan Luo , Bin Fang , Fuchun Sun , Xiao-Ping Zhang , Wenbo Ding

Tactile and visual perception are both crucial for humans to perform fine-grained interactions with their environment. Developing similar multi-modal sensing capabilities for robots can significantly enhance and expand their manipulation…

Robotics · Computer Science 2025-01-08 Binghao Huang , Yixuan Wang , Xinyi Yang , Yiyue Luo , Yunzhu Li

In this work, we report on the integrated sensorimotor control of the Pisa/IIT SoftHand, an anthropomorphic soft robot hand designed around the principle of adaptive synergies, with the BRL tactile fingertip (TacTip), a soft biomimetic…

Tactile sensing in biological organisms is deeply intertwined with morphological form, such as human fingers, cat paws, and elephant trunks, which enables rich and adaptive interactions through a variety of geometrically complex structures.…

Reliably planning fingertip grasps for multi-fingered hands lies as a key challenge for many tasks including tool use, insertion, and dexterous in-hand manipulation. This task becomes even more difficult when the robot lacks an accurate…

Robotics · Computer Science 2022-12-19 Martin Matak , Tucker Hermans

The human somatosensory system integrates multimodal sensory feedback, including tactile, proprioceptive, and thermal signals, to enable comprehensive perception and effective interaction with the environment. Inspired by the biological…

Robotics · Computer Science 2025-09-03 Fengyi Wang , Xiangyu Fu , Nitish Thakor , Gordon Cheng

Conventional industrial robots often use two-fingered grippers or suction cups to manipulate objects or interact with the world. Because of their simplified design, they are unable to reproduce the dexterity of human hands when manipulating…

Robotics · Computer Science 2025-09-18 Jana Egli , Benedek Forrai , Thomas Buchner , Jiangtao Su , Xiaodong Chen , Robert K. Katzschmann

Incorporating touch as a sensing modality for robots can enable finer and more robust manipulation skills. Existing tactile sensors are either flat, have small sensitive fields or only provide low-resolution signals. In this paper, we…

Robotics · Computer Science 2020-03-17 Akhil Padmanabha , Frederik Ebert , Stephen Tian , Roberto Calandra , Chelsea Finn , Sergey Levine

Tactile sensing is an essential capability for robots that carry out dexterous manipulation tasks. While cameras, Lidars and other remote sensors can assess a scene globally and instantly, tactile sensors can reduce their measurement…

Robotics · Computer Science 2021-12-06 Daniel Fernandes Gomes , Shan Luo

Distinguishing the feel of smooth silk from coarse cotton is a trivial everyday task for humans. When exploring such fabrics, fingertip skin senses both spatio-temporal force patterns and texture-induced vibrations that are integrated to…

High-density afferents in the human hand have long been regarded as essential for human grasping and manipulation abilities. In contrast, robotic tactile sensors are typically used to provide low-density contact data, such as…

Robotics · Computer Science 2020-06-09 Yashraj S. Narang , Karl Van Wyk , Arsalan Mousavian , Dieter Fox

Vision-based Tactile Sensors (VBTSs) show significant promise in that they can leverage image measurements to provide high-spatial-resolution human-like performance. However, current VBTS designs, typically confined to the fingertips of…

Robotics · Computer Science 2024-08-06 Meng Wang , Wanlin Li , Hao Liang , Boren Li , Kaspar Althoefer , Yao Su , Hangxin Liu

Wearable fingertip haptic devices are critical for realistic interaction in virtual reality, augmented reality, and teleoperation, yet existing approaches struggle to simultaneously achieve adequate tactile output, low mass, simple…

Robotics · Computer Science 2026-04-03 Rui Chen , Daniele Leonardis , Antonio Frisoli

Object manipulation is fundamental to virtual reality (VR) applications, yet conventional fingertip haptic devices fail to render certain tactile features relevant for immersive and precise interactions, as i.e. detection of edges. This…

Robotics · Computer Science 2026-04-02 Rui Chen , Xianlong Mai , Alireza Sanaei , Domenico Chiaradia , Antonio Frisoli , Daniele Leonardis