English
Related papers

Related papers: Design and Benchmarking of A Multi-Modality Sensor…

200 papers

We investigate the transduction of tactile information during active exploration of finely textured surfaces using a novel tactile sensor mimicking the human fingertip. The sensor has been designed by integrating a linear array of 10…

Soft Condensed Matter · Physics 2010-07-30 Raphaël Candelier , Georges Debrégeas , Alexis Prevost

Tactile sensing plays a fundamental role in enabling robots to navigate dynamic and unstructured environments, particularly in applications such as delicate object manipulation, surface exploration, and human-robot interaction. In this…

Robotics · Computer Science 2025-09-18 Annan Zhang , Miguel Flores-Acton , Andy Yu , Anshul Gupta , Maggie Yao , Daniela Rus

Manipulation of deformable objects is a challenging task for a robot. It will be problematic to use a single sensory input to track the behaviour of such objects: vision can be subjected to occlusions, whereas tactile inputs cannot capture…

Robotics · Computer Science 2023-05-01 Leszek Pecyna , Siyuan Dong , Shan Luo

Reusing the tactile knowledge of some previously-explored objects helps us humans to easily recognize the tactual properties of new objects. In this master thesis, we enable arobotic arm equipped with multi-modal artificial skin, like…

Robotics · Computer Science 2018-07-04 Di Feng

Bringing tactile sensation to robotic hands will allow for more effective grasping, along with the wide range of benefits of human-like touch. Here we present a 3D-printed, three-fingered tactile robot hand comprising an OpenHand Model O…

Robotics · Computer Science 2020-08-17 Jasper W. James , Alex Church , Luke Cramphorn , Nathan F. Lepora

In this work, we introduce the problem of cross-modal visuo-tactile object recognition with robotic active exploration. With this term, we mean that the robot observes a set of objects with visual perception and, later on, it is able to…

Robotics · Computer Science 2020-01-22 Pietro Falco , Shuang Lu , Ciro Natale , Salvatore Pirozzi , Dongheui Lee

The multimodal datasets can be leveraged to pre-train large-scale vision-language models by providing cross-modal semantics. Current endeavors for determining the usage of datasets mainly focus on single-modal dataset ownership verification…

Information Retrieval · Computer Science 2025-04-18 Wenyi Zhang , Ju Jia , Xiaojun Jia , Yihao Huang , Xinfeng Li , Cong Wu , Lina Wang

The advancements in vision-based tactile sensors have boosted the aptitude of robots to perform contact-rich manipulation, particularly when precise positioning and contact state of the manipulated objects are crucial for successful…

Robotics · Computer Science 2023-12-19 Changyi Lin , Han Zhang , Jikai Xu , Lei Wu , Huazhe Xu

This paper presents a magnet-based robotic skin that integrates a multilayer soft lattice with distributed Hall-effect sensor arrays and a tactile super-resolution model. External contact forces are converted to magnetic field changes by…

Robotics · Computer Science 2026-05-28 Yunseong Bang , Joowon Park , Suan Sim , Youngjun Ryu , Sukho Park , Kyungseo Park

We present a tactile-sensorized Fin-Ray finger that enables simultaneous detection of contact location and indentation depth through an indirect sensing approach. A hinge mechanism is integrated between the soft Fin-Ray structure and a…

Robotics · Computer Science 2025-12-09 Saekwang Nam , Bowen Deng , Loong Yi Lee , Jonathan M. Rossiter , Nathan F. Lepora

Camera-based tactile sensors have shown great promise in enhancing a robot's ability to perform a variety of dexterous manipulation tasks. Advantages of their use can be attributed to the high resolution tactile data and 3D depth map…

Robotics · Computer Science 2023-04-11 Megha H. Tippur , Edward H. Adelson

The ability to associate touch with other modalities has huge implications for humans and computational systems. However, multimodal learning with touch remains challenging due to the expensive data collection process and non-standardized…

Computer Vision and Pattern Recognition · Computer Science 2024-02-01 Fengyu Yang , Chao Feng , Ziyang Chen , Hyoungseob Park , Daniel Wang , Yiming Dou , Ziyao Zeng , Xien Chen , Rit Gangopadhyay , Andrew Owens , Alex Wong

In this paper, a novel tactile sensing mechanism for soft robotic fingers is proposed. Inspired by the proprioception mechanism found in mammals, the proposed approach infers tactile information from a strain sensor attached on the finger's…

Robotics · Computer Science 2021-07-07 Chang Cheng , Yadong Yan , Mingjun Guan , Jianan Zhang , Yu Wang

Inferring physical properties can significantly enhance robotic manipulation by enabling robots to handle objects safely and efficiently through adaptive grasping strategies. Previous approaches have typically relied on either tactile or…

Robotics · Computer Science 2025-06-25 Zexiang Guo , Hengxiang Chen , Xinheng Mai , Qiusang Qiu , Gan Ma , Zhanat Kappassov , Qiang Li , Nutan Chen

In conjunction with huge recent progress in camera and computer vision technology, camera-based sensors have increasingly shown considerable promise in relation to tactile sensing. In comparison to competing technologies (be they resistive,…

Signal Processing · Electrical Eng. & Systems 2023-03-07 Kaspar Althoefer , Yonggen Ling , Wanlin Li , Xinyuan Qian , Wang Wei Lee , Peng Qi

Robots are expected to grasp a wide range of objects varying in shape, weight or material type. Providing robots with tactile capabilities similar to humans is thus essential for applications involving human-to-robot or robot-to-robot…

Robotics · Computer Science 2022-07-26 Pedro Machado , T. M. McGinnity

Humans usually perceive the world in a multimodal way that vision, touch, sound are utilised to understand surroundings from various dimensions. These senses are combined together to achieve a synergistic effect where the learning is more…

Computer Vision and Pattern Recognition · Computer Science 2021-12-30 Guanqun Cao , Shan Luo

The perception and recognition of the surroundings is one of the essential tasks for a robot. With preliminary knowledge about a target object, it can perform various manipulation tasks such as rolling motion, palpation, and force control.…

Tactile feedback is critical for understanding the dynamics of both rigid and deformable objects in many manipulation tasks, such as non-prehensile manipulation and dense packing. We introduce an approach that combines visual and tactile…

Robotics · Computer Science 2024-07-02 Bo Ai , Stephen Tian , Haochen Shi , Yixuan Wang , Cheston Tan , Yunzhu Li , Jiajun Wu

Sound is a rich information medium that transmits through air; people communicate through speech and can even discern material through tapping and listening. To capture frequencies in the human hearing range, commercial microphones…

Robotics · Computer Science 2023-07-20 Monica S. Li , Hannah S. Stuart