English
Related papers

Related papers: Attention for Robot Touch: Tactile Saliency Predic…

200 papers

Increasing the performance of tactile sensing in robots enables versatile, in-hand manipulation. Vision-based tactile sensors have been widely used as rich tactile feedback has been shown to be correlated with increased performance in…

Robotics · Computer Science 2022-03-10 Won Kyung Do , Monroe Kennedy

Deep learning has the potential to have the impact on robot touch that it has had on robot vision. Optical tactile sensors act as a bridge between the subjects by allowing techniques from vision to be applied to touch. In this paper, we…

Robotics · Computer Science 2020-12-07 Nathan F. Lepora , Alex Church , Conrad De Kerckhove , Raia Hadsell , John Lloyd

Collocated tactile sensing is a fundamental enabling technology for dexterous manipulation. However, deformable sensors introduce complex dynamics between the robot, grasped object, and environment that must be considered for fine…

Robotics · Computer Science 2022-09-28 Miquel Oller , Mireia Planas , Dmitry Berenson , Nima Fazeli

Saliency computation models aim to imitate the attention mechanism in the human visual system. The application of deep neural networks for saliency prediction has led to a drastic improvement over the last few years. However, deep models…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Saman Zabihi , Hamed Rezazadegan Tavakoli , Ali Borji

Tactile sensation is essential for contact-rich manipulation tasks. It provides direct feedback on object geometry, surface properties, and interaction forces, enhancing perception and enabling fine-grained control. An inherent limitation…

Haptic exploration is a key skill for both robots and humans to discriminate and handle unknown objects or to recognize familiar objects. Its active nature is evident in humans who from early on reliably acquire sophisticated sensory-motor…

Robotics · Computer Science 2020-01-28 Sascha Fleer , Alexandra Moringen , Roberta L. Klatzky , Helge Ritter

Tactile sensing is an essential perception for robots to complete dexterous tasks. As a promising tactile sensing technique, vision-based tactile sensors have been developed to improve robot performance in manipulation and grasping. Here we…

Robotics · Computer Science 2022-06-01 Guanlan Zhang , Yipai Du , Hongyu Yu , Michael Yu Wang

Mobile robots operating in crowded environments require the ability to navigate among humans and surrounding obstacles efficiently while adhering to safety standards and socially compliant mannerisms. This scale of the robot navigation…

Robotics · Computer Science 2025-08-15 Yung Chuen Ng , Qi Wen Shervina Lim , Chun Ye Tan , Zhen Hao Gan , Meng Yee Michael Chuah

Hardness is among the most important attributes of an object that humans learn about through touch. However, approaches for robots to estimate hardness are limited, due to the lack of information provided by current tactile sensors. In this…

Robotics · Computer Science 2017-09-26 Wenzhen Yuan , Chenzhuo Zhu , Andrew Owens , Mandayam A. Srinivasan , Edward H. Adelson

Tactile sensing is vital for human dexterous manipulation, however, it has not been widely used in robotics. Compact, low-cost sensing platforms can facilitate a change, but unlike their popular optical counterparts, they are difficult to…

Robotics · Computer Science 2025-03-10 Adrian Röfer , Nick Heppert , Abdallah Ayad , Eugenio Chisari , Abhinav Valada

A key problem in salient object detection is how to effectively model the semantic properties of salient objects in a data-driven manner. In this paper, we propose a multi-task deep saliency model based on a fully convolutional neural…

Computer Vision and Pattern Recognition · Computer Science 2016-08-24 Xi Li , Liming Zhao , Lina Wei , Ming-Hsuan Yang , Fei Wu , Yueting Zhuang , Haibin Ling , Jingdong Wang

In-hand manipulation tasks, particularly in human-inspired robotic systems, must rely on distributed tactile sensing to achieve precise control across a wide variety of tasks. However, the optimal configuration of this network of sensors is…

Robotics · Computer Science 2026-01-05 João Damião Almeida , Egidio Falotico , Cecilia Laschi , José Santos-Victor

The images captured by vision-based tactile sensors carry information about high-resolution tactile fields, such as the distribution of the contact forces applied to their soft sensing surface. However, extracting the information encoded in…

Robotics · Computer Science 2021-10-01 Carmelo Sferrazza , Raffaello D'Andrea

Robots have been brought to work close to humans in many scenarios. For coexistence and collaboration, robots should be safe and pleasant for humans to interact with. To this end, the robots could be both physically soft with multimodal…

Robotics · Computer Science 2022-11-08 Quan Khanh Luu , Dinh Quang Nguyen , Nhan Huu Nguyen , Van Anh Ho

Tactile sensing is crucial for achieving human-level robotic capabilities in manipulation tasks. As a promising solution, Vision-Based Tactile Sensors (VBTSs) offer high spatial resolution and cost-effectiveness, but present unique…

Robotics · Computer Science 2025-09-15 Yuyang Li , Wenxin Du , Chang Yu , Puhao Li , Zihang Zhao , Tengyu Liu , Chenfanfu Jiang , Yixin Zhu , Siyuan Huang

Tactile perception is central to robot manipulation in unstructured environments. However, it requires contact, and a mature implementation must infer object models while also accounting for the motion induced by the interaction. In this…

Tactile perception has the potential to significantly enhance dexterous robotic manipulation by providing rich local information that can complement or substitute for other sensory modalities such as vision. However, because tactile sensing…

Robotics · Computer Science 2025-06-17 Tim Schneider , Guillaume Duret , Cristiana de Farias , Roberto Calandra , Liming Chen , Jan Peters

Tactile perception is a crucial sensing modality in robotics, particularly in scenarios that require precise manipulation and safe interaction with other objects. Previous research in this area has focused extensively on tactile perception…

Robotics · Computer Science 2023-06-27 John Lloyd , Nathan Lepora

Tactile servoing is an important technique because it enables robots to manipulate objects with precision and accuracy while adapting to changes in their environments in real-time. One approach for tactile servo control with high-resolution…

Robotics · Computer Science 2023-12-15 John Lloyd , Nathan F. Lepora

This article describes a new way of controlling robots using soft tactile sensors: pose-based tactile servo (PBTS) control. The basic idea is to embed a tactile perception model for estimating the sensor pose within a servo control loop…

Robotics · Computer Science 2021-07-05 Nathan F. Lepora , John Lloyd