English
Related papers

Related papers: Transfer learning for vision-based tactile sensing

200 papers

Tactile sensing provides a promising sensing modality for object pose estimation in manipulation settings where visual information is limited due to occlusion or environmental effects. However, efficiently leveraging tactile data for…

Today's tactile sensors have a variety of different designs, making it challenging to develop general-purpose methods for processing touch signals. In this paper, we learn a unified representation that captures the shared information…

Transfer learning enables to re-use knowledge learned on a source task to help learning a target task. A simple form of transfer learning is common in current state-of-the-art computer vision models, i.e. pre-training a model for image…

Computer Vision and Pattern Recognition · Computer Science 2021-11-23 Thomas Mensink , Jasper Uijlings , Alina Kuznetsova , Michael Gygli , Vittorio Ferrari

Deep Neural Networks trained in a fully supervised fashion are the dominant technology in perception-based autonomous driving systems. While collecting large amounts of unlabeled data is already a major undertaking, only a subset of it can…

Computer Vision and Pattern Recognition · Computer Science 2020-04-10 Elmar Haussmann , Michele Fenzi , Kashyap Chitta , Jan Ivanecky , Hanson Xu , Donna Roy , Akshita Mittel , Nicolas Koumchatzky , Clement Farabet , Jose M. Alvarez

The connection between visual input and tactile sensing is critical for object manipulation tasks such as grasping and pushing. In this work, we introduce the challenging task of estimating a set of tactile physical properties from visual…

Computer Vision and Pattern Recognition · Computer Science 2021-09-22 Matthew Purri , Kristin Dana

Tactile sensors have been introduced to a wide range of robotic tasks such as robot manipulation to mimic the sense of human touch. However, there has only been a few works that integrate tactile sensing into robot navigation. This paper…

Robotics · Computer Science 2022-11-24 Zhen Hao Gan , Yangwei You , Meng Yee , Chuah

Tactile sensing is crucial for achieving human-level robotic capabilities in manipulation tasks. As a promising solution, Vision-Based Tactile Sensors (VBTSs) offer high spatial resolution and cost-effectiveness, but present unique…

Robotics · Computer Science 2025-09-15 Yuyang Li , Wenxin Du , Chang Yu , Puhao Li , Zihang Zhao , Tengyu Liu , Chenfanfu Jiang , Yixin Zhu , Siyuan Huang

Tactile servoing is an important technique because it enables robots to manipulate objects with precision and accuracy while adapting to changes in their environments in real-time. One approach for tactile servo control with high-resolution…

Robotics · Computer Science 2023-12-15 John Lloyd , Nathan F. Lepora

This paper describes a system for transmitting softness and the motion of shape or contact area sensation using a vision based tactile sensor and a tactile display in which mechanical and electrical stimulation are combined. A unit of…

Human-Computer Interaction · Computer Science 2024-11-11 Hikaru Kukita , Hiroyuki Kajimoto , Yem Vibol

The advent of tactile sensors in robotics has sparked many ideas on how robots can leverage direct contact measurements of their environment interactions to improve manipulation tasks. An important line of research in this regard is that of…

Robotics · Computer Science 2023-11-14 Luca Lach , Robert Haschke , Davide Tateo , Jan Peters , Helge Ritter , Júlia Borràs , Carme Torras

Task transfer learning is a popular technique in image processing applications that uses pre-trained models to reduce the supervision cost of related tasks. An important question is to determine task transferability, i.e. given a common…

Machine Learning · Computer Science 2022-12-21 Yajie Bao , Yang Li , Shao-Lun Huang , Lin Zhang , Lizhong Zheng , Amir Zamir , Leonidas Guibas

Can a robot grasp an unknown object without seeing it? In this paper, we present a tactile-sensing based approach to this challenging problem of grasping novel objects without prior knowledge of their location or physical properties. Our…

Robotics · Computer Science 2018-05-14 Adithyavairavan Murali , Yin Li , Dhiraj Gandhi , Abhinav Gupta

Reusing the tactile knowledge of some previously-explored objects helps us humans to easily recognize the tactual properties of new objects. In this master thesis, we enable arobotic arm equipped with multi-modal artificial skin, like…

Robotics · Computer Science 2018-07-04 Di Feng

Calibration of sensors is a fundamental step to validate their operation. This can be a demanding task, as it relies on acquiring a detailed modelling of the device, aggravated by its possible dependence upon multiple parameters. Machine…

Visuo-tactile sensors aim to emulate human tactile perception, enabling robots to precisely understand and manipulate objects. Over time, numerous meticulously designed visuo-tactile sensors have been integrated into robotic systems, aiding…

Machine Learning · Computer Science 2025-04-02 Ruoxuan Feng , Jiangyu Hu , Wenke Xia , Tianci Gao , Ao Shen , Yuhao Sun , Bin Fang , Di Hu

We address the problem of tactile localization, where the goal is to identify image regions that share the same material properties as a tactile input. Existing visuo-tactile methods rely on global alignment and thus fail to capture the…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Seongyu Kim , Seungwoo Lee , Hyeonggon Ryu , Joon Son Chung , Arda Senocak

Tactile sensing is essential to the human perception system, so as to robot. In this paper, we develop a novel optical-based tactile sensor "FingerVision" with effective signal processing algorithms. This sensor is composed of soft skin…

Robotics · Computer Science 2018-10-08 Yazhan Zhang , Zicheng Kan , Yu Alexander Tse , Yang Yang , Michael Yu Wang

Efficient learning from demonstration for long-horizon tasks remains an open challenge in robotics. While significant effort has been directed toward learning trajectories, a recent resurgence of object-centric approaches has demonstrated…

Robotics · Computer Science 2025-12-01 Adrian Röfer , Russell Buchanan , Max Argus , Sethu Vijayakumar , Abhinav Valada

Integrating knowledge across different domains is an essential feature of human learning. Learning paradigms such as transfer learning, meta-learning, and multi-task learning reflect the human learning process by exploiting the prior…

Machine Learning · Computer Science 2024-10-17 Richa Upadhyay , Ronald Phlypo , Rajkumar Saini , Marcus Liwicki

Capacitive technology allows building sensors that are small, compact and have high sensitivity. For this reason it has been widely adopted in robotics. In a previous work we presented a compliant skin system based on capacitive technology…

Robotics · Computer Science 2021-06-30 Perla Maiolino , Marco Maggiali , Giorgio Cannata , Giorgio Metta , Lorenzo Natale