English
Related papers

Related papers: RETRO: REthinking Tactile Representation Learning …

200 papers

Self-supervised learning aims to learn image feature representations without the usage of manually annotated labels. It is often used as a precursor step to obtain useful initial network weights which contribute to faster convergence and…

Computer Vision and Pattern Recognition · Computer Science 2021-12-06 Peri Akiva , Matthew Purri , Matthew Leotta

The missing signal caused by the objects being occluded or an unstable sensor is a common challenge during data collection. Such missing signals will adversely affect the results obtained from the data, and this issue is observed more…

Robotics · Computer Science 2023-07-17 Guanqun Cao , Jiaqi Jiang , Danushka Bollegala , Shan Luo

The world is abundant with diverse materials, each possessing unique surface appearances that play a crucial role in our daily perception and understanding of their properties. Despite advancements in technology enabling the capture and…

Computer Vision and Pattern Recognition · Computer Science 2025-09-25 Jiri Filip , Filip Dechterenko , Filipp Schmidt , Jiri Lukavsky , Veronika Vilimovska , Jan Kotera , Roland W. Fleming

The field of robotic manipulation has advanced significantly in recent years. At the sensing level, several novel tactile sensors have been developed, capable of providing accurate contact information. On a methodological level, learning…

Robotics · Computer Science 2026-04-21 Niklas Funk , Changqi Chen , Tim Schneider , Georgia Chalvatzaki , Roberto Calandra , Jan Peters

Due to the complexity of modeling the elastic properties of materials, the use of machine learning algorithms is continuously increasing for tactile sensing applications. Recent advances in deep neural networks applied to computer vision…

Robotics · Computer Science 2020-06-05 Carmelo Sferrazza , Raffaello D'Andrea

Using tactile sensors for manipulation remains one of the most challenging problems in robotics. At the heart of these challenges is generalization: How can we train a tactile-based policy that can manipulate unseen and diverse objects? In…

Robotics · Computer Science 2024-03-20 Entong Su , Chengzhe Jia , Yuzhe Qin , Wenxuan Zhou , Annabella Macaluso , Binghao Huang , Xiaolong Wang

Recently, tactile sensing has attracted great interest in robotics, especially for facilitating exploration of unstructured environments and effective manipulation. A detailed understanding of the surface textures via tactile sensing is…

Robotics · Computer Science 2020-08-12 Guanqun Cao , Yi Zhou , Danushka Bollegala , Shan Luo

Integrating robots into human-centric environments such as homes, necessitates advanced manipulation skills as robotic devices will need to engage with articulated objects like doors and drawers. Key challenges in robotic manipulation of…

Robotics · Computer Science 2025-09-15 Zihang Zhao , Yuyang Li , Wanlin Li , Zhenghao Qi , Lecheng Ruan , Yixin Zhu , Kaspar Althoefer

The connection between visual input and tactile sensing is critical for object manipulation tasks such as grasping and pushing. In this work, we introduce the challenging task of estimating a set of tactile physical properties from visual…

Computer Vision and Pattern Recognition · Computer Science 2021-09-22 Matthew Purri , Kristin Dana

Teachers of the visually impaired (TVIs) regularly present tactile materials (tactile graphics, 3D models, and real objects) to students with vision impairments. Researchers have been increasingly interested in designing tools to support…

Human-Computer Interaction · Computer Science 2022-02-25 Mahika Phutane , Julie Wright , Brenda Veronica Castro , Lei Shi , Simone R. Stern , Holly M. Lawson , Shiri Azenkot

The Transformer model, initially achieving significant success in the field of natural language processing, has recently shown great potential in the application of tactile perception. This review aims to comprehensively outline the…

Machine Learning · Computer Science 2024-05-22 Jing Gao , Ning Cheng , Bin Fang , Wenjuan Han

Tactile information is a critical tool for dexterous manipulation. As humans, we rely heavily on tactile information to understand objects in our environments and how to interact with them. We use touch not only to perform manipulation…

Robotics · Computer Science 2024-09-30 Abraham George , Selam Gano , Pranav Katragadda , Amir Barati Farimani

David Marr's seminal theory of human perception stipulates that visual processing is a multi-stage process, prioritizing the derivation of boundary and surface properties before forming semantic object representations. In contrast,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Tianqin Li , Junru Zhao , Dunhan Jiang , Shenghao Wu , Alan Ramirez , Tai Sing Lee

Robots are increasingly expected to manipulate objects in ever more unstructured environments where the object properties have high perceptual uncertainty from any single sensory modality. This directly impacts successful object…

Robotics · Computer Science 2022-07-15 Wenyu Liang , Fen Fang , Cihan Acar , Wei Qi Toh , Ying Sun , Qianli Xu , Yan Wu

Stable and robust robotic grasping is essential for current and future robot applications. In recent works, the use of large datasets and supervised learning has enhanced speed and precision in antipodal grasping. However, these methods…

Robotics · Computer Science 2025-02-28 Boya Zhang , Iris Andrussow , Andreas Zell , Georg Martius

Tactile perception is an essential ability of intelligent robots in interaction with their surrounding environments. This perception as an intermediate level acts between sensation and action and has to be defined properly to generate…

Robotics · Computer Science 2019-07-24 Masoud Baghbahari , Aman Behal

Humans rely on touch and tactile sensing for a lot of dexterous manipulation tasks. Our tactile sensing provides us with a lot of information regarding contact formations as well as geometric information about objects during any…

Robotics · Computer Science 2023-06-06 Kei Ota , Devesh K. Jha , Hsiao-Yu Tung , Joshua B. Tenenbaum

To achieve a dexterous robotic manipulation, we need to endow our robot with tactile feedback capability, i.e. the ability to drive action based on tactile sensing. In this paper, we specifically address the challenge of tactile servoing,…

When humans perform a task with an articulated object, they interact with the object only in a handful of ways, while the space of all possible interactions is nearly endless. This is because humans have prior knowledge about what…

Computer Vision and Pattern Recognition · Computer Science 2023-05-30 Liquan Wang , Nikita Dvornik , Rafael Dubeau , Mayank Mittal , Animesh Garg

In recent years, the lack of successors for traditional skills has become an issue. To solve this problem, we propose a skill transfer system that presents tactile information in spatial tasks as a color map on an AR space. We believe that…

Human-Computer Interaction · Computer Science 2024-11-11 Takaya Nida , Masamune Waga , Yuta Hamada , Masashi Konyo , Yushi Nakaya , Shubhamkumar Pandey , Satoshi Tadokoro