English
Related papers

Related papers: Connecting Touch and Vision via Cross-Modal Predic…

200 papers

Robots which interact with the physical world will benefit from a fine-grained tactile understanding of objects and surfaces. Additionally, for certain tasks, robots may need to know the haptic properties of an object before touching it. To…

Robotics · Computer Science 2016-04-13 Yang Gao , Lisa Anne Hendricks , Katherine J. Kuchenbecker , Trevor Darrell

Observing touch on another's body can elicit corresponding tactile sensations in the observer, a phenomenon termed mirror touch that supports empathy and social perception. This visuo-tactile resonance is thought to rely on structural…

Robotics · Computer Science 2026-05-15 Tianfang Zhu , Ning An , Rui Wang , Jiasi Gao , Qingming Luo , Anan Li , Guyue Zhou

Humans rely on touch and tactile sensing for a lot of dexterous manipulation tasks. Our tactile sensing provides us with a lot of information regarding contact formations as well as geometric information about objects during any…

Robotics · Computer Science 2023-06-06 Kei Ota , Devesh K. Jha , Hsiao-Yu Tung , Joshua B. Tenenbaum

Touch sensing can help robots understand their sur- rounding environment, and in particular the objects they interact with. To this end, roboticists have, in the last few decades, developed several tactile sensing solutions, extensively…

Robotics · Computer Science 2017-11-13 Shan Luo , Joao Bimbo , Ravinder Dahiya , Hongbin Liu

Humans use all of their senses to accomplish different tasks in everyday activities. In contrast, existing work on robotic manipulation mostly relies on one, or occasionally two modalities, such as vision and touch. In this work, we…

Autonomous manipulation of articulated objects remains a fundamental challenge for robots in human environments. Vision-based methods can infer hidden kinematics but can yield imprecise estimates on unfamiliar objects. Tactile approaches…

Robotics · Computer Science 2026-04-03 Leiyao Cui , Zihang Zhao , Sirui Xie , Wenhuan Zhang , Zhi Han , Yixin Zhu

Research on tactile sensing has been progressing at constant pace. In robotics, tactile sensing is typically studied in the context of object grasping and manipulation. In this domain, the development of robust, multi-modal, tactile sensors…

Robotics · Computer Science 2022-06-29 Lorenzo Natale , Giorgio Cannata

Autonomously exploring the unknown physical properties of novel objects such as stiffness, mass, center of mass, friction coefficient, and shape is crucial for autonomous robotic systems operating continuously in unstructured environments.…

Robotics · Computer Science 2024-05-24 Anirvan Dutta , Etienne Burdet , Mohsen Kaboli

Tactile sensing is a fundamental modality for embodied intelligence, offering unique and direct feedback on contact geometry, material properties, and interaction dynamics that remote sensors cannot replace. However, unimodal tactile…

Inferring physical properties can significantly enhance robotic manipulation by enabling robots to handle objects safely and efficiently through adaptive grasping strategies. Previous approaches have typically relied on either tactile or…

Robotics · Computer Science 2025-06-25 Zexiang Guo , Hengxiang Chen , Xinheng Mai , Qiusang Qiu , Gan Ma , Zhanat Kappassov , Qiang Li , Nutan Chen

Tactility provides crucial support and enhancement for the perception and interaction capabilities of both humans and robots. Nevertheless, the multimodal research related to touch primarily focuses on visual and tactile modalities, with…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Ning Cheng , You Li , Jing Gao , Bin Fang , Jinan Xu , Wenjuan Han

Tactile and visual perception are both crucial for humans to perform fine-grained interactions with their environment. Developing similar multi-modal sensing capabilities for robots can significantly enhance and expand their manipulation…

Robotics · Computer Science 2025-01-08 Binghao Huang , Yixuan Wang , Xinyi Yang , Yiyue Luo , Yunzhu Li

Human tactile perception of materials relies on complex multisensory touch cues, yet the relationship between low-level tactile signals and perceptual representations remains poorly understood. This knowledge gap hinders the integration of…

Robotics · Computer Science 2026-05-29 Li Zou , Yasemin Vardar

When a toddler is presented a new toy, their instinctual behaviour is to pick it upand inspect it with their hand and eyes in tandem, clearly searching over its surface to properly understand what they are playing with. At any instance…

Computer Vision and Pattern Recognition · Computer Science 2020-11-04 Edward J. Smith , Roberto Calandra , Adriana Romero , Georgia Gkioxari , David Meger , Jitendra Malik , Michal Drozdzal

Manipulation of deformable objects is a challenging task for a robot. It will be problematic to use a single sensory input to track the behaviour of such objects: vision can be subjected to occlusions, whereas tactile inputs cannot capture…

Robotics · Computer Science 2023-05-01 Leszek Pecyna , Siyuan Dong , Shan Luo

Tactile perception is an essential ability of intelligent robots in interaction with their surrounding environments. This perception as an intermediate level acts between sensation and action and has to be defined properly to generate…

Robotics · Computer Science 2019-07-24 Masoud Baghbahari , Aman Behal

Humans sense of distance depends on the integration of multi sensory cues. The incoming visual luminance, auditory pitch and tactile vibration could all contribute to the ability of distance judgement. This ability can be enhanced if the…

Human-Computer Interaction · Computer Science 2020-02-18 Feng Feng , Tony Stockman

Tactile sensors, which provide information about the physical properties of objects, are an essential component of robotic systems. The visuotactile sensing technology with the merits of high resolution and low cost has facilitated the…

Robotics · Computer Science 2024-06-19 Shoujie Li , Zihan Wang , Changsheng Wu , Xiang Li , Shan Luo , Bin Fang , Fuchun Sun , Xiao-Ping Zhang , Wenbo Ding

Data-driven approaches to tactile sensing aim to overcome the complexity of accurately modeling contact with soft materials. However, their widespread adoption is impaired by concerns about data efficiency and the capability to generalize…

Robotics · Computer Science 2020-03-06 Carmelo Sferrazza , Thomas Bi , Raffaello D'Andrea

Touch plays a central role in how humans perceive and recognize materials through physical contact. Despite decades of research, the mechanisms by which tactile signals are transformed into meaningful perceptual representations remain…

Human-Computer Interaction · Computer Science 2026-05-19 Yasemin Vardar