English
Related papers

Related papers: Simulation of Vision-based Tactile Sensors using P…

200 papers

Vision-based learning from demonstrations has achieved remarkable success in enabling robots to perform manipulation tasks and high-level semantic reasoning, yet it remains insufficient for complex, contact-rich manipulation. While there is…

Tactile sensing is an essential capability for robots that carry out dexterous manipulation tasks. While cameras, Lidars and other remote sensors can assess a scene globally and instantly, tactile sensors can reduce their measurement…

Robotics · Computer Science 2021-12-06 Daniel Fernandes Gomes , Shan Luo

Compliance is a critical parameter for describing objects in engineering, agriculture, and biomedical applications. Traditional compliance detection methods are limited by their lack of portability and scalability, rely on specialized,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-29 Ziteng Li , Malte Kuhlmann , Ilana Nisky , Nicolás Navarro-Guerrero

Vision-based tactile sensors have gained extensive attention in the robotics community. The sensors are highly expected to be capable of extracting contact information i.e. haptic information during in-hand manipulation. This nature of…

Tactile sensing is important for robots to perceive the world as it captures the texture and hardness of the object in contact and is robust to illumination and colour variances. However, due to the limited sensing area and the resistance…

Robotics · Computer Science 2021-03-02 Guanqun Cao , Jiaqi Jiang , Chen Lu , Daniel Fernandes Gomes , Shan Luo

Humans rely on touch and tactile sensing for a lot of dexterous manipulation tasks. Our tactile sensing provides us with a lot of information regarding contact formations as well as geometric information about objects during any…

Robotics · Computer Science 2023-06-06 Kei Ota , Devesh K. Jha , Hsiao-Yu Tung , Joshua B. Tenenbaum

Tactile sensing, which relies on direct physical contact, is critical for human perception and underpins applications in computer vision, robotics, and multimodal learning. Because tactile data is often scarce and costly to acquire,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Cagri Gungor , Derek Eppinger , Adriana Kovashka

Robot simulation has been an essential tool for data-driven manipulation tasks. However, most existing simulation frameworks lack either efficient and accurate models of physical interactions with tactile sensors or realistic tactile…

Robotics · Computer Science 2022-08-08 Zilin Si , Zirui Zhu , Arpit Agarwal , Stuart Anderson , Wenzhen Yuan

This work studies the problem of shape reconstruction and object localization using a vision-based tactile sensor, GelSlim. The main contributions are the recovery of local shapes from contact, an approach to reconstruct the tactile shape…

Robotics · Computer Science 2019-07-12 Maria Bauza , Oleguer Canal , Alberto Rodriguez

Combining 3D vision with tactile sensing could unlock a greater level of dexterity for robots and improve several manipulation tasks. However, obtaining a close-up 3D view of the location where manipulation contacts occur can be…

Robotics · Computer Science 2023-03-14 Etienne Roberge , Guillaume Fornes , Jean-Philippe Roberge

Knowledge of 3-D object shape is of great importance to robot manipulation tasks, but may not be readily available in unstructured environments. While vision is often occluded during robot-object interaction, high-resolution tactile sensors…

Robotics · Computer Science 2022-03-11 Sudharshan Suresh , Zilin Si , Joshua G. Mangelson , Wenzhen Yuan , Michael Kaess

Tactile displays that lend tangible form to digital content could transform computing interactions. However, achieving the resolution, speed, and dynamic range needed for perceptual fidelity remains challenging. We present a tactile display…

Emerging Technologies · Computer Science 2026-01-27 Max Linnander , Dustin Goetz , Gregory Reardon , Vijay Kumar , Elliot Hawkes , Yon Visell

The development of vision-based tactile sensors has significantly enhanced robots' perception and manipulation capabilities, especially for tasks requiring contact-rich interactions with objects. In this work, we present DTactive, a novel…

Robotics · Computer Science 2024-10-14 Jikai Xu , Lei Wu , Changyi Lin , Ding Zhao , Huazhe Xu

Reproducing the capabilities of the human sense of touch in machines is an important step in enabling robot manipulation to have the ease of human dexterity. A combination of robotic technologies will be needed, including soft robotics,…

Robotics · Computer Science 2021-07-23 Nathan F. Lepora

Rapid deployment of new tactile sensors is essential for scalable robotic manipulation, especially in multi-fingered hands equipped with vision-based tactile sensors. However, current methods for inferring contact properties rely heavily on…

Robotics · Computer Science 2026-04-02 Christopher J. Ford , Kaichen Shi , Laura Butcher , Nathan F. Lepora , Efi Psomopoulou

Increasing the performance of tactile sensing in robots enables versatile, in-hand manipulation. Vision-based tactile sensors have been widely used as rich tactile feedback has been shown to be correlated with increased performance in…

Robotics · Computer Science 2022-03-10 Won Kyung Do , Monroe Kennedy

Modern incarnations of tactile sensors produce high-dimensional raw sensory feedback such as images, making it challenging to efficiently store, process, and generalize across sensors. To address these concerns, we introduce a novel…

Robotics · Computer Science 2024-09-24 Sikai Li , Samanta Rodriguez , Yiming Dou , Andrew Owens , Nima Fazeli

Rich haptic sensory feedback in response to user interactions is desirable for an effective, immersive virtual reality or teleoperation system. However, this feedback depends on material properties and user interactions in a complex,…

Robotics · Computer Science 2020-10-27 Negin Heravi , Wenzhen Yuan , Allison M. Okamura , Jeannette Bohg

Tactile perception using vibration sensation helps robots recognize their environment's physical properties and perform complex tasks. A sliding motion is applied to target objects to generate tactile vibration data. However, situations…

Robotics · Computer Science 2021-04-21 Naoto Komeno , Takamitsu Matsubara

Compliant grippers enable robots to work with humans in unstructured environments. In general, these grippers can improve with tactile sensing to estimate the state of objects around them to precisely manipulate objects. However,…

Robotics · Computer Science 2024-03-08 Yuxiang Ma , Arpit Agarwal , Sandra Q. Liu , Wenzhen Yuan , Edward H. Adelson