English
Related papers

Related papers: Visual Tactile Sensor Based Force Estimation for P…

200 papers

We're interested in the problem of estimating object states from touch during manipulation under occlusions. In this work, we address the problem of estimating object poses from touch during planar pushing. Vision-based tactile sensors…

Robotics · Computer Science 2021-03-30 Paloma Sodhi , Michael Kaess , Mustafa Mukadam , Stuart Anderson

The lack of haptic feedback in Robot-assisted Minimally Invasive Surgery (RMIS) is a potential barrier to safe tissue handling during surgery. Bayesian modeling theory suggests that surgeons with experience in open or laparoscopic surgery…

Robotics · Computer Science 2022-07-08 Zonghe Chua , Anthony M. Jarc , Sherry Wren , Ilana Nisky , Allison M. Okamura

Deep learning and reinforcement learning methods have been shown to enable learning of flexible and complex robot controllers. However, the reliance on large amounts of training data often requires data collection to be carried out in…

Robotics · Computer Science 2020-04-02 Zihan Ding , Nathan F. Lepora , Edward Johns

Rotational displacement about the grasping point is a common grasp failure when an object is grasped at a location away from its center of gravity. Tactile sensors with soft surfaces, such as GelSight sensors, can detect the rotation…

Robotics · Computer Science 2021-08-03 Raj Kolamuri , Zilin Si , Yufan Zhang , Arpit Agarwal , Wenzhen Yuan

Collocated tactile sensing is a fundamental enabling technology for dexterous manipulation. However, deformable sensors introduce complex dynamics between the robot, grasped object, and environment that must be considered for fine…

Robotics · Computer Science 2022-09-28 Miquel Oller , Mireia Planas , Dmitry Berenson , Nima Fazeli

This study introduces a novel haptic device for enhancing dexterous manipulation in virtual reality. By stimulating mechanoreceptors on both sides of the fingernail, our lightweight system simulates tangential force sensations. We employ…

Human-Computer Interaction · Computer Science 2024-11-11 Yunxiu Xu , Shoichi Hasegawa

In this paper, we presented a new method for deformation control of deformable objects, which utilizes both visual and tactile feedback. At present, manipulation of deformable objects is basically formulated by assuming positional…

Robotics · Computer Science 2021-06-01 Yuhao Guo , Xin Jiang , Yunhui Liu

Reliably planning fingertip grasps for multi-fingered hands lies as a key challenge for many tasks including tool use, insertion, and dexterous in-hand manipulation. This task becomes even more difficult when the robot lacks an accurate…

Robotics · Computer Science 2022-12-19 Martin Matak , Tucker Hermans

Tactile sensors play a crucial role in enabling robots to interact effectively and safely with objects in everyday tasks. In particular, visuotactile sensors have seen increasing usage in two and three-fingered grippers due to their…

Robotics · Computer Science 2024-10-22 Yifan Wu , Yuzhou Chen , Zhengying Zhu , Xuhao Qin , Chenxi Xiao

To assist robots in teleoperation tasks, haptic rendering which allows human operators access a virtual touch feeling has been developed in recent years. Most previous haptic rendering methods strongly rely on data collected by tactile…

Robotics · Computer Science 2023-01-18 Guanqun Cao , Jiaqi Jiang , Ningtao Mao , Danushka Bollegala , Min Li , Shan Luo

Endowing robots with tactile capabilities opens up new possibilities for their interaction with the environment, including the ability to handle fragile and/or soft objects. In this work, we equip the robot gripper with low-cost…

Robotics · Computer Science 2023-06-12 Michael C. Welle , Martina Lippi , Haofei Lu , Jens Lundell , Andrea Gasparri , Danica Kragic

Tactile sensation is essential for contact-rich manipulation tasks. It provides direct feedback on object geometry, surface properties, and interaction forces, enhancing perception and enabling fine-grained control. An inherent limitation…

We present a visuo-tactile data-collection system that generates temporally structured, contact-rich demonstrations for imitation learning. Conventional systems often decouple the operator from contact forces, which hinders the…

Robotics · Computer Science 2026-05-12 Yeseung Kim , Nayoung Oh , Jun Park , Teetat Thamronglak , Daehyung Park

Contact-rich manipulation has become increasingly important in robot learning. However, previous studies on robot learning datasets have focused on rigid objects and underrepresented the diversity of pressure conditions for real-world…

Hand pose tracking is essential for advancing applications in human-computer interaction. Current approaches, such as vision-based systems and wearable devices, face limitations in portability, usability, and practicality. We present a…

Human-Computer Interaction · Computer Science 2025-10-07 Yingjing Xiao , Zhichao Huang , Junbin Ren , Haichuan Song , Yang Gao , Yuting Bai , Zhanpeng Jin

The sense of touch is essential for reliable mapping between the environment and a robot which interacts physically with objects. Presumably, an artificial tactile skin would facilitate safe interaction of the robots with the environment.…

Tactile sensing is a necessary capability for a robotic hand to perform fine manipulations and interact with the environment. Optical sensors are a promising solution for high-resolution contact estimation. Nevertheless, they are usually…

Tactile sensing allows robots to gather detailed geometric information about objects through physical interaction, complementing vision-based approaches. However, efficiently acquiring useful tactile data remains challenging due to the…

Robotics · Computer Science 2026-02-27 Chung Hee Kim , Shivani Kamtikar , Tye Brady , Taskin Padir , Joshua Migdal

The tactile sensation of clothing is critical to wearer comfort. To reveal physical properties that make clothing comfortable, systematic collection of tactile data during sliding motion is required. We propose a robotic arm-based system…

Robotics · Computer Science 2025-11-18 Michikuni Eguchi , Takekazu Kitagishi , Yuichi Hiroi , Takefumi Hiraki

Prehensile autonomous manipulation, such as peg insertion, tool use, or assembly, require precise in-hand understanding of the object pose and the extrinsic contacts made during interactions. Providing accurate estimation of pose and…

Robotics · Computer Science 2026-01-01 Mark Van der Merwe , Kei Ota , Dmitry Berenson , Nima Fazeli , Devesh K. Jha