English
Related papers

Related papers: MidasTouch: Monte-Carlo inference over distributio…

200 papers

Camera-based tactile sensors are emerging as a promising inexpensive solution for tactile-enhanced manipulation tasks. A recently introduced FingerVision sensor was shown capable of generating reliable signals for force estimation, object…

Optical tactile sensors are extensively utilized in intelligent robot manipulation due to their ability to acquire high-resolution tactile information at a lower cost. However, achieving adequate reality and versatility in simulating…

Robotics · Computer Science 2024-05-07 Zirong Shen , Yuhao Sun , Shixin Zhang , Zixi Chen , Heyi Sun , Fuchun Sun , Bin Fang

A GelSight sensor uses an elastomeric slab covered with a reflective membrane to measure tactile signals. It measures the 3D geometry and contact force information with high spacial resolution, and successfully helped many challenging robot…

Robotics · Computer Science 2018-03-01 Siyuan Dong , Wenzhen Yuan , Edward Adelson

The primary focus of this research is the discreet and subtle everyday contact interactions between mobile phones and their surrounding surfaces. Such interactions are anticipated to facilitate mobile context awareness, encompassing aspects…

Human-Computer Interaction · Computer Science 2024-07-23 Yongquan Hu , Hui-Shyong Yeo , Mingyue Yuan , Haoran Fan , Don Samitha Elvitigala , Wen Hu , Aaron Quigley

Touch and vision go hand in hand, mutually enhancing our ability to understand the world. From a research perspective, the problem of mixing touch and vision is underexplored and presents interesting challenges. To this end, we propose…

Computer Vision and Pattern Recognition · Computer Science 2024-04-01 Mauro Comi , Alessio Tonioni , Max Yang , Jonathan Tremblay , Valts Blukis , Yijiong Lin , Nathan F. Lepora , Laurence Aitchison

This work proposes a process for efficiently searching over combinations of individual object 6D pose hypotheses in cluttered scenes, especially in cases involving occlusions and objects resting on each other. The initial set of candidate…

Robotics · Computer Science 2017-10-25 Chaitanya Mitash , Abdeslam Boularias , Kostas E. Bekris

This paper investigates how visual texture presentation influences tactile perception when interacting with electrostatic cloth displays. We propose a visuo-haptic system that allows users to pinch and rub virtual fabrics while feeling…

Human-Computer Interaction · Computer Science 2025-11-11 Takekazu Kitagishi , Chun-Wei Ooi , Yuichi Hiroi , Jun Rekimoto

We present Diffusion Restore, a real-time framework for diffusion-based MCMC light transport. MCMC methods are highly suitable for sampling from complex high-dimensional distributions and for approximating integrals over them. In practice,…

Computational Engineering, Finance, and Science · Computer Science 2026-05-21 Sascha Holl , Gurprit Singh , Hans-Peter Seidel

This study presents a novel approach for touch sensing using semi-elastic textile surfaces that does not require the placement of additional sensors in the sensing area, instead relying on sensors located on the border of the textile. The…

Machine Learning · Computer Science 2023-05-18 Samuel Zühlke , Andreas Stöckl , David C. Schedl

Localizing and tracking the pose of robotic grippers are necessary skills for manipulation tasks. However, the manipulators with imprecise kinematic models (e.g. low-cost arms) or manipulators with unknown world coordinates (e.g. poor…

Robotics · Computer Science 2020-11-12 Tarik Kelestemur , Colin Keil , John P. Whitney , Robert Platt , Taskin Padir

Handheld grippers are increasingly used to collect human demonstrations due to their ease of deployment and versatility. However, most existing designs lack tactile sensing, despite the critical role of tactile feedback in precise…

Robotics · Computer Science 2025-11-13 Xinyue Zhu , Binghao Huang , Yunzhu Li

Tactile and textile skin technologies have become increasingly important for enhancing human-robot interaction and allowing robots to adapt to different environments. Despite notable advancements, there are ongoing challenges in skin signal…

Robotics · Computer Science 2024-04-24 Bo Ying Su , Yuchen Wu , Chengtao Wen , Changliu Liu

Reliably planning fingertip grasps for multi-fingered hands lies as a key challenge for many tasks including tool use, insertion, and dexterous in-hand manipulation. This task becomes even more difficult when the robot lacks an accurate…

Robotics · Computer Science 2022-12-19 Martin Matak , Tucker Hermans

As more robots are implemented for contact-rich tasks, tactile sensors are in increasing demand. For many circumstances, the contact is required to be compliant, and soft sensors are in need. This paper introduces a novelly designed soft…

Robotics · Computer Science 2021-05-18 Wu-Te Yang , Zhian Kuang , Changhao Wang , Masayoshi Tomizuka

Through our respiratory system, many viruses and diseases frequently spread and pass from one person to another. Covid-19 served as an example of how crucial it is to track down and cut back on contacts to stop its spread. There is a clear…

Computer Vision and Pattern Recognition · Computer Science 2023-08-25 Mohamed R. Ibrahim , Terry Lyons

We propose a hardware and software pipeline to fabricate flexible wearable sensors and use them to capture deformations without line of sight. Our first contribution is a low-cost fabrication pipeline to embed multiple aligned conductive…

Graphics · Computer Science 2019-03-25 Oliver Glauser , Daniele Panozzo , Otmar Hilliges , Olga Sorkine-Hornung

Simulators perform an important role in prototyping, debugging, and benchmarking new advances in robotics and learning for control. Although many physics engines exist, some aspects of the real world are harder than others to simulate. One…

Robotics · Computer Science 2022-02-14 Shaoxiong Wang , Mike Lambeta , Po-Wei Chou , Roberto Calandra

Spatial tactile feedback can enhance the realism of geometry exploration in virtual reality applications. Current vibrotactile approaches often face challenges with the spatial and temporal resolution needed to render different 3D…

Human-Computer Interaction · Computer Science 2026-02-04 Yihao Dong , Praneeth Bimsara Perera , Chin-Teng Lin , Craig T Jin , Anusha Withana

Tactile servoing is an important technique because it enables robots to manipulate objects with precision and accuracy while adapting to changes in their environments in real-time. One approach for tactile servo control with high-resolution…

Robotics · Computer Science 2023-12-15 John Lloyd , Nathan F. Lepora

Pose estimation is essential for robotic manipulation, particularly when visual perception is occluded during gripper-object interactions. Existing tactile-based methods generally rely on tactile simulation or pre-trained models, which…

Robotics · Computer Science 2026-03-12 Zirui Zhang , Boyang Zhang , Fumin Zhang , Huan Yin