English

HapticMatch: An Exploration for Generative Material Haptic Simulation and Interaction

Human-Computer Interaction 2026-01-26 v1 Databases

Abstract

High-fidelity haptic feedback is essential for immersive virtual environments, yet authoring realistic tactile textures remains a significant bottleneck for designers. We introduce HapticMatch, a visual-to-tactile generation framework designed to democratize haptic content creation. We present a novel dataset containing precisely aligned pairs of micro-scale optical images, surface height maps, and friction-induced vibrations for 100 diverse materials. Leveraging this data, we explore and demonstrate that conditional generative models like diffusion and flow-matching can synthesize high-fidelity, renderable surface geometries directly from standard RGB photos. By enabling a "Scan-to-Touch" workflow, HapticMatch allows interaction designers to rapidly prototype multimodal surface sensations without specialized recording equipment, bridging the gap between visual and tactile immersion in VR/AR interfaces.

Keywords

Cite

@article{arxiv.2601.16639,
  title  = {HapticMatch: An Exploration for Generative Material Haptic Simulation and Interaction},
  author = {Mingxin Zhang and Yu Yao and Yasutoshi Makino and Hiroyuki Shinoda and Masashi Sugiyama},
  journal= {arXiv preprint arXiv:2601.16639},
  year   = {2026}
}
R2 v1 2026-07-01T09:17:09.799Z