English

UniVTAC: A Unified Simulation Platform for Visuo-Tactile Manipulation Data Generation, Learning, and Benchmarking

Robotics 2026-02-11 v1

Abstract

Robotic manipulation has seen rapid progress with vision-language-action (VLA) policies. However, visuo-tactile perception is critical for contact-rich manipulation, as tasks such as insertion are difficult to complete robustly using vision alone. At the same time, acquiring large-scale and reliable tactile data in the physical world remains costly and challenging, and the lack of a unified evaluation platform further limits policy learning and systematic analysis. To address these challenges, we propose UniVTAC, a simulation-based visuo-tactile data synthesis platform that supports three commonly used visuo-tactile sensors and enables scalable and controllable generation of informative contact interactions. Based on this platform, we introduce the UniVTAC Encoder, a visuo-tactile encoder trained on large-scale simulation-synthesized data with designed supervisory signals, providing tactile-centric visuo-tactile representations for downstream manipulation tasks. In addition, we present the UniVTAC Benchmark, which consists of eight representative visuo-tactile manipulation tasks for evaluating tactile-driven policies. Experimental results show that integrating the UniVTAC Encoder improves average success rates by 17.1% on the UniVTAC Benchmark, while real-world robotic experiments further demonstrate a 25% improvement in task success. Our webpage is available at https://univtac.github.io/.

Keywords

Cite

@article{arxiv.2602.10093,
  title  = {UniVTAC: A Unified Simulation Platform for Visuo-Tactile Manipulation Data Generation, Learning, and Benchmarking},
  author = {Baijun Chen and Weijie Wan and Tianxing Chen and Xianda Guo and Congsheng Xu and Yuanyang Qi and Haojie Zhang and Longyan Wu and Tianling Xu and Zixuan Li and Yizhe Wu and Rui Li and Xiaokang Yang and Ping Luo and Wei Sui and Yao Mu},
  journal= {arXiv preprint arXiv:2602.10093},
  year   = {2026}
}

Comments

Website: https://univtac.github.io/

R2 v1 2026-07-01T10:30:14.476Z