English

Virtual avatar generation models as world navigators

Computer Vision and Pattern Recognition 2024-06-04 v1 Artificial Intelligence Human-Computer Interaction Machine Learning Robotics

Abstract

We introduce SABR-CLIMB, a novel video model simulating human movement in rock climbing environments using a virtual avatar. Our diffusion transformer predicts the sample instead of noise in each diffusion step and ingests entire videos to output complete motion sequences. By leveraging a large proprietary dataset, NAV-22M, and substantial computational resources, we showcase a proof of concept for a system to train general-purpose virtual avatars for complex tasks in robotics, sports, and healthcare.

Keywords

Cite

@article{arxiv.2406.01056,
  title  = {Virtual avatar generation models as world navigators},
  author = {Sai Mandava},
  journal= {arXiv preprint arXiv:2406.01056},
  year   = {2024}
}

Comments

16 pages, 15 figures

R2 v1 2026-06-28T16:50:40.653Z