English

TongSIM: A General Platform for Simulating Intelligent Machines

Artificial Intelligence 2025-12-24 v1

Abstract

As artificial intelligence (AI) rapidly advances, especially in multimodal large language models (MLLMs), research focus is shifting from single-modality text processing to the more complex domains of multimodal and embodied AI. Embodied intelligence focuses on training agents within realistic simulated environments, leveraging physical interaction and action feedback rather than conventionally labeled datasets. Yet, most existing simulation platforms remain narrowly designed, each tailored to specific tasks. A versatile, general-purpose training environment that can support everything from low-level embodied navigation to high-level composite activities, such as multi-agent social simulation and human-AI collaboration, remains largely unavailable. To bridge this gap, we introduce TongSIM, a high-fidelity, general-purpose platform for training and evaluating embodied agents. TongSIM offers practical advantages by providing over 100 diverse, multi-room indoor scenarios as well as an open-ended, interaction-rich outdoor town simulation, ensuring broad applicability across research needs. Its comprehensive evaluation framework and benchmarks enable precise assessment of agent capabilities, such as perception, cognition, decision-making, human-robot cooperation, and spatial and social reasoning. With features like customized scenes, task-adaptive fidelity, diverse agent types, and dynamic environmental simulation, TongSIM delivers flexibility and scalability for researchers, serving as a unified platform that accelerates training, evaluation, and advancement toward general embodied intelligence.

Keywords

Cite

@article{arxiv.2512.20206,
  title  = {TongSIM: A General Platform for Simulating Intelligent Machines},
  author = {Zhe Sun and Kunlun Wu and Chuanjian Fu and Zeming Song and Langyong Shi and Zihe Xue and Bohan Jing and Ying Yang and Xiaomeng Gao and Aijia Li and Tianyu Guo and Huiying Li and Xueyuan Yang and Rongkai Liu and Xinyi He and Yuxi Wang and Yue Li and Mingyuan Liu and Yujie Lu and Hongzhao Xie and Shiyun Zhao and Bo Dai and Wei Wang and Tao Yuan and Song-Chun Zhu and Yujia Peng and Zhenliang Zhang},
  journal= {arXiv preprint arXiv:2512.20206},
  year   = {2025}
}
R2 v1 2026-07-01T08:38:17.318Z