Physical AI 的 Cosmos World 基础模型平台
计算机视觉与模式识别
2025-07-11 v3 人工智能
机器学习
机器人学
摘要
Physical AI 需要首先在数字环境中进行训练。它需要一个自身的数字孪 replica，即策略模型，以及一个世界的数字孪 replica，即世界模型。本文提出了 Cosmos World 基础模型平台，以帮助开发者为其 Physical AI 设置构建定制化的世界模型。我们将世界基础模型定位为通用型世界模型，可微调为下游应用的定制化世界模型。我们的平台涵盖视频 curated 流水线、预训练世界基础模型、预训练世界基础模型的后训练示例以及视频标记器。为帮助 Physical AI 构建者解决社会最关键的问题，我们使 Cosmos 开源，并通过 https://github.com/nvidia-cosmos/cosmos-predict1 提供具有宽松许可证的模型权重。
引用
@article{arxiv.2501.03575,
title = {Cosmos World Foundation Model Platform for Physical AI},
author = {NVIDIA and : and Niket Agarwal and Arslan Ali and Maciej Bala and Yogesh Balaji and Erik Barker and Tiffany Cai and Prithvijit Chattopadhyay and Yongxin Chen and Yin Cui and Yifan Ding and Daniel Dworakowski and Jiaojiao Fan and Michele Fenzi and Francesco Ferroni and Sanja Fidler and Dieter Fox and Songwei Ge and Yunhao Ge and Jinwei Gu and Siddharth Gururani and Ethan He and Jiahui Huang and Jacob Huffman and Pooya Jannaty and Jingyi Jin and Seung Wook Kim and Gergely Klár and Grace Lam and Shiyi Lan and Laura Leal-Taixe and Anqi Li and Zhaoshuo Li and Chen-Hsuan Lin and Tsung-Yi Lin and Huan Ling and Ming-Yu Liu and Xian Liu and Alice Luo and Qianli Ma and Hanzi Mao and Kaichun Mo and Arsalan Mousavian and Seungjun Nah and Sriharsha Niverty and David Page and Despoina Paschalidou and Zeeshan Patel and Lindsey Pavao and Morteza Ramezanali and Fitsum Reda and Xiaowei Ren and Vasanth Rao Naik Sabavat and Ed Schmerling and Stella Shi and Bartosz Stefaniak and Shitao Tang and Lyne Tchapmi and Przemek Tredak and Wei-Cheng Tseng and Jibin Varghese and Hao Wang and Haoxiang Wang and Heng Wang and Ting-Chun Wang and Fangyin Wei and Xinyue Wei and Jay Zhangjie Wu and Jiashu Xu and Wei Yang and Lin Yen-Chen and Xiaohui Zeng and Yu Zeng and Jing Zhang and Qinsheng Zhang and Yuxuan Zhang and Qingqing Zhao and Artur Zolkowski},
journal= {arXiv preprint arXiv:2501.03575},
year = {2025}
}