English

XuanCe: A Comprehensive and Unified Deep Reinforcement Learning Library

Machine Learning 2023-12-29 v1 Artificial Intelligence Digital Libraries

Abstract

In this paper, we present XuanCe, a comprehensive and unified deep reinforcement learning (DRL) library designed to be compatible with PyTorch, TensorFlow, and MindSpore. XuanCe offers a wide range of functionalities, including over 40 classical DRL and multi-agent DRL algorithms, with the flexibility to easily incorporate new algorithms and environments. It is a versatile DRL library that supports CPU, GPU, and Ascend, and can be executed on various operating systems such as Ubuntu, Windows, MacOS, and EulerOS. Extensive benchmarks conducted on popular environments including MuJoCo, Atari, and StarCraftII multi-agent challenge demonstrate the library's impressive performance. XuanCe is open-source and can be accessed at https://github.com/agi-brain/xuance.git.

Cite

@article{arxiv.2312.16248,
  title  = {XuanCe: A Comprehensive and Unified Deep Reinforcement Learning Library},
  author = {Wenzhang Liu and Wenzhe Cai and Kun Jiang and Guangran Cheng and Yuanda Wang and Jiawei Wang and Jingyu Cao and Lele Xu and Chaoxu Mu and Changyin Sun},
  journal= {arXiv preprint arXiv:2312.16248},
  year   = {2023}
}

Comments

16 pages, 4 figures, 32 conferences

R2 v1 2026-06-28T14:02:28.159Z