English

Human-Centric Foundation Models: Perception, Generation and Agentic Modeling

Computer Vision and Pattern Recognition 2025-02-13 v1 Artificial Intelligence Machine Learning Multimedia

Abstract

Human understanding and generation are critical for modeling digital humans and humanoid embodiments. Recently, Human-centric Foundation Models (HcFMs) inspired by the success of generalist models, such as large language and vision models, have emerged to unify diverse human-centric tasks into a single framework, surpassing traditional task-specific approaches. In this survey, we present a comprehensive overview of HcFMs by proposing a taxonomy that categorizes current approaches into four groups: (1) Human-centric Perception Foundation Models that capture fine-grained features for multi-modal 2D and 3D understanding. (2) Human-centric AIGC Foundation Models that generate high-fidelity, diverse human-related content. (3) Unified Perception and Generation Models that integrate these capabilities to enhance both human understanding and synthesis. (4) Human-centric Agentic Foundation Models that extend beyond perception and generation to learn human-like intelligence and interactive behaviors for humanoid embodied tasks. We review state-of-the-art techniques, discuss emerging challenges and future research directions. This survey aims to serve as a roadmap for researchers and practitioners working towards more robust, versatile, and intelligent digital human and embodiments modeling.

Keywords

Cite

@article{arxiv.2502.08556,
  title  = {Human-Centric Foundation Models: Perception, Generation and Agentic Modeling},
  author = {Shixiang Tang and Yizhou Wang and Lu Chen and Yuan Wang and Sida Peng and Dan Xu and Wanli Ouyang},
  journal= {arXiv preprint arXiv:2502.08556},
  year   = {2025}
}

Comments

9 pages

R2 v1 2026-06-28T21:41:56.224Z