English

Live Avatar: Streaming Real-time Audio-Driven Avatar Generation with Infinite Length

Computer Vision and Pattern Recognition 2026-04-21 v5

Abstract

Audio-driven avatar interaction demands real-time, streaming, and infinite-length generation -- capabilities fundamentally at odds with the sequential denoising and long-horizon drift of current diffusion models. We present Live Avatar, an algorithm-system co-designed framework that addresses both challenges for a 14-billion-parameter diffusion model. On the algorithm side, a two-stage pipeline distills a pretrained bidirectional model into a causal, few-step streaming one, while a set of complementary long-horizon strategies eliminate identity drift and visual artifacts, enabling stable autoregressive generation exceeding 10000 seconds. On the system side, Timestep-forcing Pipeline Parallelism (TPP) assigns each GPU a fixed denoising timestep, converting the sequential diffusion chain into an asynchronous spatial pipeline that simultaneously boosts throughput and improves temporal consistency. Live Avatar achieves 45 FPS with a TTFF of 1.21\,s on 5 H800 GPUs, and to our knowledge is the first to enable practical real-time streaming of a 14B diffusion model for infinite-length avatar generation. We further introduce GenBench, a standardized long-form benchmark, to facilitate reproducible evaluation. Our project page is at https://liveavatar.github.io/.

Keywords

Cite

@article{arxiv.2512.04677,
  title  = {Live Avatar: Streaming Real-time Audio-Driven Avatar Generation with Infinite Length},
  author = {Yubo Huang and Hailong Guo and Fangtai Wu and Weiqiang Wang and Shifeng Zhang and Shijie Huang and Qijun Gan and Lin Liu and Sirui Zhao and Enhong Chen and Jiaming Liu and Steven Hoi},
  journal= {arXiv preprint arXiv:2512.04677},
  year   = {2026}
}
R2 v1 2026-07-01T08:09:16.124Z