English

LifeSim: Long-Horizon User Life Simulator for Personalized Assistant Evaluation

Computation and Language 2026-03-13 v1

Abstract

The rapid advancement of large language models (LLMs) has accelerated progress toward universal AI assistants. However, existing benchmarks for personalized assistants remain misaligned with real-world user-assistant interactions, failing to capture the complexity of external contexts and users' cognitive states. To bridge this gap, we propose LifeSim, a user simulator that models user cognition through the Belief-Desire-Intention (BDI) model within physical environments for coherent life trajectories generation, and simulates intention-driven user interactive behaviors. Based on LifeSim, we introduce LifeSim-Eval, a comprehensive benchmark for multi-scenario, long-horizon personalized assistance. LifeSim-Eval covers 8 life domains and 1,200 diverse scenarios, and adopts a multi-turn interactive method to assess models' abilities to complete explicit and implicit intentions, recover user profiles, and produce high-quality responses. Under both single-scenario and long-horizon settings, our experiments reveal that current LLMs face significant limitations in handling implicit intention and long-term user preference modeling.

Keywords

Cite

@article{arxiv.2603.12152,
  title  = {LifeSim: Long-Horizon User Life Simulator for Personalized Assistant Evaluation},
  author = {Feiyu Duan and Xuanjing Huang and Zhongyu Wei},
  journal= {arXiv preprint arXiv:2603.12152},
  year   = {2026}
}
R2 v1 2026-07-01T11:17:07.563Z