English

Beyond Action Imitation: Learning a Decision-Aware User Simulator for Online Advertising

Information Retrieval 2026-07-29 v1

Abstract

Recent advances in LLM-based user simulation have shown promise for offline evaluation of recommendation and advertising systems. However, existing simulators typically infer user preferences from single-domain interaction histories and are primarily optimized to reproduce observable actions such as clicks. Consequently, they capture only a partial view of user preferences, while action-only prediction easily induces model shortcuts and limits both the fidelity and diagnostic value of simulation. To address these challenges, we propose DASH, a decision-aware user simulator that jointly generates thinking traces and predicts behavioral actions from heterogeneous cross-domain histories. DASH first introduces a Context Engineering stage that folds heterogeneous cross-domain histories into decision-relevant context, together with prompt optimization for effective reasoning over the folded context. To train a user simulator, DASH distills thinking trajectories from strong LLMs as SFT data, and further tailors a rubric-based reward model that evaluates thinking traces along form, content, and logic for RL training. Combined with the action reward, these signals jointly improve action prediction and thinking quality. Extensive experiments on real-world Tencent advertising data spanning five heterogeneous content domains demonstrate the effectiveness, efficiency, fidelity, and diagnostic value of DASH.

Cite

@article{arxiv.2607.26893,
  title  = {Beyond Action Imitation: Learning a Decision-Aware User Simulator for Online Advertising},
  author = {Zipeng Chen and Jiaer Zheng and Xiangyang Xu and Xinyu Lin and Zhaobin Wang and Zhaohui Liu and Qianjin Xiang and Xiaoyu Zhao and Zhuozhen Yu and Guangshuo Wang and Daxing Chen and Junwei Pan and Zhangbin Zhu and Chengguo Yin and Hao Chen and Tat-Seng Chua and Haijie Gu and Jie Jiang},
  journal= {arXiv preprint arXiv:2607.26893},
  year   = {2026}
}

Comments

23 pages, 10 figures, 9 tables