English

MF-LLM: Simulating Population Decision Dynamics via a Mean-Field Large Language Model Framework

Multiagent Systems 2025-07-11 v3 Artificial Intelligence

Abstract

Simulating collective decision-making involves more than aggregating individual behaviors; it emerges from dynamic interactions among individuals. While large language models (LLMs) offer strong potential for social simulation, achieving quantitative alignment with real-world data remains a key challenge. To bridge this gap, we propose the Mean-Field LLM (MF-LLM) framework, the first to incorporate mean field theory into LLM-based social simulation. MF-LLM models bidirectional interactions between individuals and the population through an iterative process, generating population signals to guide individual decisions, which in turn update the signals. This interplay produces coherent trajectories of collective behavior. To improve alignment with real-world data, we introduce IB-Tune, a novel fine-tuning method inspired by the Information Bottleneck principle, which retains population signals most predictive of future actions while filtering redundant history. Evaluated on a real-world social dataset, MF-LLM reduces KL divergence to human population distributions by 47\% compared to non-mean-field baselines, enabling accurate trend forecasting and effective intervention planning. Generalizing across 7 domains and 4 LLM backbones, MF-LLM provides a scalable, high-fidelity foundation for social simulation.

Keywords

Cite

@article{arxiv.2504.21582,
  title  = {MF-LLM: Simulating Population Decision Dynamics via a Mean-Field Large Language Model Framework},
  author = {Qirui Mi and Mengyue Yang and Xiangning Yu and Zhiyu Zhao and Cheng Deng and Bo An and Haifeng Zhang and Xu Chen and Jun Wang},
  journal= {arXiv preprint arXiv:2504.21582},
  year   = {2025}
}

Comments

29 pages, 8 figures, 4 tables

R2 v1 2026-06-28T23:16:42.378Z