English

SLALOM: Simulation Lifecycle Analysis via Longitudinal Observation Metrics for Social Simulation

Multiagent Systems 2026-04-14 v1 Artificial Intelligence

Abstract

Large Language Model (LLM) agents offer a potentially-transformative path forward for generative social science but face a critical crisis of validity. Current simulation evaluation methodologies suffer from the "stopped clock" problem: they confirm that a simulation reached the correct final outcome while ignoring whether the trajectory leading to it was sociologically plausible. Because the internal reasoning of LLMs is opaque, verifying the "black box" of social mechanisms remains a persistent challenge. In this paper, we introduce SLALOM (Simulation Lifecycle Analysis via Longitudinal Observation Metrics), a framework that shifts validation from outcome verification to process fidelity. Drawing on Pattern-Oriented Modeling (POM), SLALOM treats social phenomena as multivariate time series that must traverse specific SLALOM gates, or intermediate waypoint constraints representing distinct phases. By utilizing Dynamic Time Warping (DTW) to align simulated trajectories with empirical ground truth, SLALOM offers a quantitative metric to assess structural realism, helping to differentiate plausible social dynamics from stochastic noise and contributing to more robust policy simulation standards.

Keywords

Cite

@article{arxiv.2604.11466,
  title  = {SLALOM: Simulation Lifecycle Analysis via Longitudinal Observation Metrics for Social Simulation},
  author = {Juhoon Lee and Joseph Seering},
  journal= {arXiv preprint arXiv:2604.11466},
  year   = {2026}
}

Comments

CHI 2026 PoliSim@CHI 2026: LLM Agent Simulation for Policy Workshop

R2 v1 2026-07-01T12:06:24.451Z