Let's practice what we preach: Planning and interpreting simulation studies with design and analysis of experiments
Methodology
2021-11-30 v1
Abstract
Statisticians recommend the Design and Analysis of Experiments (DAE) for evidence-based research but often use tables to present their own simulation studies. Could DAE do better? We outline how DAE methods can be used to plan and analyze simulation studies. Tools for planning include fishbone diagrams, factorial and fractional factorial designs. Analysis is carried out via ANOVA, main-effect and interaction plots and other DAE tools. We also demonstrate how Taguchi Robust Parameter Design can be used to study the robustness of methods to a variety of uncontrollable population parameters.
Keywords
Cite
@article{arxiv.2111.13737,
title = {Let's practice what we preach: Planning and interpreting simulation studies with design and analysis of experiments},
author = {Hugh Chipman and Derek Bingham},
journal= {arXiv preprint arXiv:2111.13737},
year = {2021}
}
Comments
37 pages, 15 figures. Submitted to Canadian Journal of Statistics. For associated R code, see https://github.com/hughchipman/TablesAsDesigns