English

Correcting Low-Signal Sensitivity in the Deliberative Reason Index

Human-Computer Interaction 2026-04-21 v1

Abstract

The Deliberative Reason Index (DRI) is increasingly used to assess the coherence between considerations and preferences in deliberative settings, including applications to LLM-generated data. Under low-signal conditions, however, the standard DRI can produce inflated scores by treating near-zero correlations as evidence of consistency. Monte Carlo simulations across common study designs show that this bias increases with group size and yields positive values even under random response. A modified DRI is introduced that applies a continuous penalty to low-signal correlation pairs. The modification preserves the original scale and reduces exactly to the standard DRI when substantive signal is present. A threshold sensitivity analysis identifies {\tau}=0.2as the optimal parameter. An empirical check with archival deliberative data shows that substantive inferences remain unchanged. The modification improves the reliability and comparability of the DRI in low-signal settings.

Keywords

Cite

@article{arxiv.2604.16963,
  title  = {Correcting Low-Signal Sensitivity in the Deliberative Reason Index},
  author = {Francesco Veri},
  journal= {arXiv preprint arXiv:2604.16963},
  year   = {2026}
}

Comments

9 pages, 1 figure

R2 v1 2026-07-01T12:15:58.896Z