English

DiSCoKit: An Open-Source Toolkit for Deploying Live LLM Experiences in Survey Research

Human-Computer Interaction 2026-02-13 v1

Abstract

Advancing social-scientific research of human-AI interaction dynamics and outcomes often requires researchers to deliver experiences with live large-language models (LLMs) to participants through online survey platforms. However, technical and practical challenges (from logging chat data to manipulating AI behaviors for experimental designs) often inhibit survey-based deployment of AI stimuli. We developed DiSCoKit--an open-source toolkit for deploying live LLM experiences (e.g., ones based on models delivered through Microsoft Azure portal) through JavaScript-enabled survey platforms (e.g., Qualtrics). This paper introduces that toolkit, explaining its scientific impetus, describes its architecture and operation, as well as its deployment possibilities and limitations.

Keywords

Cite

@article{arxiv.2602.11230,
  title  = {DiSCoKit: An Open-Source Toolkit for Deploying Live LLM Experiences in Survey Research},
  author = {Jaime Banks and Jon Stromer-Galley and Samiksha Singh and Collin Capano},
  journal= {arXiv preprint arXiv:2602.11230},
  year   = {2026}
}
R2 v1 2026-07-01T10:32:29.657Z