Qualitative coding relies on a researcher's application of codes to textual data. As coding proceeds across large datasets, interpretations of codes often shift (temporal drift), reducing the credibility of the analysis. Existing Computer-Assisted Qualitative Data Analysis (CAQDAS) tools provide support for data management but offer no workflow for real-time detection of these drifts. We present Co-Refine, an AI-augmented qualitative coding platform that delivers continuous, grounded feedback on coding consistency without disrupting the researcher's workflow. The system employs a three-stage audit pipeline: Stage 1 computes deterministic embedding-based metrics for mathematical consistency; Stage 2 grounds LLM verdicts within ±0.15 of the deterministic scores; and Stage 3 produces code definitions from previous patterns to create a deepening feedback loop. Co-Refine demonstrates that deterministic scoring can effectively constrain LLM outputs to produce reliable, real-time audit signals for qualitative analysis.
@article{arxiv.2604.19309,
title = {Co-Refine: AI-Powered Tool Supporting Qualitative Analysis},
author = {Athikash Jeyaganthan and Kai Xu and Franziska Becker and Steffen Koch},
journal= {arXiv preprint arXiv:2604.19309},
year = {2026}
}
Comments
7 pages, 4 figures. Includes details on system architecture, a three-stage audit pipeline, and a formative user study