Qualitative data analysis (QDA) emphasizes trustworthiness, requiring sustained human engagement and reflexivity. Recently, large language models (LLMs) have been applied in QDA to improve efficiency. However, their use raises concerns about unvalidated automation and displaced sensemaking, which can undermine trustworthiness. To address these issues, we employed two strategies: transparency and human involvement. Through a literature review and formative interviews, we identified six design requirements for transparent automation and meaningful human involvement. Guided by these requirements, we developed MindCoder, an LLM-powered workflow that delegates mechanical tasks, such as grouping and validation, to the system, while enabling humans to conduct meaningful interpretation. MindCoder also maintains comprehensive logs of users' step-by-step interactions to ensure transparency and support trustworthy results. In an evaluation with 12 users and two external evaluators, MindCoder supported active interpretation, offered flexible control, and produced more trustworthy codebooks. We further discuss design implications for building human-AI collaborative QDA workflows.
@article{arxiv.2501.00775,
title = {Efficiency with Rigor! A Trustworthy LLM-powered Workflow for Qualitative Data Analysis},
author = {Jie Gao and Zhiyao Shu and Shun Yi Yeo and Alok Prakash and Chien-Ming Huang and Mark Dredze and Ziang Xiao},
journal= {arXiv preprint arXiv:2501.00775},
year = {2025}
}