English

A Framework For Discussing LLMs as Tools for Qualitative Analysis

Human-Computer Interaction 2024-07-17 v1

Abstract

We review discourses about the philosophy of science in qualitative research and evidence from cognitive linguistics in order to ground a framework for discussing the use of Large Language Models (LLMs) to support the qualitative analysis process. This framework involves asking two key questions: "is the LLM proposing or refuting a qualitative model?" and "is the human researcher checking the LLM's decision-making directly?". We then discuss an implication of this framework: that using LLMs to surface counter-examples for human review represents a promising space for the adoption of LLMs into the qualitative research process. This space is promising because it is a site of overlap between researchers working from a variety of philosophical assumptions, enabling productive cross-paradigm collaboration on tools and practices.

Keywords

Cite

@article{arxiv.2407.11198,
  title  = {A Framework For Discussing LLMs as Tools for Qualitative Analysis},
  author = {James Eschrich and Sarah Sterman},
  journal= {arXiv preprint arXiv:2407.11198},
  year   = {2024}
}

Comments

4 pages, 1 table. Presented at the "LLMs as Research Tools" workshop at CHI 2024 (https://dl.acm.org/doi/10.1145/3613905.3636301)

R2 v1 2026-06-28T17:42:13.184Z