English

Eliciting Topic Hierarchies from Large Language Models

Human-Computer Interaction 2024-06-19 v2

Abstract

Current research has explored how Generative AI can support the brainstorming process for content creators, but a gap remains in exploring support-tools for the pre-writing process. Specifically, our research is focused on supporting users in finding topics at the right level of specificity for their audience. This process is called topic scoping. Topic scoping is a cognitively demanding task, requiring users to actively recall subtopics in a given domain. This manual approach also reduces the diversity of subtopics that a user is able to explore. We propose using Large Language Models (LLMs) to support the process of topic scoping by iteratively generating subtopics at increasing levels of specificity: dynamically creating topic hierarchies. We tested three different prompting strategies and found that increasing the amount of context included in the prompt improves subtopic generation by 20 percentage points. Finally, we discuss applications of this research in education, content creation, and product management.

Keywords

Cite

@article{arxiv.2310.19275,
  title  = {Eliciting Topic Hierarchies from Large Language Models},
  author = {Grace Li and Tao Long and Lydia B. Chilton},
  journal= {arXiv preprint arXiv:2310.19275},
  year   = {2024}
}

Comments

6 pages, 6 figures

R2 v1 2026-06-28T13:05:29.966Z