English

LLM-Supported Content Analysis of Motivated Reasoning on Climate Change

Social and Information Networks 2026-05-27 v1

Abstract

Public discourse around climate change remains polarized despite scientific consensus on anthropogenic climate change (ACC). This study examines how "believers" and "skeptics" of ACC differ in their YouTube comment discourse. We analyzed 44,989 comments from 30 videos using a large language model (LLM) as a qualitative annotator, identifying ten distinct topics. These annotations were combined with social network analysis to examine engagement patterns. A linear mixed-effects model showed that comments about government policy and natural cycles generated significantly lower interaction compared to misinformation, suggesting these topics are ideologically settled points within communities. These patterns reflect motivated reasoning, where users selectively engage with content that aligns with their identity and beliefs. Our findings highlight the utility of LLMs for large-scale qualitative analysis and highlight how climate discourse is shaped not only by content, but by underlying cognitive and ideological motivations.

Keywords

Cite

@article{arxiv.2508.21305,
  title  = {LLM-Supported Content Analysis of Motivated Reasoning on Climate Change},
  author = {Yuheun Kim and Qiaoyi Liu and Jeff Hemsley},
  journal= {arXiv preprint arXiv:2508.21305},
  year   = {2026}
}

Comments

11 pages, 3 figures. Accepted for ASIS&T 2025