English

Is ChatGPT better than Human Annotators? Potential and Limitations of ChatGPT in Explaining Implicit Hate Speech

Computation and Language 2023-03-17 v2 Human-Computer Interaction

Abstract

Recent studies have alarmed that many online hate speeches are implicit. With its subtle nature, the explainability of the detection of such hateful speech has been a challenging problem. In this work, we examine whether ChatGPT can be used for providing natural language explanations (NLEs) for implicit hateful speech detection. We design our prompt to elicit concise ChatGPT-generated NLEs and conduct user studies to evaluate their qualities by comparison with human-written NLEs. We discuss the potential and limitations of ChatGPT in the context of implicit hateful speech research.

Keywords

Cite

@article{arxiv.2302.07736,
  title  = {Is ChatGPT better than Human Annotators? Potential and Limitations of ChatGPT in Explaining Implicit Hate Speech},
  author = {Fan Huang and Haewoon Kwak and Jisun An},
  journal= {arXiv preprint arXiv:2302.07736},
  year   = {2023}
}

Comments

Accepted by The Web Conference Companion, 2023

R2 v1 2026-06-28T08:40:51.338Z