English

EtiCor: Corpus for Analyzing LLMs for Etiquettes

Computation and Language 2023-10-31 v1 Artificial Intelligence Machine Learning

Abstract

Etiquettes are an essential ingredient of day-to-day interactions among people. Moreover, etiquettes are region-specific, and etiquettes in one region might contradict those in other regions. In this paper, we propose EtiCor, an Etiquettes Corpus, having texts about social norms from five different regions across the globe. The corpus provides a test bed for evaluating LLMs for knowledge and understanding of region-specific etiquettes. Additionally, we propose the task of Etiquette Sensitivity. We experiment with state-of-the-art LLMs (Delphi, Falcon40B, and GPT-3.5). Initial results indicate that LLMs, mostly fail to understand etiquettes from regions from non-Western world.

Cite

@article{arxiv.2310.18974,
  title  = {EtiCor: Corpus for Analyzing LLMs for Etiquettes},
  author = {Ashutosh Dwivedi and Pradhyumna Lavania and Ashutosh Modi},
  journal= {arXiv preprint arXiv:2310.18974},
  year   = {2023}
}

Comments

Accepted at EMNLP 2023, Main Conference

R2 v1 2026-06-28T13:05:02.113Z