English

Attacks, Defenses and Evaluations for LLM Conversation Safety: A Survey

Computation and Language 2024-03-28 v3 Artificial Intelligence Computers and Society Machine Learning

Abstract

Large Language Models (LLMs) are now commonplace in conversation applications. However, their risks of misuse for generating harmful responses have raised serious societal concerns and spurred recent research on LLM conversation safety. Therefore, in this survey, we provide a comprehensive overview of recent studies, covering three critical aspects of LLM conversation safety: attacks, defenses, and evaluations. Our goal is to provide a structured summary that enhances understanding of LLM conversation safety and encourages further investigation into this important subject. For easy reference, we have categorized all the studies mentioned in this survey according to our taxonomy, available at: https://github.com/niconi19/LLM-conversation-safety.

Keywords

Cite

@article{arxiv.2402.09283,
  title  = {Attacks, Defenses and Evaluations for LLM Conversation Safety: A Survey},
  author = {Zhichen Dong and Zhanhui Zhou and Chao Yang and Jing Shao and Yu Qiao},
  journal= {arXiv preprint arXiv:2402.09283},
  year   = {2024}
}

Comments

Accepted to NAACL 2024

R2 v1 2026-06-28T14:48:34.779Z