English

Are LLM-Powered Social Media Bots Realistic?

Social and Information Networks 2025-08-25 v2 Artificial Intelligence

Abstract

As Large Language Models (LLMs) become more sophisticated, there is a possibility to harness LLMs to power social media bots. This work investigates the realism of generating LLM-Powered social media bot networks. Through a combination of manual effort, network science and LLMs, we create synthetic bot agent personas, their tweets and their interactions, thereby simulating social media networks. We compare the generated networks against empirical bot/human data, observing that both network and linguistic properties of LLM-Powered Bots differ from Wild Bots/Humans. This has implications towards the detection and effectiveness of LLM-Powered Bots.

Keywords

Cite

@article{arxiv.2508.00998,
  title  = {Are LLM-Powered Social Media Bots Realistic?},
  author = {Lynnette Hui Xian Ng and Kathleen M. Carley},
  journal= {arXiv preprint arXiv:2508.00998},
  year   = {2025}
}

Comments

Accepted into SBP-BRiMS 2025