English

Political-LLM: Large Language Models in Political Science

Computation and Language 2024-12-11 v1 Artificial Intelligence

Abstract

In recent years, large language models (LLMs) have been widely adopted in political science tasks such as election prediction, sentiment analysis, policy impact assessment, and misinformation detection. Meanwhile, the need to systematically understand how LLMs can further revolutionize the field also becomes urgent. In this work, we--a multidisciplinary team of researchers spanning computer science and political science--present the first principled framework termed Political-LLM to advance the comprehensive understanding of integrating LLMs into computational political science. Specifically, we first introduce a fundamental taxonomy classifying the existing explorations into two perspectives: political science and computational methodologies. In particular, from the political science perspective, we highlight the role of LLMs in automating predictive and generative tasks, simulating behavior dynamics, and improving causal inference through tools like counterfactual generation; from a computational perspective, we introduce advancements in data preparation, fine-tuning, and evaluation methods for LLMs that are tailored to political contexts. We identify key challenges and future directions, emphasizing the development of domain-specific datasets, addressing issues of bias and fairness, incorporating human expertise, and redefining evaluation criteria to align with the unique requirements of computational political science. Political-LLM seeks to serve as a guidebook for researchers to foster an informed, ethical, and impactful use of Artificial Intelligence in political science. Our online resource is available at: http://political-llm.org/.

Keywords

Cite

@article{arxiv.2412.06864,
  title  = {Political-LLM: Large Language Models in Political Science},
  author = {Lincan Li and Jiaqi Li and Catherine Chen and Fred Gui and Hongjia Yang and Chenxiao Yu and Zhengguang Wang and Jianing Cai and Junlong Aaron Zhou and Bolin Shen and Alex Qian and Weixin Chen and Zhongkai Xue and Lichao Sun and Lifang He and Hanjie Chen and Kaize Ding and Zijian Du and Fangzhou Mu and Jiaxin Pei and Jieyu Zhao and Swabha Swayamdipta and Willie Neiswanger and Hua Wei and Xiyang Hu and Shixiang Zhu and Tianlong Chen and Yingzhou Lu and Yang Shi and Lianhui Qin and Tianfan Fu and Zhengzhong Tu and Yuzhe Yang and Jaemin Yoo and Jiaheng Zhang and Ryan Rossi and Liang Zhan and Liang Zhao and Emilio Ferrara and Yan Liu and Furong Huang and Xiangliang Zhang and Lawrence Rothenberg and Shuiwang Ji and Philip S. Yu and Yue Zhao and Yushun Dong},
  journal= {arXiv preprint arXiv:2412.06864},
  year   = {2024}
}

Comments

54 Pages, 9 Figures