POLAR:一个面向多语言、多文化和多事件在线极化的基准数据集
计算与语言
2026-02-06 v3
摘要
在线极化对民主话语构成了日益严峻的挑战,然而大多数计算社会科学研究仍局限于单语、文化狭窄或特定事件。我们引入了 POLAR,这是一个多语言、多文化和多事件的数据集,包含来自不同在线平台和真实世界事件的 22 种语言的超过 11 万个实例。极化沿着三个轴进行标注,即检测、类型和表现形式,使用了适应每种文化背景的多种标注平台。我们进行了两项主要实验:(1)微调六个预训练的小语言模型;(2)在少样本和零样本设置下评估一系列开源和闭源大语言模型。结果表明,尽管大多数模型在二分类极化检测中表现良好,但在预测极化类型和表现形式时,其性能显著降低。这些发现凸显了极化高度复杂和强语境依赖的特性,并证明了在自然语言处理(NLP)和计算社会科学中需要鲁棒且适应性强的分析方法。所有资源将被发布,以支持全球范围内对数字极化的进一步研究和有效缓解。
引用
@article{arxiv.2505.20624,
title = {POLAR: A Benchmark for Multilingual, Multicultural, and Multi-Event Online Polarization},
author = {Usman Naseem and Robert Geislinger and Juan Ren and Sarah Kohail and Rudy Garrido Veliz and P Sam Sahil and Yiran Zhang and Marco Antonio Stranisci and Idris Abdulmumin and Özge Alacam and Cengiz Acartürk and Aisha Jabr and Saba Anwar and Abinew Ali Ayele and Simona Frenda and Alessandra Teresa Cignarella and Elena Tutubalina and Oleg Rogov and Aung Kyaw Htet and Xintong Wang and Surendrabikram Thapa and Kritesh Rauniyar and Tanmoy Chakraborty and Arfeen Zeeshan and Dheeraj Kodati and Satya Keerthi and Sahar Moradizeyveh and Firoj Alam and Arid Hasan and Syed Ishtiaque Ahmed and Ye Kyaw Thu and Shantipriya Parida and Ihsan Ayyub Qazi and Lilian Wanzare and Nelson Odhiambo Onyango and Clemencia Siro and Jane Wanjiru Kimani and Ibrahim Said Ahmad and Adem Chanie Ali and Martin Semmann and Chris Biemann and Shamsuddeen Hassan Muhammad and Seid Muhie Yimam},
journal= {arXiv preprint arXiv:2505.20624},
year = {2026}
}
备注
Preprint