English

ArAIEval Shared Task: Propagandistic Techniques Detection in Unimodal and Multimodal Arabic Content

Computation and Language 2024-07-08 v1 Artificial Intelligence Computer Vision and Pattern Recognition

Abstract

We present an overview of the second edition of the ArAIEval shared task, organized as part of the ArabicNLP 2024 conference co-located with ACL 2024. In this edition, ArAIEval offers two tasks: (i) detection of propagandistic textual spans with persuasion techniques identification in tweets and news articles, and (ii) distinguishing between propagandistic and non-propagandistic memes. A total of 14 teams participated in the final evaluation phase, with 6 and 9 teams participating in Tasks 1 and 2, respectively. Finally, 11 teams submitted system description papers. Across both tasks, we observed that fine-tuning transformer models such as AraBERT was at the core of the majority of the participating systems. We provide a description of the task setup, including a description of the dataset construction and the evaluation setup. We further provide a brief overview of the participating systems. All datasets and evaluation scripts are released to the research community (https://araieval.gitlab.io/). We hope this will enable further research on these important tasks in Arabic.

Keywords

Cite

@article{arxiv.2407.04247,
  title  = {ArAIEval Shared Task: Propagandistic Techniques Detection in Unimodal and Multimodal Arabic Content},
  author = {Maram Hasanain and Md. Arid Hasan and Fatema Ahmed and Reem Suwaileh and Md. Rafiul Biswas and Wajdi Zaghouani and Firoj Alam},
  journal= {arXiv preprint arXiv:2407.04247},
  year   = {2024}
}

Comments

propaganda, span detection, disinformation, misinformation, fake news, LLMs, GPT-4, multimodality, multimodal LLMs

R2 v1 2026-06-28T17:29:46.114Z