A Survey on Multimodal Disinformation Detection
Abstract
Recent years have witnessed the proliferation of offensive content online such as fake news, propaganda, misinformation, and disinformation. While initially this was mostly about textual content, over time images and videos gained popularity, as they are much easier to consume, attract more attention, and spread further than text. As a result, researchers started leveraging different modalities and combinations thereof to tackle online multimodal offensive content. In this study, we offer a survey on the state-of-the-art on multimodal disinformation detection covering various combinations of modalities: text, images, speech, video, social media network structure, and temporal information. Moreover, while some studies focused on factuality, others investigated how harmful the content is. While these two components in the definition of disinformation (i) factuality, and (ii) harmfulness, are equally important, they are typically studied in isolation. Thus, we argue for the need to tackle disinformation detection by taking into account multiple modalities as well as both factuality and harmfulness, in the same framework. Finally, we discuss current challenges and future research directions
Cite
@article{arxiv.2103.12541,
title = {A Survey on Multimodal Disinformation Detection},
author = {Firoj Alam and Stefano Cresci and Tanmoy Chakraborty and Fabrizio Silvestri and Dimiter Dimitrov and Giovanni Da San Martino and Shaden Shaar and Hamed Firooz and Preslav Nakov},
journal= {arXiv preprint arXiv:2103.12541},
year = {2022}
}
Comments
Accepted at COLING-2022, disinformation, misinformation, factuality, harmfulness, fake news, propaganda, multimodality, text, images, videos, network structure, temporality