English
Related papers

Related papers: Interpretable Multimodal Misinformation Detection …

200 papers

Detecting out-of-context media, such as "mis-captioned" images on Twitter, is a relevant problem, especially in domains of high public significance. In this work we aim to develop defenses against such misinformation for the topics of…

Computer Vision and Pattern Recognition · Computer Science 2022-05-04 Giscard Biamby , Grace Luo , Trevor Darrell , Anna Rohrbach

Online users today are exposed to misleading and propagandistic news articles and media posts on a daily basis. To counter thus, a number of approaches have been designed aiming to achieve a healthier and safer online news and media…

Computation and Language · Computer Science 2021-08-31 Seunghak Yu , Giovanni Da San Martino , Mitra Mohtarami , James Glass , Preslav Nakov

The rise of social media has enabled the widespread propagation of fake news, text that is published with an intent to spread misinformation and sway beliefs. Rapidly detecting fake news, especially as new events arise, is important to…

Computation and Language · Computer Science 2023-09-27 Nikhil Mehta , Dan Goldwasser

The growing societal dependence on social media and user generated content for news and information has increased the influence of unreliable sources and fake content, which muddles public discourse and lessens trust in the media.…

Computation and Language · Computer Science 2022-09-07 Marjan Hosseini , Alireza Javadian Sabet , Suining He , Derek Aguiar

The rapid spread of misinformation in mobile and wireless networks presents critical security challenges. This study introduces a training-free, retrieval-based multimodal fact verification system that leverages pretrained vision-language…

Multimedia · Computer Science 2025-06-27 Van-Hoang Phan , Long-Khanh Pham , Dang Vu , Anh-Duy Tran , Minh-Son Dao

The pervasiveness of the dissemination of fake news through social media platforms poses critical risks to the trust of the general public, societal stability, and democratic institutions. This challenge calls for novel methodologies in…

Computation and Language · Computer Science 2025-02-04 Jingyuan Yi , Zeqiu Xu , Tianyi Huang , Peiyang Yu

Multimodal large language models (MLLMs) perform strongly on natural images, yet their ability to understand discrete visual symbols remains unclear. We present a multi-domain benchmark spanning language, culture, mathematics, physics and…

Social media misinformation harms individuals and societies and is potentialized by fast-growing multi-modal content (i.e., texts and images), which accounts for higher "credibility" than text-only news pieces. Although existing supervised…

Artificial Intelligence · Computer Science 2023-11-27 Hui Liu , Wenya Wang , Hao Sun , Anderson Rocha , Haoliang Li

Misinformation is a prevalent societal issue due to its potential high risks. Out-of-context (OOC) misinformation, where authentic images are repurposed with false text, is one of the easiest and most effective ways to mislead audiences.…

Multimedia · Computer Science 2024-03-12 Peng Qi , Zehong Yan , Wynne Hsu , Mong Li Lee

The proliferation of misinformation on social media has raised significant societal concerns, necessitating robust detection mechanisms. Large Language Models such as GPT-4 and LLaMA2 have been envisioned as possible tools for detecting…

Computation and Language · Computer Science 2025-03-04 Tianyi Huang , Jingyuan Yi , Peiyang Yu , Xiaochuan Xu

Automated decision-making systems are becoming increasingly ubiquitous, which creates an immediate need for their interpretability and explainability. However, it remains unclear whether users know what insights an explanation offers and,…

Human-Computer Interaction · Computer Science 2024-09-27 Yueqing Xuan , Edward Small , Kacper Sokol , Danula Hettiachchi , Mark Sanderson

The most effective misinformation campaigns are multimodal, often combining text with images and videos taken out of context -- or fabricating them entirely -- to support a given narrative. Contemporary methods for detecting misinformation,…

Computation and Language · Computer Science 2025-02-17 Tomas Peterka , Matyas Bohacek

We study the interpretability issue of task-oriented dialogue systems in this paper. Previously, most neural-based task-oriented dialogue systems employ an implicit reasoning strategy that makes the model predictions uninterpretable to…

Computation and Language · Computer Science 2022-03-14 Shiquan Yang , Rui Zhang , Sarah Erfani , Jey Han Lau

The increasing proliferation of misinformation and its alarming impact have motivated both industry and academia to develop approaches for misinformation detection and fact checking. Recent advances on large language models (LLMs) have…

Computation and Language · Computer Science 2024-07-22 Sahar Tahmasebi , Eric Müller-Budack , Ralph Ewerth

Multimodal out-of-context (OOC) misinformation is misinformation that repurposes real images with unrelated or misleading captions. Detecting such misinformation is challenging because it requires resolving the context of the claim before…

Machine Learning · Computer Science 2025-05-27 Sharad Duwal , Mir Nafis Sharear Shopnil , Abhishek Tyagi , Adiba Mahbub Proma

Large language models (LLMs) are a promising venue for natural language understanding and generation. However, current LLMs are far from reliable: they are prone to generating non-factual information and, more crucially, to contradicting…

Computation and Language · Computer Science 2024-09-24 Diego Calanzone , Stefano Teso , Antonio Vergari

The rapid spread of misinformation on digital platforms threatens public discourse, emotional stability, and decision-making. While prior work has explored various adversarial attacks in misinformation detection, the specific…

Computation and Language · Computer Science 2025-10-13 Nouar Aldahoul , Yasir Zaki

The past decade has seen a substantial rise in the amount of mis- and disinformation online, from targeted disinformation campaigns to influence politics, to the unintentional spreading of misinformation about public health. This…

Computation and Language · Computer Science 2021-12-09 Isabelle Augenstein

Reasoning is central to human intelligence, enabling structured problem-solving across diverse tasks. Recent advances in large language models (LLMs) have greatly enhanced their reasoning abilities in arithmetic, commonsense, and symbolic…

Combating fake news and misinformation propagation is a challenging task in the post-truth era. News feed and search algorithms could potentially lead to unintentional large-scale propagation of false and fabricated information with users…

Information Retrieval · Computer Science 2020-07-28 Sina Mohseni , Fan Yang , Shiva Pentyala , Mengnan Du , Yi Liu , Nic Lupfer , Xia Hu , Shuiwang Ji , Eric Ragan