中文
相关论文

相关论文: Towards Explainable Bilingual Multimodal Misinform…

200 篇论文

Disinformation spreads rapidly across linguistic boundaries, yet most AI models are still benchmarked only on English. We address this gap with a systematic comparison of five multilingual transformer models: mBERT, XLM, XLM-RoBERTa,…

计算与语言 · 计算机科学 2026-05-12 Zaur Gouliev , Jennifer Waters , Chengqian Wang

The rapid spread of misinformation on online platforms undermines trust among individuals and hinders informed decision making. This paper shows an explainable and computationally efficient pipeline to detect misinformation using…

计算与语言 · 计算机科学 2025-10-23 Jainee Patel , Chintan Bhatt , Himani Trivedi , Thanh Thi Nguyen

Detecting disinformation that blends manipulated text and images has become increasingly challenging, as AI tools make synthetic content easy to generate and disseminate. While most existing AI safety benchmarks focus on single modality…

The exponential rise of social media and digital news in the past decade has had the unfortunate consequence of escalating what the United Nations has called a global topic of concern: the growing prevalence of disinformation. Given the…

计算与语言 · 计算机科学 2019-11-28 Chris Dulhanty , Jason L. Deglint , Ibrahim Ben Daya , Alexander Wong

The increasing proliferation of misinformation and its alarming impact have motivated both industry and academia to develop approaches for misinformation detection and fact checking. Recent advances on large language models (LLMs) have…

计算与语言 · 计算机科学 2024-07-22 Sahar Tahmasebi , Eric Müller-Budack , Ralph Ewerth

Recent years have witnessed the proliferation of offensive content online such as fake news, propaganda, misinformation, and disinformation. While initially this was mostly about textual content, over time images and videos gained…

The World Wide Web and social media platforms have become popular sources for news and information. Typically, multimodal information, e.g., image and text is used to convey information more effectively and to attract attention. While in…

信息检索 · 计算机科学 2021-04-29 Matthias Springstein , Eric Müller-Budack , Ralph Ewerth

Multimodal misinformation, such as miscaptioned images, where captions misrepresent an image's origin, context, or meaning, poses a growing challenge in the digital age. Due to the scarcity of large-scale annotated datasets for multimodal…

计算机视觉与模式识别 · 计算机科学 2026-01-14 Stefanos-Iordanis Papadopoulos , Christos Koutlis , Symeon Papadopoulos , Panagiotis C. Petrantonakis

The rapid spread of multimodal misinformation on social media calls for more effective and robust detection methods. Recent advances leveraging multimodal large language models (MLLMs) have shown the potential in addressing this challenge.…

计算与语言 · 计算机科学 2025-08-15 Yuzhuo Xiao , Zeyu Han , Yuhan Wang , Huaizu Jiang

News image captioning aims to produce journalistically informative descriptions by combining visual content with contextual cues from associated articles. Despite recent advances, existing methods struggle with three key challenges: (1)…

计算机视觉与模式识别 · 计算机科学 2025-11-27 Xiaoxing You , Qiang Huang , Lingyu Li , Chi Zhang , Xiaopeng Liu , Min Zhang , Jun Yu

The proliferation of online misinformation videos poses serious societal risks. Current datasets and detection methods primarily target binary classification or single-modality localization based on post-processed data, lacking the…

社会与信息网络 · 计算机科学 2025-09-11 Bingjian Yang , Danni Xu , Kaipeng Niu , Wenxuan Liu , Zheng Wang , Mohan Kankanhalli

Misinformation is becoming increasingly prevalent on social media and in news articles. It has become so widespread that we require algorithmic assistance utilising machine learning to detect such content. Training these machine learning…

机器学习 · 计算机科学 2022-03-09 Dan Saattrup Nielsen , Ryan McConville

In recent years, the rampant spread of misinformation on social media has made accurate detection of multimodal fake news a critical research focus. However, previous research has not adequately understood the semantics of images, and…

多媒体 · 计算机科学 2025-07-18 Peican Zhu , Yubo Jing , Le Cheng , Keke Tang , Yangming Guo

This study addresses generating counterfactual explanations with multimodal information. Our goal is not only to classify a video into a specific category, but also to provide explanations on why it is not categorized to a specific class…

计算机视觉与模式识别 · 计算机科学 2019-05-21 Atsushi Kanehira , Kentaro Takemoto , Sho Inayoshi , Tatsuya Harada

In multimodal misinformation, deception usually arises not just from pixel-level manipulations in an image, but from the semantic and contextual claim jointly expressed by the image-text pair. Yet most deepfake detectors, engineered to…

计算机视觉与模式识别 · 计算机科学 2026-02-03 A S M Sharifuzzaman Sagar , Mohammed Bennamoun , Farid Boussaid , Naeha Sharif , Lian Xu , Shaaban Sahmoud , Ali Kishk

Detecting bias in multimodal news requires models that reason over text--image pairs, not just classify text. In response, we present ViLBias, a VQA-style benchmark and framework for detecting and reasoning about bias in multimodal news.…

Multimodal out-of-context (OOC) misinformation is misinformation that repurposes real images with unrelated or misleading captions. Detecting such misinformation is challenging because it requires resolving the context of the claim before…

机器学习 · 计算机科学 2025-05-27 Sharad Duwal , Mir Nafis Sharear Shopnil , Abhishek Tyagi , Adiba Mahbub Proma

The increasing proliferation of misinformation and its alarming impact have motivated both industry and academia to develop approaches for fake news detection. However, state-of-the-art approaches are usually trained on datasets of smaller…

计算与语言 · 计算机科学 2023-05-31 Sahar Tahmasebi , Sherzod Hakimov , Ralph Ewerth , Eric Müller-Budack

Social media is accompanied by an increasing proportion of content that provides fake information or misleading content, known as information disorder. In this paper, we study the problem of multimodal fake news detection on a largescale…

信息检索 · 计算机科学 2021-06-01 Armin Kirchknopf , Djordje Slijepcevic , Matthias Zeppelzauer

Multimodal manipulation detection aims to simultaneously identify forged image--text pairs and localize tampered regions, yet existing methods typically rely on memorizing isolated artifacts and struggle with imperceptible manipulation…

计算机视觉与模式识别 · 计算机科学 2026-05-28 Jun Zhou , Bingwen Hu , Yaxiong Wang , Zhedong Zheng , Yongzhen Wang , Yuchen Zhang , Ping Liu