English
Related papers

Related papers: Harmfully Manipulated Images Matter in Multimodal …

200 papers

The widespread prevalence of misinformation poses significant societal concerns. Out-of-context misinformation, where authentic images are paired with false text, is particularly deceptive and easily misleads audiences. Most existing…

Artificial Intelligence · Computer Science 2025-02-04 Giovanni Pio Delvecchio , Huy Hong Nguyen , Isao Echizen

Social media is accompanied by an increasing proportion of content that provides fake information or misleading content, known as information disorder. In this paper, we study the problem of multimodal fake news detection on a largescale…

Information Retrieval · Computer Science 2021-06-01 Armin Kirchknopf , Djordje Slijepcevic , Matthias Zeppelzauer

Multimodal disinformation, from 'deepfakes' to simple edits that deceive, is an important societal problem. Yet at the same time, the vast majority of media edits are harmless -- such as a filtered vacation photo. The difference between…

Computation and Language · Computer Science 2025-03-28 Jeff Da , Maxwell Forbes , Rowan Zellers , Anthony Zheng , Jena D. Hwang , Antoine Bosselut , Yejin Choi

Multimodal Misinformation Recognition has become an urgent task with the emergence of huge multimodal fake content on social media platforms. Previous studies mainly focus on complex feature extraction and fusion to learn discriminative…

Multimedia · Computer Science 2025-10-15 Hengyang Zhou , Yiwei Wei , Jian Yang , Zhenyu Zhang

Multimodal news contains a wealth of information and is easily affected by deepfake modeling attacks. To combat the latest image and text generation methods, we present a new Multimodal Fake News Detection dataset (MFND) containing 11…

Computer Vision and Pattern Recognition · Computer Science 2025-05-13 Ye Zhu , Yunan Wang , Zitong Yu

The proliferation of disinformation, particularly in multimodal contexts combining text and images, presents a significant challenge across digital platforms. This study investigates the potential of large multimodal models (LMMs) in…

Computer Vision and Pattern Recognition · Computer Science 2025-09-29 Yasmina Kheddache , Marc Lalonde

The detection and grounding of multimedia manipulation has emerged as a critical challenge in combating AI-generated disinformation. While existing methods have made progress in recent years, we identify two fundamental limitations in…

Computer Vision and Pattern Recognition · Computer Science 2026-03-16 Yuchen Zhang , Yaxiong Wang , Yujiao Wu , Lianwei Wu , Li Zhu , Zhedong Zheng

Social media misinformation harms individuals and societies and is potentialized by fast-growing multi-modal content (i.e., texts and images), which accounts for higher "credibility" than text-only news pieces. Although existing supervised…

Artificial Intelligence · Computer Science 2023-11-27 Hui Liu , Wenya Wang , Hao Sun , Anderson Rocha , Haoliang Li

In this paper, we delve into the rapidly evolving challenge of misinformation detection, with a specific focus on the nuanced manipulation of narrative frames - an under-explored area within the AI community. The potential for Generative AI…

Computation and Language · Computer Science 2024-02-27 Guan Wang , Rebecca Frederick , Jinglong Duan , William Wong , Verica Rupar , Weihua Li , Quan Bai

The age of social media is flooded with Internet memes, necessitating a clear grasp and effective identification of harmful ones. This task presents a significant challenge due to the implicit meaning embedded in memes, which is not…

Computation and Language · Computer Science 2024-01-25 Hongzhan Lin , Ziyang Luo , Wei Gao , Jing Ma , Bo Wang , Ruichao Yang

Short video platforms have become important channels for news dissemination, offering a highly engaging and immediate way for users to access current events and share information. However, these platforms have also emerged as significant…

Computer Vision and Pattern Recognition · Computer Science 2024-11-18 Weihao Zhong , Yinhao Xiao , Minghui Xu , Xiuzhen Cheng

Multimodal misinformation, such as miscaptioned images, where captions misrepresent an image's origin, context, or meaning, poses a growing challenge in the digital age. Due to the scarcity of large-scale annotated datasets for multimodal…

Computer Vision and Pattern Recognition · Computer Science 2026-01-14 Stefanos-Iordanis Papadopoulos , Christos Koutlis , Symeon Papadopoulos , Panagiotis C. Petrantonakis

The age of social media is rife with memes. Understanding and detecting harmful memes pose a significant challenge due to their implicit meaning that is not explicitly conveyed through the surface text and image. However, existing harmful…

Computation and Language · Computer Science 2023-12-12 Hongzhan Lin , Ziyang Luo , Jing Ma , Long Chen

The key challenge of image manipulation detection is how to learn generalizable features that are sensitive to manipulations in novel data, whilst specific to prevent false alarms on authentic images. Current research emphasizes the…

Computer Vision and Pattern Recognition · Computer Science 2021-07-27 Xinru Chen , Chengbo Dong , Jiaqi Ji , Juan Cao , Xirong Li

Internet memes have become a dominant method of communication; at the same time, however, they are also increasingly being used to advocate extremism and foster derogatory beliefs. Nonetheless, we do not have a firm understanding as to…

The increasing proliferation of misinformation and its alarming impact have motivated both industry and academia to develop approaches for misinformation detection and fact checking. Recent advances on large language models (LLMs) have…

Computation and Language · Computer Science 2024-07-22 Sahar Tahmasebi , Eric Müller-Budack , Ralph Ewerth

The rapid growth of social media has led to the widespread dissemination of fake news across multiple content forms, including text, images, audio, and video. Traditional unimodal detection methods fall short in addressing complex…

Multimedia · Computer Science 2025-04-15 Moyang Liu , Kaiying Yan , Yukun Liu , Ruibo Fu , Zhengqi Wen , Xuefei Liu , Chenxing Li

Preventing the spread of misinformation is challenging. The detection of misleading content presents a significant hurdle due to its extreme linguistic and domain variability. Content-based models have managed to identify deceptive language…

Computation and Language · Computer Science 2024-01-30 Flavio Merenda , José Manuel Gómez-Pérez

The rapid growth of social media has resulted in an explosion of online news content, leading to a significant increase in the spread of misleading or false information. While machine learning techniques have been widely applied to detect…

Computation and Language · Computer Science 2024-12-10 Hao Chen , Hui Guo , Baochen Hu , Shu Hu , Jinrong Hu , Siwei Lyu , Xi Wu , Xin Wang

In recent years, detecting fake multimodal content on social media has drawn increasing attention. Two major forms of deception dominate: human-crafted misinformation (e.g., rumors and misleading posts) and AI-generated content produced by…

Artificial Intelligence · Computer Science 2025-10-17 Haiyang Li , Yaxiong Wang , Shengeng Tang , Lianwei Wu , Lechao Cheng , Zhun Zhong