中文
相关论文

相关论文: Harmfully Manipulated Images Matter in Multimodal …

200 篇论文

The increasing realism of multimodal content has made misinformation more subtle and harder to detect, especially in news media where images are frequently paired with bilingual (e.g., Chinese-English) subtitles. Such content often includes…

计算机视觉与模式识别 · 计算机科学 2025-12-10 Yiwei He , Zhenglin Huang , Haiquan Wen , Tianxiao Li , Yi Dong , Hao Fei , Baoyuan Wu , Guangliang Cheng

In recent years, monitoring hate speech and offensive language on social media platforms has become paramount due to its widespread usage among all age groups, races, and ethnicities. Consequently, there have been substantial research…

机器学习 · 计算机科学 2022-02-15 Aneri Rana , Sonali Jha

With information consumption via online video streaming becoming increasingly popular, misinformation video poses a new threat to the health of the online information ecosystem. Though previous studies have made much progress in detecting…

计算机视觉与模式识别 · 计算机科学 2023-08-08 Yuyan Bu , Qiang Sheng , Juan Cao , Peng Qi , Danding Wang , Jintao Li

Multimodal image-text memes are prevalent on the internet, serving as a unique form of communication that combines visual and textual elements to convey humor, ideas, or emotions. However, some memes take a malicious turn, promoting hateful…

计算机视觉与模式识别 · 计算机科学 2023-10-13 Giovanni Burbi , Alberto Baldrati , Lorenzo Agnolucci , Marco Bertini , Alberto Del Bimbo

An increasingly common expression of online hate speech is multimodal in nature and comes in the form of memes. Designing systems to automatically detect hateful content is of paramount importance if we are to mitigate its undesirable…

The rapid advancement of multimodal large language models (MLLMs) has significantly enhanced performance across benchmarks. However, data contamination-unintentional memorization of benchmark data during model training-poses critical…

计算机视觉与模式识别 · 计算机科学 2025-09-23 Dingjie Song , Sicheng Lai , Mingxuan Wang , Shunian Chen , Lichao Sun , Benyou Wang

Social media platforms enable the propagation of hateful content across different modalities such as textual, auditory, and visual, necessitating effective detection methods. While recent approaches have shown promise in handling individual…

计算机视觉与模式识别 · 计算机科学 2025-03-03 Girish A. Koushik , Diptesh Kanojia , Helen Treharne

As a multimodal medium combining images and text, memes frequently convey implicit harmful content through metaphors and humor, rendering the detection of harmful memes a complex and challenging task. Although recent studies have made…

计算与语言 · 计算机科学 2026-04-02 Hexiang Gu , Qifan Yu , Yuan Liu , Zikang Li , Saihui Hou , Jian Zhao , Zhaofeng He

Over the last years, there has been an unprecedented proliferation of fake news. As a consequence, we are more susceptible to the pernicious impact that misinformation and disinformation spreading can have in different segments of our…

计算与语言 · 计算机科学 2021-12-10 Santiago Alonso-Bartolome , Isabel Segura-Bedmar

Hateful meme detection presents a significant challenge as a multimodal task due to the complexity of interpreting implicit hate messages and contextual cues within memes. Previous approaches have fine-tuned pre-trained vision-language…

计算与语言 · 计算机科学 2025-02-18 Ming Shan Hee , Roy Ka-Wei Lee

Are frontier AI systems becoming more capable? Certainly. Yet such progress is not an unalloyed blessing but rather a Trojan horse: behind their performance leaps lie more insidious and destructive safety risks, namely deception. Unlike…

人工智能 · 计算机科学 2026-05-28 Sitong Fang , Shiyi Hou , Kaile Wang , Boyuan Chen , Donghai Hong , Jiayi Zhou , Josef Dai , Yaodong Yang , Jiaming Ji

Detecting multimodal misinformation, especially in the form of image-text pairs, is crucial. Obtaining large-scale, high-quality real-world fact-checking datasets for training detectors is costly, leading researchers to use synthetic…

计算与语言 · 计算机科学 2024-10-01 Fengzhu Zeng , Wenqian Li , Wei Gao , Yan Pang

The widespread of false information is a rising concern worldwide with critical social impact, inspiring the emergence of fact-checking organizations to mitigate misinformation dissemination. However, human-driven verification leads to a…

机器学习 · 计算机科学 2022-12-09 Vítor Lourenço , Aline Paes

The rise of multimodal misinformation on social platforms poses significant challenges for individuals and societies. Its increased credibility and broader impact compared to textual misinformation make detection complex, requiring robust…

计算与语言 · 计算机科学 2024-06-24 Keyang Xuan , Li Yi , Fan Yang , Ruochen Wu , Yi R. Fung , Heng Ji

Misinformation is often conveyed in multiple modalities, e.g. a miscaptioned image. Multimodal misinformation is perceived as more credible by humans, and spreads faster than its text-only counterparts. While an increasing body of research…

计算与语言 · 计算机科学 2023-10-27 Mubashara Akhtar , Michael Schlichtkrull , Zhijiang Guo , Oana Cocarascu , Elena Simperl , Andreas Vlachos

Image repurposing is a commonly used method for spreading misinformation on social media and online forums, which involves publishing untampered images with modified metadata to create rumors and further propaganda. While manual…

计算机视觉与模式识别 · 计算机科学 2019-04-11 Ayush Jaiswal , Yue Wu , Wael AbdAlmageed , Iacopo Masi , Premkumar Natarajan

Multimodal fake news detection (MFND) aims to verify news credibility by jointly exploiting textual and visual evidence. However, real-world news dissemination frequently suffers from missing modality due to deleted images, corrupted…

计算机视觉与模式识别 · 计算机科学 2026-04-14 Kai Qian , Weijie Shi , Jiaqi Wang , Mengze Li , Hao Chen , Yue Cui , Hanghui Guo , Ziyi Liu , Jia Zhu , Jiajie Xu

The social media-fuelled explosion of fake news and misinformation supported by tampered images has led to growth in the development of models and datasets for image manipulation detection. However, existing detection methods mostly treat…

计算机视觉与模式识别 · 计算机科学 2025-03-31 Joshua Krinsky , Alan Bettis , Qiuyu Tang , Daniel Moreira , Aparna Bharati

Misinformation on the web increasingly appears in multimodal forms, combining text, images, and OCR-rendered content in ways that amplify harm to public trust and vulnerable communities. While prior fact-checking systems often rely on…

计算与语言 · 计算机科学 2026-01-14 Aditya Kishore , Gaurav Kumar , Jasabanta Patro

AI-generated content (AIGC) technology has emerged as a prevalent alternative to create multimodal misinformation on social media platforms, posing unprecedented threats to societal safety. However, standard prompting leverages multimodal…

计算与语言 · 计算机科学 2025-12-01 Junjie Wu , Yumeng Fu , Chen Gong , Guohong Fu