中文
相关论文

相关论文: RW-Post: Auditable Evidence-Grounded Multimodal Fa…

200 篇论文

Multimodal fake news detection is crucial for mitigating adversarial misinformation. Existing methods, relying on static fusion or LLMs, face computational redundancy and hallucination risks due to weak visual foundations. To address this,…

计算机视觉与模式识别 · 计算机科学 2026-01-13 Weilin Zhou , Zonghao Ying , Chunlei Meng , Jiahui Liu , Hengyang Zhou , Quanchen Zou , Deyue Zhang , Dongdong Yang , Xiangzheng Zhang

The rapid proliferation of multimodal misinformation presents significant challenges for automated fact-checking systems, especially when claims are ambiguous or lack sufficient context. We introduce RAMA, a novel retrieval-augmented…

计算与语言 · 计算机科学 2025-07-15 Shuo Yang , Zijian Yu , Zhenzhe Ying , Yuqin Dai , Guoqing Wang , Jun Lan , Jinfeng Xu , Jinze Li , Edith C. H. Ngai

Automated Fact-Checking (AFC) relies on claim extraction as a first step, yet existing methods largely overlook the multimodal nature of today's misinformation. Social media posts often combine short, informal text with images such as…

计算与语言 · 计算机科学 2026-04-21 Joycelyn Teo , Rui Cao , Zhenyun Deng , Zifeng Ding , Michael Sejr Schlichtkrull , Andreas Vlachos

Visual reasoning is central to human cognition, enabling individuals to interpret and abstractly understand their environment. Although recent Multimodal Large Language Models (MLLMs) have demonstrated impressive performance across language…

计算机视觉与模式识别 · 计算机科学 2025-03-17 Jing Bi , Junjia Guo , Susan Liang , Guangyu Sun , Luchuan Song , Yunlong Tang , Jinxi He , Jiarui Wu , Ali Vosoughi , Chen Chen , Chenliang Xu

Recent years have witnessed the sustained evolution of misinformation that aims at manipulating public opinions. Unlike traditional rumors or fake news editors who mainly rely on generated and/or counterfeited images, text and videos,…

计算与语言 · 计算机科学 2024-04-09 Yizhou Zhang , Loc Trinh , Defu Cao , Zijun Cui , Yan Liu

This paper describes our participant system for the multi-modal fact verification (Factify) challenge at AAAI 2022. Despite the recent advance in text based verification techniques and large pre-trained multimodal models cross vision and…

计算机视觉与模式识别 · 计算机科学 2022-03-29 Jie Gao , Hella-Franziska Hoffmann , Stylianos Oikonomou , David Kiskovski , Anil Bandhakavi

Textual claims are often accompanied by images to enhance their credibility and spread on social media, but this also raises concerns about the spread of misinformation. Existing datasets for automated verification of image-text claims…

计算与语言 · 计算机科学 2025-10-08 Rui Cao , Zifeng Ding , Zhijiang Guo , Michael Schlichtkrull , Andreas Vlachos

Exponential growth in digital information outlets and the race to publish has made scientific misinformation more prevalent than ever. However, the task to fact-verify a given scientific claim is not straightforward even for researchers.…

计算与语言 · 计算机科学 2022-04-19 Ashish Rana , Deepanshu Khanna , Tirthankar Ghosal , Muskaan Singh , Harpreet Singh , Prashant Singh Rana

The rapid proliferation of misinformation across online platforms underscores the urgent need for robust, up-to-date, explainable, and multilingual fact-checking resources. However, existing datasets are limited in scope, often lacking…

计算与语言 · 计算机科学 2026-03-18 Z. Melce Hüsünbeyi , Virginie Mouilleron , Leonie Uhling , Daniel Foppe , Tatjana Scheffler , Djamé Seddah

Web-scale visual entity recognition, the task of associating images with their corresponding entities within vast knowledge bases like Wikipedia, presents significant challenges due to the lack of clean, large-scale training data. In this…

计算机视觉与模式识别 · 计算机科学 2024-11-01 Mathilde Caron , Alireza Fathi , Cordelia Schmid , Ahmet Iscen

Users of social networks tend to post and share content with little restraint. Hence, rumors and fake news can quickly spread on a huge scale. This may pose a threat to the credibility of social media and can cause serious consequences in…

社会与信息网络 · 计算机科学 2021-09-07 Abderrazek Azri , Cécile Favre , Nouria Harbi , Jérôme Darmont , Camille Noûs

Large Language Models (LLMs) hold significant potential for advancing fact-checking by leveraging their capabilities in reasoning, evidence retrieval, and explanation generation. However, existing benchmarks fail to comprehensively evaluate…

计算与语言 · 计算机科学 2025-06-17 Shuo Yang , Yuqin Dai , Guoqing Wang , Xinran Zheng , Jinfeng Xu , Jinze Li , Zhenzhe Ying , Weiqiang Wang , Edith C. H. Ngai

Multimodal large language models (MLLMs) often struggle to ground reasoning in perceptual evidence. We present a systematic study of perception strategies-explicit, implicit, visual, and textual-across four multimodal benchmarks and two…

计算机视觉与模式识别 · 计算机科学 2025-09-30 Yizhuo Ding , Mingkang Chen , Zhibang Feng , Tong Xiao , Wanying Qu , Wenqi Shao , Yanwei Fu

The rapid spread of misinformation in mobile and wireless networks presents critical security challenges. This study introduces a training-free, retrieval-based multimodal fact verification system that leverages pretrained vision-language…

多媒体 · 计算机科学 2025-06-27 Van-Hoang Phan , Long-Khanh Pham , Dang Vu , Anh-Duy Tran , Minh-Son Dao

Multi-image reasoning and grounding require understanding complex cross-image relationships at both object levels and image levels. Current Large Visual Language Models (LVLMs) face two critical challenges: the lack of cross-image reasoning…

计算机视觉与模式识别 · 计算机科学 2025-09-29 Lihao Zheng , Jiawei Chen , Xintian Shen , Hao Ma , Tao Wei

Recent work shows that text-only reinforcement learning with verifiable rewards (RLVR) can match or outperform image-text RLVR on multimodal medical VQA benchmarks, suggesting current evaluation protocols may fail to measure causal visual…

计算机视觉与模式识别 · 计算机科学 2026-03-05 Anas Zafar , Leema Krishna Murali , Ashish Vashist

Social media content routinely incorporates multi-modal design to covey information and shape meanings, and sway interpretations toward desirable implications, but the choices and outcomes of using both texts and visual images have not been…

计算与语言 · 计算机科学 2023-03-13 Mesut Erhan Unal , Adriana Kovashka , Wen-Ting Chung , Yu-Ru Lin

Given the widespread dissemination of misinformation on social media, implementing fact-checking mechanisms for online claims is essential. Manually verifying every claim is very challenging, underscoring the need for an automated…

计算与语言 · 计算机科学 2024-10-08 Ronit Singhal , Pransh Patwa , Parth Patwa , Aman Chadha , Amitava Das

Misinformation and disinformation demand fact checking that goes beyond simple evidence-based reasoning. Existing benchmarks fall short: they are largely single modality (text-only), span short time horizons, use shallow evidence, cover…

社会与信息网络 · 计算机科学 2025-10-30 Wenyan Xu , Dawei Xiang , Tianqi Ding , Weihai Lu

The proliferation of multimedia content on social media platforms has dramatically transformed how information is consumed and disseminated. While this shift enables real-time coverage of global events, it also facilitates the rapid spread…