English
Related papers

Related papers: RW-Post: Auditable Evidence-Grounded Multimodal Fa…

200 papers

Despite the ubiquity and proliferation of images and videos in online news environments, much of the existing research on misinformation and its correction is solely focused on textual misinformation, and little is known about how ordinary…

Social and Information Networks · Computer Science 2023-03-10 Cuihua Shen , Mona Kasra , James O'Brien

Multiple-choice question answering (MCQA) has been a popular format for evaluating and reinforcement fine-tuning (RFT) of modern multimodal language models. Its constrained output format allows for simplified, deterministic automatic…

Computation and Language · Computer Science 2025-11-25 Yesheng Liu , Hao Li , Haiyu Xu , Baoqi Pei , Jiahao Wang , Mingxuan Zhao , Jingshu Zheng , Zheqi He , JG Yao , Bowen Qin , Xi Yang , Jiajun Zhang

The proliferation of multi-modal fake news on social media poses a significant threat to public trust and social stability. Traditional detection methods, primarily text-based, often fall short due to the deceptive interplay between…

Cryptography and Security · Computer Science 2025-08-11 Junhao He , Tianyu Liu , Jingyuan Zhao , Benjamin Turner

Automatic fact-checking plays a crucial role in combating the spread of misinformation. Large Language Models (LLMs) and Instruction-Following variants, such as InstructGPT and Alpaca, have shown remarkable performance in various natural…

Computation and Language · Computer Science 2023-09-04 Tsun-Hin Cheung , Kin-Man Lam

Recent advances have showcased the extraordinary capabilities of Large Language Model (LLM) agents in tackling web-based information-seeking tasks. However, existing efforts mainly focus on single-fact retrieval and rely on outcome-only…

Fact checking is an essential task in journalism; its importance has been highlighted due to recently increased concerns and efforts in combating misinformation. In this paper, we present an automated fact-checking platform which given a…

Computation and Language · Computer Science 2019-04-04 Sebastião Miranda , David Nogueira , Afonso Mendes , Andreas Vlachos , Andrew Secker , Rebecca Garrett , Jeff Mitchel , Zita Marinho

Existing multimodal retrieval benchmarks primarily focus on evaluating whether models can retrieve and utilize external textual knowledge for question answering. However, there are scenarios where retrieving visual information is either…

Computer Vision and Pattern Recognition · Computer Science 2025-03-21 Wenbo Hu , Jia-Chen Gu , Zi-Yi Dou , Mohsen Fayyaz , Pan Lu , Kai-Wei Chang , Nanyun Peng

Recently multimodal named entity recognition (MNER) has utilized images to improve the accuracy of NER in tweets. However, most of the multimodal methods use attention mechanisms to extract visual clues regardless of whether the text and…

Computation and Language · Computer Science 2021-02-08 Lin Sun , Jiquan Wang , Kai Zhang , Yindu Su , Fangsheng Weng

The verification of multimedia content over social media is one of the challenging and crucial issues in the current scenario and gaining prominence in an age where user-generated content and online social web platforms are the leading…

Social and Information Networks · Computer Science 2021-09-22 Deepika Varshney , Dinesh Kumar Vishwakarma

Social media has evolved into a complex multimodal environment where text, images, and other signals interact to shape nuanced meanings, often concealing harmful intent. Identifying such intent, whether sarcasm, hate speech, or…

Artificial Intelligence · Computer Science 2025-09-09 Rui Lu , Jinhe Bi , Yunpu Ma , Feng Xiao , Yuntao Du , Yijun Tian

The nuisance of misinformation and fake news has escalated many folds since the advent of online social networks. Human consciousness and decision-making capabilities are negatively influenced by manipulated, fabricated, biased or…

Social and Information Networks · Computer Science 2021-09-28 Priyanka Meel , Dinesh Kumar Vishwakarma

Recent work shows that text-only reinforcement learning with verifiable rewards (RLVR) can match or outperform image-text RLVR on multimodal medical VQA benchmarks, suggesting current evaluation protocols may fail to measure causal visual…

Computer Vision and Pattern Recognition · Computer Science 2026-03-05 Anas Zafar , Leema Krishna Murali , Ashish Vashist

Large reasoning models (LRMs) show strong capabilities in complex reasoning, yet their marginal gains on evidence-dependent factual questions are limited. We find this limitation is partially attributable to a reasoning-answer hit gap,…

Computation and Language · Computer Science 2026-01-06 Xinming Wang , Jian Xu , Bin Yu , Sheng Lian , Hongzhu Yi , Yi Chen , Yingjian Zhu , Boran Wang , Hongming Yang , Han Hu , Xu-Yao Zhang , Cheng-Lin Liu

In the current digital commerce landscape, user-generated reviews play a critical role in shaping consumer behavior, product reputation, and platform credibility. However, the proliferation of fake or misleading reviews often generated by…

Artificial Intelligence · Computer Science 2025-11-04 Suhasnadh Reddy Veluru , Sai Teja Erukude , Viswa Chaitanya Marella

The widespread of false information is a rising concern worldwide with critical social impact, inspiring the emergence of fact-checking organizations to mitigate misinformation dissemination. However, human-driven verification leads to a…

Machine Learning · Computer Science 2022-12-09 Vítor Lourenço , Aline Paes

Multimodal reasoning for ultra-high-resolution (UHR) remote sensing (RS) is usually bottlenecked by visual evidence acquisition: the model necessitates localizing tiny task-relevant regions in massive pixel spaces. While Agentic…

We propose VC-Inspector, a lightweight, open-source large multimodal model (LMM) for reference-free evaluation of video captions, with a focus on factual accuracy. Unlike existing metrics that suffer from limited context handling, weak…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Shubhashis Roy Dipta , Tz-Ying Wu , Subarna Tripathi

Responsible use of Authorship Verification (AV) systems not only requires high accuracy but also interpretable solutions. More importantly, for systems to be used to make decisions with real-world consequences requires the model's…

Computation and Language · Computer Science 2025-10-08 Peter Zeng , Pegah Alipoormolabashi , Jihu Mun , Gourab Dey , Nikita Soni , Niranjan Balasubramanian , Owen Rambow , H. Schwartz

Researchers have found that fake news spreads much times faster than real news. This is a major problem, especially in today's world where social media is the key source of news for many among the younger population. Fact verification,…

Computation and Language · Computer Science 2024-10-08 Suryavardan Suresh , Anku Rani , Parth Patwa , Aishwarya Reganti , Vinija Jain , Aman Chadha , Amitava Das , Amit Sheth , Asif Ekbal

Image repurposing is a commonly used method for spreading misinformation on social media and online forums, which involves publishing untampered images with modified metadata to create rumors and further propaganda. While manual…

Computer Vision and Pattern Recognition · Computer Science 2019-04-11 Ayush Jaiswal , Yue Wu , Wael AbdAlmageed , Iacopo Masi , Premkumar Natarajan