English
Related papers

Related papers: RW-Post: Auditable Evidence-Grounded Multimodal Fa…

200 papers

Entity state tracking is a necessary component of world modeling that requires maintaining coherent representations of entities over time. Previous work has benchmarked entity tracking performance in purely text-based tasks. We introduce…

Computation and Language · Computer Science 2026-02-10 Vanya Cohen , Raymond Mooney

Given the widespread dissemination of misinformation on social media, implementing fact-checking mechanisms for online claims is essential. Manually verifying every claim is very challenging, underscoring the need for an automated…

Computation and Language · Computer Science 2024-10-08 Ronit Singhal , Pransh Patwa , Parth Patwa , Aman Chadha , Amitava Das

Recent advances in multimodal language models (MLLMs) have made thinking with images a dominant paradigm for multimodal reasoning. However, existing methods still fail to ensure evidence-answer consistency, where correct answers must be…

Artificial Intelligence · Computer Science 2026-05-22 Tianrun Xu , Haoda Jing , Ye Li , Yuquan Wei , Jun Feng , Guanyu Chen , Haichuan Gao , Tianren Zhang , Feng Chen

This paper presents our submission to the ACMMM25 - Grand Challenge on Multimedia Verification. We developed a multi-agent verification system that combines Multimodal Large Language Models (MLLMs) with specialized verification tools to…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Huy Hoan Le , Van Sy Thinh Nguyen , Thi Le Chi Dang , Vo Thanh Khang Nguyen , Truong Thanh Hung Nguyen , Hung Cao

Recently, Multi-modal Large Language Models (MLLMs) have demonstrated significant performance across various video understanding tasks. However, their robustness, particularly when faced with manipulated video content, remains largely…

Computer Vision and Pattern Recognition · Computer Science 2025-10-13 Zixi Yang , Jiapeng Li , Muxi Diao , Yinuo Jing , Kongming Liang

Visual reasoning is central to human cognition, enabling individuals to interpret and abstractly understand their environment. Although recent Multimodal Large Language Models (MLLMs) have demonstrated impressive performance across language…

Computer Vision and Pattern Recognition · Computer Science 2025-03-17 Jing Bi , Junjia Guo , Susan Liang , Guangyu Sun , Luchuan Song , Yunlong Tang , Jinxi He , Jiarui Wu , Ali Vosoughi , Chen Chen , Chenliang Xu

Multimodal Large Language Models (MLLMs) exhibit impressive performance across various visual tasks. Subsequent investigations into enhancing their visual reasoning abilities have significantly expanded their performance envelope. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-08-08 Yang Chen , Yufan Shen , Wenxuan Huang , Sheng Zhou , Qunshu Lin , Xinyu Cai , Zhi Yu , Jiajun Bu , Botian Shi , Yu Qiao

This study evaluates the effectiveness of Vision Language Models (VLMs) in representing and utilizing multimodal content for fact-checking. To be more specific, we investigate whether incorporating multimodal content improves performance…

Computation and Language · Computer Science 2024-12-09 Recep Firat Cekinel , Pinar Karagoz , Cagri Coltekin

Recent advances in text-driven image editing have been significant, yet the task of accurately evaluating these edited images continues to pose a considerable challenge. Different from the assessment of text-driven image generation,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Bowen Qu , Shangkun Sun , Xiaoyu Liang , Wei Gao

Large Language Models (LLMs) augmented with retrieval mechanisms have demonstrated significant potential in fact-checking tasks by integrating external knowledge. However, their reliability decreases when confronted with conflicting…

Computation and Language · Computer Science 2025-05-26 Ziyu Ge , Yuhao Wu , Daniel Wai Kit Chin , Roy Ka-Wei Lee , Rui Cao

Given the growing influx of misinformation across news and social media, there is a critical need for systems that can provide effective real-time verification of news claims. Large language or multimodal model based verification has been…

Computation and Language · Computer Science 2024-07-02 Jaeyoung Lee , Ximing Lu , Jack Hessel , Faeze Brahman , Youngjae Yu , Yonatan Bisk , Yejin Choi , Saadia Gabriel

The increasing realism of multimodal content has made misinformation more subtle and harder to detect, especially in news media where images are frequently paired with bilingual (e.g., Chinese-English) subtitles. Such content often includes…

Computer Vision and Pattern Recognition · Computer Science 2025-12-10 Yiwei He , Zhenglin Huang , Haiquan Wen , Tianxiao Li , Yi Dong , Hao Fei , Baoyuan Wu , Guangliang Cheng

Online disinformation poses an escalating threat to society, driven increasingly by the rapid spread of misleading content across both multimedia and multilingual platforms. While automated fact-checking methods have advanced in recent…

Computation and Language · Computer Science 2026-01-19 Rafael Martins Frade , Rrubaa Panchendrarajan , Arkaitz Zubiaga

The proliferation of multimedia content on social media platforms has dramatically transformed how information is consumed and disseminated. While this shift enables real-time coverage of global events, it also facilitates the rapid spread…

While Large Language Models (LLMs) excel at algorithmic code generation, they struggle with front-end development, where correctness is judged on rendered pixels and interaction. We present ReLook, an agentic, vision-grounded reinforcement…

Machine Learning · Computer Science 2025-10-14 Yuhang Li , Chenchen Zhang , Ruilin Lv , Ao Liu , Ken Deng , Yuanxing Zhang , Jiaheng Liu , Wiggin Zhou , Bo Zhou

Multimodal pre-training remains constrained by the descriptive bias of image-caption pairs, leading models to favor surface linguistic cues over grounded visual understanding. We introduce MMRPT, a masked multimodal reinforcement…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Xuhui Zheng , Kang An , Ziliang Wang , Yuhang Wang , Faqiang Qian , Yichao Wu

Visual retrieval-augmented generation (VRAG) augments vision-language models (VLMs) with external visual knowledge to ground reasoning and reduce hallucinations. Yet current VRAG systems often fail to reliably perceive and integrate…

Computation and Language · Computer Science 2025-10-14 Yubo Sun , Chunyi Peng , Yukun Yan , Shi Yu , Zhenghao Liu , Chi Chen , Zhiyuan Liu , Maosong Sun

Textual claims are often accompanied by images to enhance their credibility and spread on social media, but this also raises concerns about the spread of misinformation. Existing datasets for automated verification of image-text claims…

Computation and Language · Computer Science 2025-10-08 Rui Cao , Zifeng Ding , Zhijiang Guo , Michael Schlichtkrull , Andreas Vlachos

Real-world information, often multimodal, can be misinformed or potentially misleading due to factual errors, outdated claims, missing context, misinterpretation, and more. Such "misinformation" is understudied, challenging to address, and…

Computation and Language · Computer Science 2026-01-13 Xinyi Zhou , Ashish Sharma , Amy X. Zhang , Tim Althoff

Recently, fake news with text and images have achieved more effective diffusion than text-only fake news, raising a severe issue of multimodal fake news detection. Current studies on this issue have made significant contributions to…

Multimedia · Computer Science 2021-08-25 Peng Qi , Juan Cao , Xirong Li , Huan Liu , Qiang Sheng , Xiaoyue Mi , Qin He , Yongbiao Lv , Chenyang Guo , Yingchao Yu