English
Related papers

Related papers: A New Dataset and Benchmark for Grounding Multimod…

200 papers

Multimodal summarization with multimodal output (MSMO) has emerged as a promising research direction. Nonetheless, numerous limitations exist within existing public MSMO datasets, including insufficient maintenance, data inaccessibility,…

Computer Vision and Pattern Recognition · Computer Science 2023-11-21 Jielin Qiu , Jiacheng Zhu , William Han , Aditesh Kumar , Karthik Mittal , Claire Jin , Zhengyuan Yang , Linjie Li , Jianfeng Wang , Ding Zhao , Bo Li , Lijuan Wang

Fake news often involves semantic manipulations across modalities such as image, text, location etc and requires the development of multimodal semantic forensics for its detection. Recent research has centered the problem around images,…

Multimedia · Computer Science 2020-11-24 Ekraam Sabir , Ayush Jaiswal , Wael AbdAlmageed , Prem Natarajan

This study evaluates the effectiveness of Vision Language Models (VLMs) in representing and utilizing multimodal content for fact-checking. To be more specific, we investigate whether incorporating multimodal content improves performance…

Computation and Language · Computer Science 2024-12-09 Recep Firat Cekinel , Pinar Karagoz , Cagri Coltekin

Fake news has now grown into a big problem for societies and also a major challenge for people fighting disinformation. This phenomenon plagues democratic elections, reputations of individual persons or organizations, and has negatively…

Multimodal large language models (MLLMs) are increasingly used for real-world tasks involving multi-step reasoning and long-form generation, where reliability requires grounding model outputs in heterogeneous input sources and verifying…

Computation and Language · Computer Science 2026-05-08 David Wan , Han Wang , Ziyang Wang , Elias Stengel-Eskin , Hyunji Lee , Mohit Bansal

In recent years, we witness the explosion of false and unconfirmed information (i.e., rumors) that went viral on social media and shocked the public. Rumors can trigger versatile, mostly controversial stance expressions among social media…

Computation and Language · Computer Science 2023-10-26 Ruichao Yang , Wei Gao , Jing Ma , Hongzhan Lin , Zhiwei Yang

The misuse of advanced generative AI models has resulted in the widespread proliferation of falsified data, particularly forged human-centric audiovisual content, which poses substantial societal risks (e.g., financial fraud and social…

Cryptography and Security · Computer Science 2025-10-28 Kangran Zhao , Yupeng Chen , Xiaoyu Zhang , Yize Chen , Weinan Guan , Baicheng Chen , Chengzhe Sun , Soumyya Kanti Datta , Qingshan Liu , Siwei Lyu , Baoyuan Wu

Multimodal deception detection aims to identify deceptive behavior by analyzing audiovisual cues for forensics and security. In these high-stakes settings, investigators need verifiable evidence connecting audiovisual cues to final…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Jiajian Huang , Dongliang Zhu , Zitong YU , Hui Ma , Jiayu Zhang , Chunmei Zhu , Xiaochun Cao

We present SciClaimEval, a new scientific dataset for the claim verification task. Unlike existing resources, SciClaimEval features authentic claims, including refuted ones, directly extracted from published papers. To create refuted…

Computation and Language · Computer Science 2026-02-16 Xanh Ho , Yun-Ang Wu , Sunisth Kumar , Tian Cheng Xia , Florian Boudin , Andre Greiner-Petter , Akiko Aizawa

Misinformation continues to pose a significant challenge in today's information ecosystem, profoundly shaping public perception and behavior. Among its various manifestations, Out-of-Context (OOC) misinformation is particularly obscure, as…

Information Retrieval · Computer Science 2025-04-10 Yin Wu , Zhengxuan Zhang , Fuling Wang , Yuyu Luo , Hui Xiong , Nan Tang

Visual grounding is a ubiquitous building block in many vision-language tasks and yet remains challenging due to large variations in visual and linguistic features of grounding entities, strong context effect and the resulting semantic…

Computer Vision and Pattern Recognition · Computer Science 2019-11-26 Yongfei Liu , Bo Wan , Xiaodan Zhu , Xuming He

The global spread of misinformation and concerns about content trustworthiness have driven the development of automated fact-checking systems. Since false information often exploits social media dynamics such as "likes" and user networks to…

Social and Information Networks · Computer Science 2026-02-03 Vítor N. Lourenço , Aline Paes , Tillman Weyde

As synthetic media, including video, audio, and text, become increasingly indistinguishable from real content, the risks of misinformation, identity fraud, and social manipulation escalate. This survey traces the evolution of deepfake…

Computer Vision and Pattern Recognition · Computer Science 2025-04-04 Ping Liu , Qiqi Tao , Joey Tianyi Zhou

In the current era of rapidly growing digital data, evaluating the political bias and factuality of news outlets has become more important for seeking reliable information online. In this work, we study the classification problem of…

Machine Learning · Computer Science 2024-12-17 Muhammad Arslan Manzoor , Ruihong Zeng , Dilshod Azizov , Preslav Nakov , Shangsong Liang

Multimodal fact verification is an under-explored and emerging field that has gained increasing attention in recent years. The goal is to assess the veracity of claims that involve multiple modalities by analyzing the retrieved evidence.…

Multimedia · Computer Science 2024-07-16 Han Cao , Lingwei Wei , Wei Zhou , Songlin Hu

Recent advances in generative AI have dramatically improved image and video synthesis capabilities, significantly increasing the risk of misinformation through sophisticated fake content. In response, detection methods have evolved from…

Computer Vision and Pattern Recognition · Computer Science 2026-01-07 Haiquan Wen , Tianxiao Li , Zhenglin Huang , Yiwei He , Guangliang Cheng

Pixel grounding, encompassing tasks such as Referring Expression Segmentation (RES), has garnered considerable attention due to its immense potential for bridging the gap between vision and language modalities. However, advancements in this…

Computer Vision and Pattern Recognition · Computer Science 2025-07-16 Rui Hu , Lianghui Zhu , Yuxuan Zhang , Tianheng Cheng , Lei Liu , Heng Liu , Longjin Ran , Xiaoxin Chen , Wenyu Liu , Xinggang Wang

As Large Language Models (LLMs) are widely deployed in diverse scenarios, the extent to which they could tacitly spread misinformation emerges as a critical safety concern. Current research primarily evaluates LLMs on explicit false…

Computation and Language · Computer Science 2025-09-30 Ruohao Guo , Wei Xu , Alan Ritter

Over the last years, there has been an unprecedented proliferation of fake news. As a consequence, we are more susceptible to the pernicious impact that misinformation and disinformation spreading can have in different segments of our…

Computation and Language · Computer Science 2021-12-10 Santiago Alonso-Bartolome , Isabel Segura-Bedmar

News summarization in today's global scene can be daunting with its flood of multilingual content and varied viewpoints from different sources. However, current studies often neglect such real-world scenarios as they tend to focus solely on…

Computation and Language · Computer Science 2024-10-08 Yangfan Ye , Xiachong Feng , Xiaocheng Feng , Weitao Ma , Libo Qin , Dongliang Xu , Qing Yang , Hongtao Liu , Bing Qin