English
Related papers

Related papers: Logically at Factify 2022: Multimodal Fact Verific…

200 papers

The widespread of false information is a rising concern worldwide with critical social impact, inspiring the emergence of fact-checking organizations to mitigate misinformation dissemination. However, human-driven verification leads to a…

Machine Learning · Computer Science 2022-12-09 Vítor Lourenço , Aline Paes

The World Wide Web and social media platforms have become popular sources for news and information. Typically, multimodal information, e.g., image and text is used to convey information more effectively and to attract attention. While in…

Information Retrieval · Computer Science 2021-04-29 Matthias Springstein , Eric Müller-Budack , Ralph Ewerth

This study evaluates the effectiveness of Vision Language Models (VLMs) in representing and utilizing multimodal content for fact-checking. To be more specific, we investigate whether incorporating multimodal content improves performance…

Computation and Language · Computer Science 2024-12-09 Recep Firat Cekinel , Pinar Karagoz , Cagri Coltekin

The growing scale of online misinformation urgently demands Automated Fact-Checking (AFC). Existing benchmarks for evaluating AFC systems, however, are largely limited in terms of task scope, modalities, domain, language diversity, realism,…

Information Retrieval · Computer Science 2026-05-01 Mark Rothermel , Marcus Kornmann , Marcus Rohrbach , Anna Rohrbach

The rapid development of audio-driven talking head generators and advanced Text-To-Speech (TTS) models has led to more sophisticated temporal deepfakes. These advances highlight the need for robust methods capable of detecting and…

Audio and Speech Processing · Electrical Eng. & Systems 2025-08-12 Ivan Kukanov , Jun Wah Ng

Deep models that are both effective and explainable are desirable in many settings; prior explainable models have been unimodal, offering either image-based visualization of attention weights or text-based generation of post-hoc…

Artificial Intelligence · Computer Science 2018-02-23 Dong Huk Park , Lisa Anne Hendricks , Zeynep Akata , Anna Rohrbach , Bernt Schiele , Trevor Darrell , Marcus Rohrbach

Automated Fact-Checking (AFC) relies on claim extraction as a first step, yet existing methods largely overlook the multimodal nature of today's misinformation. Social media posts often combine short, informal text with images such as…

Computation and Language · Computer Science 2026-04-21 Joycelyn Teo , Rui Cao , Zhenyun Deng , Zifeng Ding , Michael Sejr Schlichtkrull , Andreas Vlachos

Existing real-world datasets for multimodal fact-checking have multiple limitations: they contain few instances, focus on only one or two languages and tasks, suffer from evidence leakage, or rely on external sets of news articles for…

Computation and Language · Computer Science 2026-01-13 Jiahui Geng , Jonathan Tonglet , Iryna Gurevych

We contribute the largest publicly available dataset of naturally occurring factual claims for the purpose of automatic claim verification. It is collected from 26 fact checking websites in English, paired with textual sources and rich…

Computation and Language · Computer Science 2019-10-22 Isabelle Augenstein , Christina Lioma , Dongsheng Wang , Lucas Chaves Lima , Casper Hansen , Christian Hansen , Jakob Grue Simonsen

Fact-based Visual Question Answering (FVQA) requires external knowledge beyond visible content to answer questions about an image, which is challenging but indispensable to achieve general VQA. One limitation of existing FVQA solutions is…

Computer Vision and Pattern Recognition · Computer Science 2020-11-05 Zihao Zhu , Jing Yu , Yujing Wang , Yajing Sun , Yue Hu , Qi Wu

The rapid growth of social media has resulted in an explosion of online news content, leading to a significant increase in the spread of misleading or false information. While machine learning techniques have been widely applied to detect…

Computation and Language · Computer Science 2024-12-10 Hao Chen , Hui Guo , Baochen Hu , Shu Hu , Jinrong Hu , Siwei Lyu , Xi Wu , Xin Wang

Online misinformation is often multimodal in nature, i.e., it is caused by misleading associations between texts and accompanying images. To support the fact-checking process, researchers have been recently developing automatic multimodal…

Multimodal large language models (MLLMs) carry the potential to support humans in processing vast amounts of information. While MLLMs are already being used as a fact-checking tool, their abilities and limitations in this regard are…

Computation and Language · Computer Science 2024-04-29 Jiahui Geng , Yova Kementchedjhieva , Preslav Nakov , Iryna Gurevych

Recent technological advancements in multimodal machine learning--including the rise of large language models (LLMs)--have improved our ability to collect, process, and analyze diverse multimodal data such as speech, video, and eye gaze in…

Amid the proliferation of forged images, notably the tsunami of deepfake content, extensive research has been conducted on using artificial intelligence (AI) to identify forged content in the face of continuing advancements in…

Computer Vision and Pattern Recognition · Computer Science 2024-07-29 Shuhan Cui , Huy H. Nguyen , Trung-Nghia Le , Chun-Shien Lu , Isao Echizen

As social media platforms are evolving from text-based forums into multi-modal environments, the nature of misinformation in social media is also transforming accordingly. Taking advantage of the fact that visual modalities such as images…

Machine Learning · Computer Science 2024-09-19 Sara Abdali , Sina shaham , Bhaskar Krishnamachari

As synthetic media, including video, audio, and text, become increasingly indistinguishable from real content, the risks of misinformation, identity fraud, and social manipulation escalate. This survey traces the evolution of deepfake…

Computer Vision and Pattern Recognition · Computer Science 2025-04-04 Ping Liu , Qiqi Tao , Joey Tianyi Zhou

In this paper, we present our submission to the MM-ArgFallacy2025 shared task, which aims to advance research in multimodal argument mining, focusing on logical fallacies in political debates. Our approach uses pretrained Transformer-based…

Computation and Language · Computer Science 2025-08-07 Alessio Pittiglio

Multiple modalities represent different aspects by which information is conveyed by a data source. Modern day social media platforms are one of the primary sources of multimodal data, where users use different modes of expression by posting…

Computer Vision and Pattern Recognition · Computer Science 2018-07-17 Mayank Meghawat , Satyendra Yadav , Debanjan Mahata , Yifang Yin , Rajiv Ratn Shah , Roger Zimmermann