English
Related papers

Related papers: MultiCaption: Detecting disinformation using multi…

200 papers

Recent years have witnessed the sustained evolution of misinformation that aims at manipulating public opinions. Unlike traditional rumors or fake news editors who mainly rely on generated and/or counterfeited images, text and videos,…

Computation and Language · Computer Science 2024-04-09 Yizhou Zhang , Loc Trinh , Defu Cao , Zijun Cui , Yan Liu

Misinformation is often conveyed in multiple modalities, e.g. a miscaptioned image. Multimodal misinformation is perceived as more credible by humans, and spreads faster than its text-only counterparts. While an increasing body of research…

Computation and Language · Computer Science 2023-10-27 Mubashara Akhtar , Michael Schlichtkrull , Zhijiang Guo , Oana Cocarascu , Elena Simperl , Andreas Vlachos

Misinformation on the web increasingly appears in multimodal forms, combining text, images, and OCR-rendered content in ways that amplify harm to public trust and vulnerable communities. While prior fact-checking systems often rely on…

Computation and Language · Computer Science 2026-01-14 Aditya Kishore , Gaurav Kumar , Jasabanta Patro

Identifying claims requiring verification is a critical task in automated fact-checking, especially given the proliferation of misinformation on social media platforms. Despite notable progress, challenges remain-particularly in handling…

Computation and Language · Computer Science 2025-07-22 Rrubaa Panchendrarajan , Arkaitz Zubiaga

This paper presents our system for SemEval-2025 Task 7: Multilingual and Crosslingual Fact-Checked Claim Retrieval. In an era where misinformation spreads rapidly, effective fact-checking is increasingly critical. We introduce TriAligner, a…

Data visualization is powerful in persuading an audience. However, when it is done poorly or maliciously, a visualization may become misleading or even deceiving. Visualizations give further strength to the dissemination of misinformation…

Human-Computer Interaction · Computer Science 2022-04-21 Leo Yu-Ho Lo , Ayush Gupta , Kento Shigyo , Aoyu Wu , Enrico Bertini , Huamin Qu

Deepfakes represent a growing concern across domains such as disinformation, fraud, and non-consensual media. In particular, the rise of video conference and identity-driven attacks in high-stakes scenarios--such as impostor hiring--demands…

Computer Vision and Pattern Recognition · Computer Science 2026-04-08 Sarah Barrington , Maty Bohacek , Hany Farid

The most effective misinformation campaigns are multimodal, often combining text with images and videos taken out of context -- or fabricating them entirely -- to support a given narrative. Contemporary methods for detecting misinformation,…

Computation and Language · Computer Science 2025-02-17 Tomas Peterka , Matyas Bohacek

Misinformation can be countered with fact-checking, but the process is costly and slow. Identifying checkworthy claims is the first step, where automation can help scale fact-checkers' efforts. However, detection methods struggle with…

Artificial Intelligence · Computer Science 2025-06-05 Michiel van der Meer , Pavel Korshunov , Sébastien Marcel , Lonneke van der Plas

Retrieval of previously fact-checked claims is a well-established task, whose automation can assist professional fact-checkers in the initial steps of information verification. Previous works have mostly tackled the task monolingually,…

Computation and Language · Computer Science 2025-09-23 Alan Ramponi , Marco Rovera , Robert Moro , Sara Tonelli

The internet gives the world an open platform to express their views and share their stories. While this is very valuable, it makes fake news one of our society's most pressing problems. Manual fact checking process is time consuming, which…

Combating disinformation is one of the burning societal crises -- about 67% of the American population believes that disinformation produces a lot of uncertainty, and 10% of them knowingly propagate disinformation. Evidence shows that…

Textual claims are often accompanied by images to enhance their credibility and spread on social media, but this also raises concerns about the spread of misinformation. Existing datasets for automated verification of image-text claims…

Computation and Language · Computer Science 2025-10-08 Rui Cao , Zifeng Ding , Zhijiang Guo , Michael Schlichtkrull , Andreas Vlachos

False information has a significant negative influence on individuals as well as on the whole society. Especially in the current COVID-19 era, we witness an unprecedented growth of medical misinformation. To help tackle this problem with…

Computation and Language · Computer Science 2022-04-27 Ivan Srba , Branislav Pecher , Matus Tomlein , Robert Moro , Elena Stefancova , Jakub Simko , Maria Bielikova

Assessing scientific claims requires identifying, extracting, and reasoning with multimodal data expressed in information-rich figures in scientific literature. Despite the large body of work in scientific QA, figure captioning, and other…

Computation and Language · Computer Science 2025-07-31 Yash Kumar Lal , Manikanta Bandham , Mohammad Saqib Hasan , Apoorva Kashi , Mahnaz Koupaee , Niranjan Balasubramanian

This paper describes VILLAIN, a multimodal fact-checking system that verifies image-text claims through prompt-based multi-agent collaboration. For the AVerImaTeC shared task, VILLAIN employs vision-language model agents across multiple…

Computation and Language · Computer Science 2026-02-23 Jaeyoon Jung , Yejun Yoon , Kunwoo Park

Millions of people use platforms such as YouTube, Facebook, Twitter, and other mass media. Due to the accessibility of these platforms, they are often used to establish a narrative, conduct propaganda, and disseminate misinformation. This…

Machine Learning · Computer Science 2021-07-05 Raj Jagtap , Abhinav Kumar , Rahul Goel , Shakshi Sharma , Rajesh Sharma , Clint P. George

The rise of disinformation on social media, especially through the strategic manipulation or repurposing of images, paired with provocative text, presents a complex challenge for traditional fact-checking methods. In this paper, we…

Multimedia · Computer Science 2025-04-11 Arka Ujjal Dey , Artemis Llabrés , Ernest Valveny , Dimosthenis Karatzas

Massive web-crawled image-text datasets lay the foundation for recent progress in multimodal learning. These datasets are designed with the goal of training a model to do well on standard computer vision benchmarks, many of which, however,…

Computer Vision and Pattern Recognition · Computer Science 2025-09-16 Thao Nguyen , Matthew Wallingford , Sebastin Santy , Wei-Chiu Ma , Sewoong Oh , Ludwig Schmidt , Pang Wei Koh , Ranjay Krishna

Misinformation is a complex societal issue, and mitigating solutions are difficult to create due to data deficiencies. To address this, we have curated the largest collection of (mis)information datasets in the literature, totaling 75. From…