English
Related papers

Related papers: MetaSumPerceiver: Multimodal Multi-Document Eviden…

200 papers

Multimodal summarization aims to generate a concise summary based on the input text and image. However, the existing methods potentially suffer from unfactual output. To evaluate the factuality of multimodal summarization models, we propose…

Computation and Language · Computer Science 2025-12-01 Yue Zhang , Jingxuan Zuo , Ke Su , Liqiang Jing

Fact verification is a challenging task that requires simultaneously reasoning and aggregating over multiple retrieved pieces of evidence to evaluate the truthfulness of a claim. Existing approaches typically (i) explore the semantic…

Computation and Language · Computer Science 2021-06-03 Jiasheng Si , Deyu Zhou , Tongzhe Li , Xingyu Shi , Yulan He

Recently, opinion summarization, which is the generation of a summary from multiple reviews, has been conducted in a self-supervised manner by considering a sampled review as a pseudo summary. However, non-text data such as image and…

Computation and Language · Computer Science 2021-05-28 Jinbae Im , Moonki Kim , Hoyeop Lee , Hyunsouk Cho , Sehee Chung

This paper describes our participant system for the multi-modal fact verification (Factify) challenge at AAAI 2022. Despite the recent advance in text based verification techniques and large pre-trained multimodal models cross vision and…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Jie Gao , Hella-Franziska Hoffmann , Stylianos Oikonomou , David Kiskovski , Anil Bandhakavi

Real-world fact verification task aims to verify the factuality of a claim by retrieving evidence from the source document. The quality of the retrieved evidence plays an important role in claim verification. Ideally, the retrieved evidence…

Computation and Language · Computer Science 2023-05-08 Xuming Hu , Zhaochen Hong , Zhijiang Guo , Lijie Wen , Philip S. Yu

Social media platforms have become new battlegrounds for anti-social elements, with misinformation being the weapon of choice. Fact-checking organizations try to debunk as many claims as possible while staying true to their journalistic…

Computation and Language · Computer Science 2022-09-15 Varad Bhatnagar , Diptesh Kanojia , Kameswari Chebrolu

Effective summarisation evaluation metrics enable researchers and practitioners to compare different summarisation systems efficiently. Estimating the effectiveness of an automatic evaluation metric, termed meta-evaluation, is a critically…

Computation and Language · Computer Science 2024-10-01 Xiang Dai , Sarvnaz Karimi , Biaoyan Fang

Despite the prevalence of pretrained language models in natural language understanding tasks, understanding lengthy text such as document is still challenging due to the data sparseness problem. Inspired by that humans develop their ability…

Computation and Language · Computer Science 2023-12-04 Yueguan Wang , Naoki Yoshinaga

The multi-document summarization task requires the designed summarizer to generate a short text that covers the important information of original documents and satisfies content diversity. This paper proposes a multi-document summarization…

Computation and Language · Computer Science 2023-03-07 Bing Ma

Currently used metrics for assessing summarization algorithms do not account for whether summaries are factually consistent with source documents. We propose a weakly-supervised, model-based approach for verifying factual consistency and…

Computation and Language · Computer Science 2019-10-29 Wojciech Kryściński , Bryan McCann , Caiming Xiong , Richard Socher

Fact verification aims to automatically probe the veracity of a claim based on several pieces of evidence. Existing works are always engaging in accuracy improvement, let alone explainability, a critical capability of fact verification…

Artificial Intelligence · Computer Science 2024-06-17 Huanhuan Ma , Weizhi Xu , Yifan Wei , Liuji Chen , Liang Wang , Qiang Liu , Shu Wu , Liang Wang

Existing real-world datasets for multimodal fact-checking have multiple limitations: they contain few instances, focus on only one or two languages and tasks, suffer from evidence leakage, or rely on external sets of news articles for…

Computation and Language · Computer Science 2026-01-13 Jiahui Geng , Jonathan Tonglet , Iryna Gurevych

The rapid proliferation of misinformation across online platforms underscores the urgent need for robust, up-to-date, explainable, and multilingual fact-checking resources. However, existing datasets are limited in scope, often lacking…

Computation and Language · Computer Science 2026-03-18 Z. Melce Hüsünbeyi , Virginie Mouilleron , Leonie Uhling , Daniel Foppe , Tatjana Scheffler , Djamé Seddah

Despite recent improvements in abstractive summarization, most current approaches generate summaries that are not factually consistent with the source document, severely restricting their trust and usage in real-world applications. Recent…

Computation and Language · Computer Science 2022-07-20 Leonardo F. R. Ribeiro , Mengwen Liu , Iryna Gurevych , Markus Dreyer , Mohit Bansal

Misinformation on the web increasingly appears in multimodal forms, combining text, images, and OCR-rendered content in ways that amplify harm to public trust and vulnerable communities. While prior fact-checking systems often rely on…

Computation and Language · Computer Science 2026-01-14 Aditya Kishore , Gaurav Kumar , Jasabanta Patro

Summaries of medical text shall be faithful by being consistent and factual with source inputs, which is an important but understudied topic for safety and efficiency in healthcare. In this paper, we investigate and improve faithfulness in…

Computation and Language · Computer Science 2023-11-10 Nan Zhang , Yusen Zhang , Wu Guo , Prasenjit Mitra , Rui Zhang

In this study, we introduce a novel cover image generation task that produces both a concise summary and a visually corresponding image from a given text-only document. Because no existing datasets are available for this task, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Hyeyeon Kim , Sungwoo Han , Jingun Kwon , Hidetaka Kamigaito , Manabu Okumura

We present SciClaimEval, a new scientific dataset for the claim verification task. Unlike existing resources, SciClaimEval features authentic claims, including refuted ones, directly extracted from published papers. To create refuted…

Computation and Language · Computer Science 2026-02-16 Xanh Ho , Yun-Ang Wu , Sunisth Kumar , Tian Cheng Xia , Florian Boudin , Andre Greiner-Petter , Akiko Aizawa

A crucial difference between single- and multi-document summarization is how salient content manifests itself in the document(s). While such content may appear at the beginning of a single document, essential information is frequently…

Computation and Language · Computer Science 2021-10-18 Logan Lebanoff , Bingqing Wang , Zhe Feng , Fei Liu

Maintaining factual consistency is a critical issue in abstractive text summarisation, however, it cannot be assessed by traditional automatic metrics used for evaluating text summarisation, such as ROUGE scoring. Recent efforts have been…

Computation and Language · Computer Science 2024-05-29 Jennifer A Bishop , Qianqian Xie , Sophia Ananiadou