English
Related papers

Related papers: The Automatic Verification of Image-Text Claims (A…

200 papers

With the widespread consumption of AI-generated content, there has been an increased focus on developing automated tools to verify the factual accuracy of such content. However, prior research and tools developed for fact verification treat…

Computation and Language · Computer Science 2025-03-20 Varich Boonsanong , Vidhisha Balachandran , Xiaochuang Han , Shangbin Feng , Lucy Lu Wang , Yulia Tsvetkov

In the midst of widespread misinformation and disinformation through social media and the proliferation of AI-generated texts, it has become increasingly difficult for people to validate and trust information they encounter. Many…

Computation and Language · Computer Science 2024-09-24 Preetam Prabhu Srikar Dammu , Himanshu Naidu , Mouly Dewan , YoungMin Kim , Tanya Roosta , Aman Chadha , Chirag Shah

Automatic verification deals with the validation by means of computers of correctness certificates. The related tools, usually called proof assistants or interactive provers, provide an interactive environment for the creation of formal…

Logic in Computer Science · Computer Science 2017-01-16 Andrea Asperti

Automatic image captioning evaluation is critical for benchmarking and promoting advances in image captioning research. Existing metrics only provide a single score to measure caption qualities, which are less explainable and informative.…

Computer Vision and Pattern Recognition · Computer Science 2023-05-11 Anwen Hu , Shizhe Chen , Liang Zhang , Qin Jin

We explore the need for more comprehensive and precise evaluation techniques for generative artificial intelligence (GenAI) in text summarization tasks, specifically in the area of opinion summarization. Traditional methods, which leverage…

Computation and Language · Computer Science 2026-02-10 Leandro Anghinoni , Jorge Sanchez

Text-image composed retrieval aims to retrieve the target image through the composed query, which is specified in the form of an image plus some text that describes desired modifications to the input image. It has recently attracted…

Computer Vision and Pattern Recognition · Computer Science 2023-12-01 Shitong Sun , Jindong Gu , Shaogang Gong

In an effort to assist factcheckers in the process of factchecking, we tackle the claim detection task, one of the necessary stages prior to determining the veracity of a claim. It consists of identifying the set of sentences, out of a long…

Computation and Language · Computer Science 2020-08-18 Lev Konstantinovskiy , Oliver Price , Mevan Babakar , Arkaitz Zubiaga

Automatically determining whether a text and a corresponding image are semantically aligned is a significant challenge for vision-language models, with applications in generative text-to-image and image-to-text tasks. In this work, we study…

Computation and Language · Computer Science 2023-12-27 Michal Yarom , Yonatan Bitton , Soravit Changpinyo , Roee Aharoni , Jonathan Herzig , Oran Lang , Eran Ofek , Idan Szpektor

This paper describes Microsoft's submission to the first shared task on sign language translation at WMT 2022, a public competition tackling sign language to spoken language translation for Swiss German sign language. The task is very…

Computation and Language · Computer Science 2022-10-25 Subhadeep Dey , Abhilash Pal , Cyrine Chaabani , Oscar Koller

Automated fact-checking is a crucial task in the governance of internet content. Although various studies utilize advanced models to tackle this issue, a significant gap persists in addressing complex real-world rumors and deceptive claims.…

Computation and Language · Computer Science 2024-01-30 Wei-Yu Kao , An-Zi Yen

We contribute the largest publicly available dataset of naturally occurring factual claims for the purpose of automatic claim verification. It is collected from 26 fact checking websites in English, paired with textual sources and rich…

Computation and Language · Computer Science 2019-10-22 Isabelle Augenstein , Christina Lioma , Dongsheng Wang , Lucas Chaves Lima , Casper Hansen , Christian Hansen , Jakob Grue Simonsen

The increasing availability of image-text pairs has largely fueled the rapid advancement in vision-language foundation models. However, the vast scale of these datasets inevitably introduces significant variability in data quality, which…

Computer Vision and Pattern Recognition · Computer Science 2024-09-05 Lei Zhang , Fangxun Shu , Tianyang Liu , Sucheng Ren , Hao Jiang , Cihang Xie

Recent advances in text-driven image editing have been significant, yet the task of accurately evaluating these edited images continues to pose a considerable challenge. Different from the assessment of text-driven image generation,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Bowen Qu , Shangkun Sun , Xiaoyu Liang , Wei Gao

Evaluating the quality of automatically generated image descriptions is a complex task that requires metrics capturing various dimensions, such as grammaticality, coverage, accuracy, and truthfulness. Although human evaluation provides…

Computer Vision and Pattern Recognition · Computer Science 2024-11-11 Jia-Hong Huang , Hongyi Zhu , Yixian Shen , Stevan Rudinac , Evangelos Kanoulas

In this paper, we describe the methodology used and the results obtained by us for completing the tasks given under the shared task on Consumer Health Information Search (CHIS) collocated with the Forum for Information Retrieval Evaluation…

Information Retrieval · Computer Science 2016-12-28 Kamal Sarkar , Debanjan Das , Indra Banerjee , Mamta Kumari , Prasenjit Biswas

Research in Image Generation has recently made significant progress, particularly boosted by the introduction of Vision-Language models which are able to produce high-quality visual content based on textual inputs. Despite ongoing…

Computer Vision and Pattern Recognition · Computer Science 2023-07-20 Federico Betti , Jacopo Staiano , Lorenzo Baraldi , Lorenzo Baraldi , Rita Cucchiara , Nicu Sebe

In this paper, we highlight our approach for the "Arabic AI Tasks Evaluation (ArAiEval) Shared Task 2023". We present our approaches for task 1-A and task 2-A of the shared task which focus on persuasion technique detection and…

Computation and Language · Computer Science 2023-12-01 Sudeep Mangalvedhekar , Kshitij Deshpande , Yash Patwardhan , Vedant Deshpande , Ravindra Murumkar

One of the ways blind people understand their surroundings is by clicking images and relying on descriptions generated by image captioning systems. Current work on captioning images for the visually impaired do not use the textual data…

Computation and Language · Computer Science 2021-05-19 Hiba Ahsan , Nikita Bhalla , Daivat Bhatt , Kaivankumar Shah

Automated Fact-Checking (AFC) is the automated verification of claim accuracy. AFC is crucial in discerning truth from misinformation, especially given the huge amounts of content are generated online daily. Current research focuses on…

Computation and Language · Computer Science 2025-04-08 Islam Eldifrawi , Shengrui Wang , Amine Trabelsi

Image-based virtual try-on aims to synthesize a naturally dressed person image with a clothing image, which revolutionizes online shopping and inspires related topics within image generation, showing both research significance and…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Dan Song , Xuanpu Zhang , Juan Zhou , Weizhi Nie , Ruofeng Tong , Mohan Kankanhalli , An-An Liu