English
Related papers

Related papers: MAVEN-Fact: A Large-scale Event Factuality Detecti…

200 papers

The remarkable performance of Multimodal Large Language Models (MLLMs) has unequivocally demonstrated their proficient understanding capabilities in handling a wide array of visual tasks. Nevertheless, the opaque nature of their black-box…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Minghe Gao , Shuang Chen , Liang Pang , Yuan Yao , Jisheng Dang , Wenqiao Zhang , Juncheng Li , Siliang Tang , Yueting Zhuang , Tat-Seng Chua

Deploying Large Language Models (LLMs) in medical applications requires fact-checking capabilities to ensure patient safety and regulatory compliance. We introduce MedFact, a challenging Chinese medical fact-checking benchmark with 2,116…

Computation and Language · Computer Science 2025-11-18 Jiayi He , Yangmin Huang , Qianyun Du , Xiangying Zhou , Zhiyang He , Jiaxue Hu , Xiaodong Tao , Lixian Lai

The Event-Enriched Image Analysis (EVENTA) Grand Challenge, hosted at ACM Multimedia 2025, introduces the first large-scale benchmark for event-level multimodal understanding. Traditional captioning and retrieval tasks largely focus on…

Computer Vision and Pattern Recognition · Computer Science 2025-08-27 Thien-Phuc Tran , Minh-Quang Nguyen , Minh-Triet Tran , Tam V. Nguyen , Trong-Le Do , Duy-Nam Ly , Viet-Tham Huynh , Khanh-Duy Le , Mai-Khiem Tran , Trung-Nghia Le

Large language models (LLMs) have recently demonstrated impressive multimodal reasoning capabilities, yet their understanding of purely numerical time-series signals remains limited. Existing approaches mainly focus on forecasting or trend…

Machine Learning · Computer Science 2025-10-29 Ninghui Feng , Yiyan Qi

Most of the artificial lights fluctuate in response to the grid's alternating current and exhibit subtle variations in terms of both intensity and spectrum, providing the potential to estimate the Electric Network Frequency (ENF) from…

Image and Video Processing · Electrical Eng. & Systems 2023-05-05 Lexuan Xu , Guang Hua , Haijian Zhang , Lei Yu , Ning Qiao

Factual hallucinations are a major challenge for Large Language Models (LLMs). They undermine reliability and user trust by generating inaccurate or fabricated content. Recent studies suggest that when generating false statements, the…

Computation and Language · Computer Science 2025-06-02 Giovanni Servedio , Alessandro De Bellis , Dario Di Palma , Vito Walter Anelli , Tommaso Di Noia

Fake news on social media is a widespread and serious problem in today's society. Existing fake news detection methods focus on finding clues from Long text content, such as original news articles and user comments. This paper solves the…

Computation and Language · Computer Science 2025-06-03 Shiwen Ni , Jiawen Li , Hung-Yu Kao

Large language models (LLMs), despite their remarkable text generation capabilities, often hallucinate and generate text that is factually incorrect and not grounded in real-world knowledge. This poses serious risks in domains like…

Computation and Language · Computer Science 2025-11-18 Raavi Gupta , Pranav Hari Panicker , Sumit Bhatia , Ganesh Ramakrishnan

With the rapid development of social media, the wide dissemination of fake news on social media is increasingly threatening both individuals and society. One of the unique challenges for fake news detection on social media is how to detect…

Social and Information Networks · Computer Science 2024-11-12 Jiajun Zhang , Zhixun Li , Qiang Liu , Shu Wu , Liang Wang

Fact verification plays a vital role in combating misinformation by assessing the veracity of claims through evidence retrieval and reasoning. However, traditional methods struggle with complex claims requiring multi-hop reasoning over…

Artificial Intelligence · Computer Science 2025-06-10 Liwen Zheng , Chaozhuo Li , Zheng Liu , Feiran Huang , Haoran Jia , Zaisheng Ye , Xi Zhang

Faithfulness hallucinations are claims generated by a Large Language Model (LLM) not supported by contexts provided to the LLM. Lacking assessment standards, existing benchmarks focus on "factual statements" that rephrase source materials…

Computation and Language · Computer Science 2025-06-26 Xiaqiang Tang , Jian Li , Keyu Hu , Du Nan , Xiaolong Li , Xi Zhang , Weigao Sun , Sihong Xie

Large Vision Language Models exhibit remarkable capabilities but struggle with hallucinations inconsistencies between images and their descriptions. Previous hallucination evaluation studies on LVLMs have identified hallucinations in terms…

Artificial Intelligence · Computer Science 2024-11-11 Chaoya Jiang , Hongrui Jia , Wei Ye , Mengfan Dong , Haiyang Xu , Ming Yan , Ji Zhang , Shikun Zhang

Despite the significant efforts made by the research community in recent years, automatically acquiring valuable information about high impact-events from social media remains challenging. We present EviDense, a graph-based approach for…

Social and Information Networks · Computer Science 2019-12-09 Oana Balalau , Carlos Castillo , Mauro Sozio

Hallucination, the generation of factually incorrect information, remains a significant challenge for large language models (LLMs), especially in open-domain long-form generation. Existing approaches for detecting hallucination in long-form…

Event-based image retrieval from free-form captions presents a significant challenge: models must understand not only visual features but also latent event semantics, context, and real-world knowledge. Conventional vision-language retrieval…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Dinh-Khoi Vo , Van-Loc Nguyen , Minh-Triet Tran , Trung-Nghia Le

Everyday news coverage has shifted from traditional broadcasts towards a wide range of presentation formats such as first-hand, unedited video footage. Datasets that reflect the diverse array of multimodal, multilingual news sources…

Information Retrieval · Computer Science 2023-07-07 Kate Sanders , David Etter , Reno Kriz , Benjamin Van Durme

The factuality of large language model (LLMs) tends to decay over time since events posterior to their training are "unknown" to them. One way to keep models up-to-date could be factual update: the task of inserting, replacing, or removing…

Computation and Language · Computer Science 2024-03-22 Hichem Ammar Khodja , Frédéric Béchet , Quentin Brabant , Alexis Nasr , Gwénolé Lecorvé

Event detection refers to identifying event occurrences in a text and comprises of two subtasks; event identification and classification. We present EDM3, a novel approach for Event Detection that formulates three generative tasks:…

Computation and Language · Computer Science 2023-05-29 Ujjwala Anantheswaran , Himanshu Gupta , Mihir Parmar , Kuntal Kumar Pal , Chitta Baral

Factuality evaluation aims to detect factual errors produced by language models (LMs) and hence guide the development of more factual models. Towards this goal, we train a factuality evaluator, FenCE, that provides LM generators with…

Computation and Language · Computer Science 2025-06-03 Yiqing Xie , Wenxuan Zhou , Pradyot Prakash , Di Jin , Yuning Mao , Quintin Fettes , Arya Talebzadeh , Sinong Wang , Han Fang , Carolyn Rose , Daniel Fried , Hejia Zhang

In this paper, we describe DeFactoNLP, the system we designed for the FEVER 2018 Shared Task. The aim of this task was to conceive a system that can not only automatically assess the veracity of a claim but also retrieve evidence supporting…

Artificial Intelligence · Computer Science 2018-09-10 Aniketh Janardhan Reddy , Gil Rocha , Diego Esteves