English
Related papers

Related papers: MAVEN-Fact: A Large-scale Event Factuality Detecti…

200 papers

Identifying the salience (i.e. importance) of discourse units is an important task in language understanding. While events play important roles in text documents, little research exists on analyzing their saliency status. This paper…

Computation and Language · Computer Science 2018-09-10 Zhengzhong Liu , Chenyan Xiong , Teruko Mitamura , Eduard Hovy

Contemporary approaches to assisted scientific discovery use language models to automatically generate large numbers of potential hypothesis to test, while also automatically generating code-based experiments to test those hypotheses. While…

Artificial Intelligence · Computer Science 2025-09-23 Peter Jansen , Samiah Hassan , Ruoyao Wang

Large Language Models (LLMs) have demonstrated significant performance improvements across various cognitive tasks. An emerging application is using LLMs to enhance retrieval-augmented generation (RAG) capabilities. These systems require…

Computation and Language · Computer Science 2025-01-28 Satyapriya Krishna , Kalpesh Krishna , Anhad Mohananey , Steven Schwarcz , Adam Stambler , Shyam Upadhyay , Manaal Faruqui

Single document news summarization has seen substantial progress on faithfulness in recent years, driven by research on the evaluation of factual consistency, or hallucinations. We ask whether these advances carry over to other text…

Large language models (LLMs) are increasingly used as sources of historical information, motivating the need for scalable audits on contested events and politically charged narratives in settings that mirror real user interactions. We…

Computers and Society · Computer Science 2026-02-24 Francesco Ortu , Joeun Yook , Punya Syon Pandey , Keenan Samway , Bernhard Schölkopf , Alberto Cazzaniga , Rada Mihalcea , Zhijing Jin

Financial event entity extraction is a crucial task for analyzing market dynamics and building financial knowledge graphs, yet it presents significant challenges due to the specialized language and complex structures in financial texts.…

Computation and Language · Computer Science 2025-04-22 Soo-joon Choi , Ji-jun Park

With the remarkable development of large language models (LLMs), ensuring the factuality of output has become a challenge. However, having all the contents of the response with given knowledge or facts is not necessarily a good thing in…

Computation and Language · Computer Science 2024-06-17 Ryohei Kamei , Daiki Shiono , Reina Akama , Jun Suzuki

This paper presents question-answering on dense video events, a novel task that answers and grounds dense-event questions in long videos, thus challenging MLLMs to faithfully comprehend and reason about multiple events over extended periods…

Computer Vision and Pattern Recognition · Computer Science 2025-05-19 Hangyu Qin , Junbin Xiao , Angela Yao

While spatio-temporal Graph Neural Networks (GNNs) excel at modeling recurring traffic patterns, their reliability plummets during non-recurring events like accidents. This failure occurs because GNNs are fundamentally correlational models,…

Artificial Intelligence · Computer Science 2025-11-18 Luyao Niu , Zepu Wang , Shuyi Guan , Yang Liu , Peng Sun

Automated fact-checking systems verify claims against evidence to predict their veracity. In real-world scenarios, the retrieved evidence may not unambiguously support or refute the claim and yield conflicting but valid interpretations.…

Computation and Language · Computer Science 2023-12-15 Max Glockner , Ieva Staliūnaitė , James Thorne , Gisela Vallejo , Andreas Vlachos , Iryna Gurevych

The proliferation of misinformation necessitates scalable, automated fact-checking solutions. Yet, current benchmarks often overlook multilingual and topical diversity. This paper introduces a novel, dynamically extensible data set that…

Computers and Society · Computer Science 2025-10-22 Lorraine Saju , Arnim Bleier , Jana Lasser , Claudia Wagner

Large language models (LLMs) show strong reasoning abilities across diverse tasks, yet their performance on extended contexts remains inconsistent. While prior research has emphasized mid-context degradation in question answering, this…

Computation and Language · Computer Science 2026-02-25 Pietro Bernardelle , Stefano Civelli , Kevin Roitero , Gianluca Demartini

Recent progress in natural language processing (NLP) owes much to remarkable advances in large language models (LLMs). Nevertheless, LLMs frequently "hallucinate," resulting in non-factual outputs. Our carefully-designed human evaluation…

Computation and Language · Computer Science 2024-03-22 Jian Guan , Jesse Dodge , David Wadden , Minlie Huang , Hao Peng

Hallucinations in generative AI, particularly in Large Language Models (LLMs), pose a significant challenge to the reliability of multilingual applications. Existing benchmarks for hallucination detection focus primarily on English and a…

Computation and Language · Computer Science 2025-03-28 Hanzhi Zhang , Sumera Anjum , Heng Fan , Weijian Zheng , Yan Huang , Yunhe Feng

The rapid increase in fake news, which causes significant damage to society, triggers many fake news related studies, including the development of fake news detection and fact verification techniques. The resources for these studies are…

Machine Learning · Computer Science 2021-11-08 Taichi Murayama

Recent studies in Large Vision-Language Models (LVLMs) have demonstrated impressive advancements in multimodal Out-of-Context (OOC) misinformation detection, discerning whether an authentic image is wrongly used in a claim. Despite their…

Machine Learning · Computer Science 2025-02-18 Junjie Wu , Yumeng Fu , Nan Yu , Guohong Fu

With the rapid development of video Multimodal Large Language Models (MLLMs), numerous benchmarks have been proposed to assess their video understanding capability. However, due to the lack of rich events in the videos, these datasets may…

Computer Vision and Pattern Recognition · Computer Science 2024-06-21 Yifan Du , Kun Zhou , Yuqi Huo , Yifan Li , Wayne Xin Zhao , Haoyu Lu , Zijia Zhao , Bingning Wang , Weipeng Chen , Ji-Rong Wen

Recognizing whether outputs from large language models (LLMs) contain faithfulness hallucination is crucial for real-world applications, e.g., retrieval-augmented generation and summarization. In this paper, we introduce FaithLens, a…

Computation and Language · Computer Science 2026-04-22 Shuzheng Si , Qingyi Wang , Haozhe Zhao , Yuzhuo Bai , Guanqiao Chen , Kangyang Luo , Gang Chen , Fanchao Qi , Minjia Zhang , Baobao Chang , Maosong Sun

Few-shot Continual Event Detection (FCED) poses the dual challenges of learning from limited data and mitigating catastrophic forgetting across sequential tasks. Existing approaches often suffer from severe forgetting due to the full…

Machine Learning · Computer Science 2025-09-30 Bao-Ngoc Dao , Quang Nguyen , Luyen Ngo Dinh , Minh Le , Linh Ngo Van

The rise of multimodal misinformation on social platforms poses significant challenges for individuals and societies. Its increased credibility and broader impact compared to textual misinformation make detection complex, requiring robust…

Computation and Language · Computer Science 2024-06-24 Keyang Xuan , Li Yi , Fan Yang , Ruochen Wu , Yi R. Fung , Heng Ji