English
Related papers

Related papers: LOREN: Logic-Regularized Reasoning for Interpretab…

200 papers

Large language models (LLMs) may generate text that lacks consistency with human knowledge, leading to factual inaccuracies or \textit{hallucination}. Existing research for evaluating the factuality of LLMs involves extracting fact claims…

Computation and Language · Computer Science 2024-02-23 Zhaoheng Huang , Zhicheng Dou , Yutao Zhu , Ji-rong Wen

The problem of verifying whether a textual hypothesis holds based on the given evidence, also known as fact verification, plays an important role in the study of natural language understanding and semantic representation. However, existing…

Computation and Language · Computer Science 2020-06-16 Wenhu Chen , Hongmin Wang , Jianshu Chen , Yunkai Zhang , Hong Wang , Shiyang Li , Xiyou Zhou , William Yang Wang

Fact-checking aims to verify the truthfulness of a claim based on the retrieved evidence. Existing methods typically follow a decomposition paradigm, in which a claim is broken down into sub-claims that are individually verified. However,…

Computation and Language · Computer Science 2026-01-26 Mingwei Sun , Qianlong Wang , Ruifeng Xu

In this paper we introduce a new publicly available dataset for verification against textual sources, FEVER: Fact Extraction and VERification. It consists of 185,445 claims generated by altering sentences extracted from Wikipedia and…

Computation and Language · Computer Science 2018-12-19 James Thorne , Andreas Vlachos , Christos Christodoulopoulos , Arpit Mittal

Large Language Models (LLMs) are powerful candidates for complex decision-making, leveraging vast encoded knowledge and remarkable zero-shot abilities. However, their adoption in high-stakes environments is hindered by their opacity; their…

Artificial Intelligence · Computer Science 2026-01-12 Sahil Wadhwa , Himanshu Kumar , Guanqun Yang , Abbaas Alif Mohamed Nishar , Pranab Mohanty , Swapnil Shinde , Yue Wu

Existing rumor detection strategies typically provide detection labels while ignoring their explanation. Nonetheless, providing pieces of evidence to explain why a suspicious tweet is rumor is essential. As such, a novel model, LOSIRD, was…

Social and Information Networks · Computer Science 2021-12-28 Jiawen Li , Shiwen Ni , Hung-Yu Kao

Trustworthiness is a core research challenge for agentic AI systems built on Large Language Models (LLMs). To enhance trust, natural language claims from diverse sources, including human-written text, web content, and model outputs, are…

Real-world fact verification task aims to verify the factuality of a claim by retrieving evidence from the source document. The quality of the retrieved evidence plays an important role in claim verification. Ideally, the retrieved evidence…

Computation and Language · Computer Science 2023-05-08 Xuming Hu , Zhaochen Hong , Zhijiang Guo , Lijie Wen , Philip S. Yu

Fact verification is a challenging task that requires simultaneously reasoning and aggregating over multiple retrieved pieces of evidence to evaluate the truthfulness of a claim. Existing approaches typically (i) explore the semantic…

Computation and Language · Computer Science 2021-06-03 Jiasheng Si , Deyu Zhou , Tongzhe Li , Xingyu Shi , Yulan He

Attribution and fact verification are critical challenges in natural language processing for assessing information reliability. While automated systems and Large Language Models (LLMs) aim to retrieve and select concise evidence to support…

Computation and Language · Computer Science 2026-01-30 Guy Alt , Eran Hirsch , Serwar Basch , Ido Dagan , Oren Glickman

Facts are subject to contingencies and can be true or false in different circumstances. One such contingency is time, wherein some facts mutate over a given period, e.g., the president of a country or the winner of a championship.…

Computation and Language · Computer Science 2024-04-05 Constanza Fierro , Nicolas Garneau , Emanuele Bugliarello , Yova Kementchedjhieva , Anders Søgaard

Reasoning in Large Language Models (LLMs) has recently shown strong potential in enhancing generative recommendation through deep understanding of complex user preference. Existing approaches follow a {reason-then-recommend} paradigm, where…

Information Retrieval · Computer Science 2026-03-10 Xinyu Lin , Hanqing Zeng , Hanchao Yu , Yinglong Xia , Jiang Zhang , Aashu Singh , Fei Liu , Wenjie Wang , Fuli Feng , Tat-Seng Chua , Qifan Wang

Recently generating natural language explanations has shown very promising results in not only offering interpretable explanations but also providing additional information and supervision for prediction. However, existing approaches…

Computation and Language · Computer Science 2022-05-30 Wangchunshu Zhou , Jinyi Hu , Hanlin Zhang , Xiaodan Liang , Maosong Sun , Chenyan Xiong , Jian Tang

Grounded claim factuality checking is important for large language model (LLM) applications such as retrieval-augmented generation, as it helps users assess the correctness of generated outputs. Existing metrics using entailment classifiers…

Computation and Language · Computer Science 2026-05-29 Yuxuan Ye , Raul Santos-Rodriguez , Edwin Simpson

Despite the syntactic fluency of Large Language Models (LLMs), ensuring their logical correctness in high-stakes domains remains a fundamental challenge. We present a neurosymbolic framework that combines LLMs with SMT solvers to produce…

Computation and Language · Computer Science 2026-05-05 Vikash Singh , Darion Cassel , Nathaniel Weir , Nick Feng , Sam Bayless

The profusion of knowledge encoded in large language models (LLMs) and their ability to apply this knowledge zero-shot in a range of settings makes them promising candidates for use in decision-making. However, they are currently limited by…

Computation and Language · Computer Science 2026-05-08 Gabriel Freedman , Adam Dejl , Deniz Gorur , Xiang Yin , Antonio Rago , Francesca Toni

The increasing prevalence of online misinformation has heightened the demand for automated fact-checking solutions. Large Language Models (LLMs) have emerged as potential tools for assisting in this task, but their effectiveness remains…

Computers and Society · Computer Science 2025-03-10 Nicolo' Fontana , Francesco Corso , Enrico Zuccolotto , Francesco Pierri

Training language models to solve complex mathematical problems benefits from curriculum learning progressively training on simpler subproblems. However, existing decomposition methods are often heuristic, offering no guarantees that…

Artificial Intelligence · Computer Science 2026-02-10 Kaleem Ullah Qasim , Jiashu Zhang , Hao Li , Muhammad Kafeel Shaheen

While recent years have witnessed the emergence of various explainable methods in machine learning, to what degree the explanations really represent the reasoning process behind the model prediction -- namely, the faithfulness of…

Computation and Language · Computer Science 2021-09-07 Yingqiang Ge , Shuchang Liu , Zelong Li , Shuyuan Xu , Shijie Geng , Yunqi Li , Juntao Tan , Fei Sun , Yongfeng Zhang

Information verification is quite a challenging task, this is because many times verifying a claim can require picking pieces of information from multiple pieces of evidence which can have a hierarchy of complex semantic relations.…

Computation and Language · Computer Science 2021-02-23 Usama Khalid , Mirza Omer Beg