English
Related papers

Related papers: FactGenius: Combining Zero-Shot Prompting and Fuzz…

200 papers

Neural models for automated fact verification have achieved promising results thanks to the availability of large, human-annotated datasets. However, for each new domain that requires fact verification, creating a dataset by manually…

Computation and Language · Computer Science 2021-06-01 Liangming Pan , Wenhu Chen , Wenhan Xiong , Min-Yen Kan , William Yang Wang

Retrieval of information from graph-structured knowledge bases represents a promising direction for improving the factuality of LLMs. While various solutions have been proposed, a comparison of methods is difficult due to the lack of…

Machine Learning · Computer Science 2025-12-05 Alberto Cattaneo , Carlo Luschi , Daniel Justus

Automated fact-checking, using machine learning to verify claims, has grown vital as misinformation spreads beyond human fact-checking capacity. Large Language Models (LLMs) like GPT-4 are increasingly trusted to write academic papers,…

Computation and Language · Computer Science 2024-02-08 Dorian Quelle , Alexandre Bovet

Fact-checking based on commercial LLMs has become mainstream. Although these methods offer high explainability, it falls short in accuracy compared to traditional fine-tuning approaches, and data security is also a significant concern. In…

Computation and Language · Computer Science 2024-05-24 Guangyao Lu , Yulin Liu

We present two LLM-based approaches to zero-shot source-and-target belief prediction on FactBank: a unified system that identifies events, sources, and belief labels in a single pass, and a hybrid approach that uses a fine-tuned DeBERTa…

Computation and Language · Computer Science 2025-02-14 John Murzaku , Owen Rambow

We explore the need for more comprehensive and precise evaluation techniques for generative artificial intelligence (GenAI) in text summarization tasks, specifically in the area of opinion summarization. Traditional methods, which leverage…

Computation and Language · Computer Science 2026-02-10 Leandro Anghinoni , Jorge Sanchez

Large Language Models (LLMs) are often challenged by generating erroneous or hallucinated responses, especially in complex reasoning tasks. Leveraging Knowledge Graphs (KGs) as external knowledge sources has emerged as a viable solution.…

Artificial Intelligence · Computer Science 2025-05-23 Yuan Sui , Yufei He , Nian Liu , Xiaoxin He , Kun Wang , Bryan Hooi

The advent of Large Language Models (LLMs) has significantly transformed the AI landscape, enhancing machine learning and AI capabilities. Factuality issue is a critical concern for LLMs, as they may generate factually incorrect responses.…

Computation and Language · Computer Science 2024-04-02 Xiaoze Liu , Feijie Wu , Tianyang Xu , Zhuo Chen , Yichi Zhang , Xiaoqian Wang , Jing Gao

In the current digital era, the rapid spread of misinformation on online platforms presents significant challenges to societal well-being, public trust, and democratic processes, influencing critical decision making and public opinion. To…

Computation and Language · Computer Science 2024-05-06 Xinyi Li , Yongfeng Zhang , Edward C. Malthouse

Factual consistency is an important quality in dialogue summarization. Large language model (LLM)-based automatic text summarization models generate more factually consistent summaries compared to those by smaller pretrained language…

Computation and Language · Computer Science 2024-06-24 Rongxin Zhu , Jey Han Lau , Jianzhong Qi

Understanding rich narratives, such as dialogues and stories, often requires natural language processing systems to access relevant knowledge from commonsense knowledge graphs. However, these systems typically retrieve facts from KGs using…

Computation and Language · Computer Science 2022-10-25 Silin Gao , Jena D. Hwang , Saya Kanno , Hiromi Wakaki , Yuki Mitsufuji , Antoine Bosselut

Large Language Models (LLMs) might hallucinate facts, while curated Knowledge Graph (KGs) are typically factually reliable especially with domain-specific knowledge. Measuring the alignment between KGs and LLMs can effectively probe the…

Artificial Intelligence · Computer Science 2024-08-02 Shangshang Zheng , He Bai , Yizhe Zhang , Yi Su , Xiaochuan Niu , Navdeep Jaitly

Despite tremendous improvements in natural language generation, summarization models still suffer from the unfaithfulness issue. Previous work evaluates faithfulness either using models trained on the other tasks or in-domain synthetic…

Computation and Language · Computer Science 2023-12-15 Qi Jia , Siyu Ren , Yizhu Liu , Kenny Q. Zhu

Recently, ChatGPT, a representative large language model (LLM), has gained considerable attention due to its powerful emergent abilities. Some researchers suggest that LLMs could potentially replace structured knowledge bases like knowledge…

Computation and Language · Computer Science 2024-01-31 Linyao Yang , Hongyang Chen , Zhao Li , Xiao Ding , Xindong Wu

Despite advancements in Large Language Models (LLMs) and Retrieval-Augmented Generation (RAG) systems, their effectiveness is often hindered by a lack of integration with entity relationships and community structures, limiting their ability…

Computation and Language · Computer Science 2024-08-19 Rong-Ching Chang , Jiawei Zhang

With the rapid progress of large language models (LLMs) and the huge amount of text they generated, it becomes more and more impractical to manually distinguish whether a text is machine-generated. Given the growing use of LLMs in social…

Computation and Language · Computer Science 2023-06-12 Jinyan Su , Terry Yue Zhuo , Di Wang , Preslav Nakov

The rapid development of social platforms exacerbates the dissemination of misinformation, which stimulates the research in fact verification. Recent studies tend to leverage semantic features to solve this problem as a single-hop task.…

Computation and Language · Computer Science 2025-03-12 Han Cao , Lingwei Wei , Wei Zhou , Songlin Hu

Evidence plays a crucial role in automated fact-checking. When verifying real-world claims, existing fact-checking systems either assume the evidence sentences are given or use the search snippets returned by the search engine. Such methods…

Computation and Language · Computer Science 2024-01-30 Xuming Hu , Junzhe Chen , Zhijiang Guo , Philip S. Yu

Answering questions using pre-trained language models (LMs) and knowledge graphs (KGs) presents challenges in identifying relevant knowledge and performing joint reasoning.We compared LMs (fine-tuned for the task) with the previously…

Computation and Language · Computer Science 2024-01-02 Shreyas Verma , Manoj Parmar , Palash Choudhary , Sanchita Porwal

Factchecking has always been a part of the journalistic process. However with newsroom budgets shrinking it is coming under increasing pressure just as the amount of false information circulating is on the rise. We therefore propose a…

Computation and Language · Computer Science 2019-07-04 Ben Adler , Giacomo Boscaini-Gilroy