English
Related papers

Related papers: FactAlign: Long-form Factuality Alignment of Large…

200 papers

Large Language Models (LLMs) acquire extensive knowledge and remarkable abilities from extensive text corpora, making them powerful tools for various applications. To make LLMs more usable, aligning them with human preferences is essential.…

Computation and Language · Computer Science 2024-10-21 Mozhi Zhang , Pengyu Wang , Chenkun Tan , Mianqiu Huang , Dong Zhang , Yaqian Zhou , Xipeng Qiu

The dissemination of false information on online platforms presents a serious societal challenge. While manual fact-checking remains crucial, Large Language Models (LLMs) offer promising opportunities to support fact-checkers with their…

Computation and Language · Computer Science 2024-10-31 Ivan Vykopal , Matúš Pikuliak , Simon Ostermann , Marián Šimko

Stance detection is critical for understanding the underlying position or attitude expressed toward a topic. Large language models (LLMs) have demonstrated significant advancements across various natural language processing tasks including…

Computation and Language · Computer Science 2025-02-11 Ang Li , Jingqian Zhao , Bin Liang , Lin Gui , Hui Wang , Xi Zeng , Xingwei Liang , Kam-Fai Wong , Ruifeng Xu

Large Language Models (LLMs) have shown exceptional performance across various Data-to-Text Generation (DTG) tasks. However, generating factually consistent text in DTG remains challenging for LLMs. Despite this, in-depth evaluations of LLM…

Computation and Language · Computer Science 2024-12-02 Joy Mahapatra , Utpal Garain

Large Language Models (LLMs) are trained on vast and diverse internet corpora that often include inaccurate or misleading content. Consequently, LLMs can generate misinformation, making robust fact-checking essential. This review…

Large Language Models (LLMs) currently respond to every prompt. However, they can produce incorrect answers when they lack knowledge or capability -- a problem known as hallucination. We instead propose post-training an LLM to generate…

Computation and Language · Computer Science 2026-02-17 Tim Franzmeyer , Archie Sravankumar , Lijuan Liu , Yuning Mao , Rui Hou , Sinong Wang , Jakob N. Foerster , Luke Zettlemoyer , Madian Khabsa

Large language models (LLMs) encode knowledge with varying degrees of confidence. When responding to queries, models face an inherent trade-off: they can generate responses that are less informative but highly factual, or more informative…

Computation and Language · Computer Science 2026-02-03 Ziwei Gong , Yanda Chen , Julia Hirschberg , Chen Zhao , He He , Zhou Yu , Kathleen Mckeown

Large language models (LLMs) exhibit hallucinations (i.e., unfaithful or nonsensical information) when serving as AI assistants in various domains. Since hallucinations always come with truthful content in the LLM responses, previous…

Computation and Language · Computer Science 2025-03-05 Yuzhe Gu , Wenwei Zhang , Chengqi Lyu , Dahua Lin , Kai Chen

Large language models (LLMs) excel at generating long-form responses, but evaluating their factuality remains challenging due to complex inter-sentence dependencies within the generated facts. Prior solutions predominantly follow a…

Computation and Language · Computer Science 2025-09-30 Xin Liu , Lechen Zhang , Sheza Munir , Yiyang Gu , Lu Wang

This paper investigates the factuality of large language models (LLMs) as knowledge bases in the legal domain, in a realistic usage scenario: we allow for acceptable variations in the answer, and let the model abstain from answering when…

Computation and Language · Computer Science 2024-09-19 Rajaa El Hamdani , Thomas Bonald , Fragkiskos Malliaros , Nils Holzenberger , Fabian Suchanek

Multiple critical scenarios (like Wikipedia text generation given English Infoboxes) need automated generation of descriptive text in low resource (LR) languages from English fact triples. Previous work has focused on English fact-to-text…

Computation and Language · Computer Science 2022-04-26 Tushar Abhishek , Shivprasad Sagare , Bhavyajeet Singh , Anubhav Sharma , Manish Gupta , Vasudeva Varma

Recent Large Language Models (LLMs) have significantly advanced natural language processing and automated decision-making. However, these models still encounter difficulties when performing complex reasoning tasks involving logical…

Computation and Language · Computer Science 2025-06-26 Yubo Dong , Hehe Fan

While large language models (LLMs) have proven to be effective on a large variety of tasks, they are also known to hallucinate information. To measure whether an LLM prefers factually consistent continuations of its input, we propose a new…

Computation and Language · Computer Science 2023-12-05 Derek Tam , Anisha Mascarenhas , Shiyue Zhang , Sarah Kwan , Mohit Bansal , Colin Raffel

In-car conversational systems bring the promise to improve the in-vehicle user experience. Modern conversational systems are based on Large Language Models (LLMs), which makes them prone to errors such as hallucinations, i.e., inaccurate,…

Computation and Language · Computer Science 2025-04-03 Rafael Giebisch , Ken E. Friedl , Lev Sorokin , Andrea Stocco

Alignment plays a crucial role in Large Language Models (LLMs) in aligning with human preferences on a specific task/domain. Traditional alignment methods suffer from catastrophic forgetting, where models lose previously acquired knowledge…

Computation and Language · Computer Science 2026-04-09 Junsong Li , Jie Zhou , Bihao Zhan , Yutao Yang , Qianjun Pan , Shilian Chen , Tianyu Huai , Xin Li , Qin Chen , Liang He

Factuality in Large Language Models (LLMs) is a persistent challenge. Current benchmarks often assess short factual answers, overlooking the critical ability to generate structured, multi-record tabular outputs from parametric knowledge. We…

Computation and Language · Computer Science 2025-05-28 Dario Satriani , Enzo Veltri , Donatello Santoro , Paolo Papotti

Retrieval-Augmented Generation (RAG) has emerged as a powerful framework to improve factuality in large language models (LLMs) by grounding their outputs in retrieved documents. However, ensuring perfect retrieval of relevant information…

Computation and Language · Computer Science 2025-12-04 Zhan Peng Lee , Andre Lin , Calvin Tan

In today's digital era, the rapid spread of misinformation poses threats to public well-being and societal trust. As online misinformation proliferates, manual verification by fact checkers becomes increasingly challenging. We introduce…

Computation and Language · Computer Science 2023-10-16 Eun Cheol Choi , Emilio Ferrara

Many text generation applications require the generated text to be factually consistent with input information. Automatic evaluation of factual consistency is challenging. Previous work has developed various metrics that often depend on…

Computation and Language · Computer Science 2023-05-29 Yuheng Zha , Yichi Yang , Ruichen Li , Zhiting Hu

Recently, large models have shown significant potential for smart healthcare. However, the deployment of Large Vision-Language Models (LVLMs) for clinical services is currently hindered by three critical challenges: a tendency to…

Artificial Intelligence · Computer Science 2025-10-27 Siyong Chen , Jinbo Wen , Jiawen Kang , Tenghui Huang , Xumin Huang , Yuanjia Su , Hudan Pan , Zishao Zhong , Dusit Niyato , Shengli Xie , Dong In Kim