English
Related papers

Related papers: FactAlign: Long-form Factuality Alignment of Large…

200 papers

Alignment of Large Language Models (LLMs) remains an unsolved problem. Human preferences are highly distributed and can be captured at multiple levels of abstraction, from the individual to diverse populations. Organisational preferences,…

Machine Learning · Computer Science 2024-08-02 Gareth Seneque , Lap-Hang Ho , Ariel Kuperman , Nafise Erfanian Saeedi , Jeffrey Molendijk

The development of Long-Context Large Language Models (LLMs) has markedly advanced natural language processing by facilitating the process of textual data across long documents and multiple corpora. However, Long-Context LLMs still face two…

Computation and Language · Computer Science 2024-10-10 Jingyang Deng , Zhengyang Shen , Boyang Wang , Lixin Su , Suqi Cheng , Ying Nie , Junfeng Wang , Dawei Yin , Jinwen Ma

Large language models (LLMs) have been treated as knowledge bases due to their strong performance in knowledge probing tasks. LLMs are typically evaluated using accuracy, yet this metric does not capture the vulnerability of LLMs to…

Computation and Language · Computer Science 2023-10-17 Weixuan Wang , Barry Haddow , Alexandra Birch , Wei Peng

Large Language Models (LLMs) have become increasingly important in natural language processing, enabling advanced data analytics through natural language queries. However, these models often generate "hallucinations"-inaccurate or…

Computation and Language · Computer Science 2024-10-29 Mikhail Rumiantsau , Aliaksei Vertsel , Ilya Hrytsuk , Isaiah Ballah

Large Language Models (LLMs) often generate responses with inherent biases, undermining their reliability in real-world applications. Existing evaluation methods often overlook biases in long-form responses and the intrinsic variability of…

Computation and Language · Computer Science 2025-10-13 Weijie Xu , Yiwen Wang , Chi Xue , Xiangkun Hu , Xi Fang , Guimin Dong , Chandan K. Reddy

We introduce FACTS Grounding, an online leaderboard and associated benchmark that evaluates language models' ability to generate text that is factually accurate with respect to given context in the user prompt. In our benchmark, each prompt…

Large Language Models (LLMs) have demonstrated remarkable adaptability, showcasing their capacity to excel in tasks for which they were not explicitly trained. However, despite their impressive natural language processing (NLP)…

Computation and Language · Computer Science 2023-09-08 Supun Manathunga , Isuru Hettigoda

Large language models (LLMs) have demonstrated remarkable capabilities in language generation, understanding, and few-shot learning in recent years. An extensive body of work has explored how their performance may be further improved…

Computation and Language · Computer Science 2023-05-24 Yilun Du , Shuang Li , Antonio Torralba , Joshua B. Tenenbaum , Igor Mordatch

To enhance Large Language Models' (LLMs) reliability, calibration is essential -- the model's assessed confidence scores should align with the actual likelihood of its responses being correct. However, current confidence elicitation methods…

Computation and Language · Computer Science 2024-10-29 Yukun Huang , Yixin Liu , Raghuveer Thirukovalluru , Arman Cohan , Bhuwan Dhingra

Grounded claim factuality checking is important for large language model (LLM) applications such as retrieval-augmented generation, as it helps users assess the correctness of generated outputs. Existing metrics using entailment classifiers…

Computation and Language · Computer Science 2026-05-29 Yuxuan Ye , Raul Santos-Rodriguez , Edwin Simpson

With the widespread adoption of large language models (LLMs) in numerous applications, the challenge of factuality and the propensity for hallucinations has emerged as a significant concern. To address this issue, particularly in…

Artificial Intelligence · Computer Science 2024-07-03 Yihao Fang , Stephen W. Thomas , Xiaodan Zhu

Large language models (LLMs) have shown impressive prowess in solving a wide range of tasks with world knowledge. However, it remains unclear how well LLMs are able to perceive their factual knowledge boundaries, particularly under…

Computation and Language · Computer Science 2024-11-20 Ruiyang Ren , Yuhao Wang , Yingqi Qu , Wayne Xin Zhao , Jing Liu , Hao Tian , Hua Wu , Ji-Rong Wen , Haifeng Wang

Large language models (LLMs) have emerged as a widely-used tool for information seeking, but their generated outputs are prone to hallucination. In this work, our aim is to allow LLMs to generate text with citations, improving their factual…

Computation and Language · Computer Science 2023-11-01 Tianyu Gao , Howard Yen , Jiatong Yu , Danqi Chen

Large language models (LLMs) often produce unsupported or unverifiable content, known as "hallucinations." To mitigate this, retrieval-augmented LLMs incorporate citations, grounding the content in verifiable sources. Despite such…

Information Retrieval · Computer Science 2024-08-26 Weijia Zhang , Mohammad Aliannejadi , Yifei Yuan , Jiahuan Pei , Jia-Hong Huang , Evangelos Kanoulas

We introduce OpenFActScore, an open-source implementation of the FActScore framework for evaluating the factuality of text generated by large language models (LLMs). FActScore evaluates the factual accuracy of long-form text by using Atomic…

Computation and Language · Computer Science 2025-07-09 Lucas Fonseca Lage , Simon Ostermann

Large language models (LLMs) have exhibited impressive reasoning abilities on a wide range of complex tasks. However, enhancing these capabilities through post-training remains resource intensive, particularly in terms of data and…

Artificial Intelligence · Computer Science 2025-08-13 Shuo Cai , Su Lu , Qi Zhou , Kejing Yang , Zhijie Sang , Congkai Xie , Hongxia Yang

We investigate the internal behavior of Transformer-based Large Language Models (LLMs) when they generate factually incorrect text. We propose modeling factual queries as constraint satisfaction problems and use this framework to…

Computation and Language · Computer Science 2024-04-18 Mert Yuksekgonul , Varun Chandrasekaran , Erik Jones , Suriya Gunasekar , Ranjita Naik , Hamid Palangi , Ece Kamar , Besmira Nushi

Large Language Models (LLMs) have impressive capabilities, but are prone to outputting falsehoods. Recent work has developed techniques for inferring whether a LLM is telling the truth by training probes on the LLM's internal activations.…

Artificial Intelligence · Computer Science 2024-08-20 Samuel Marks , Max Tegmark

Factual knowledge extraction aims to explicitly extract knowledge parameterized in pre-trained language models for application in downstream tasks. While prior work has been investigating the impact of supervised fine-tuning data on the…

Computation and Language · Computer Science 2025-05-30 Xuan Gong , Hanbo Huang , Shiyu Liang

Large Language Models (LLMs) trained on extensive textual corpora have emerged as leading solutions for a broad array of Natural Language Processing (NLP) tasks. Despite their notable performance, these models are prone to certain…

Computation and Language · Computer Science 2023-07-25 Yufei Wang , Wanjun Zhong , Liangyou Li , Fei Mi , Xingshan Zeng , Wenyong Huang , Lifeng Shang , Xin Jiang , Qun Liu