English
Related papers

Related papers: A Survey on the Honesty of Large Language Models

200 papers

This paper investigates the capabilities of Large Language Models (LLMs) in the context of understanding their knowledge and uncertainty over questions. Specifically, we focus on addressing known-unknown questions, characterized by high…

Computation and Language · Computer Science 2024-07-03 Alfonso Amayuelas , Kyle Wong , Liangming Pan , Wenhu Chen , William Wang

The honesty of large language models (LLMs) is a critical alignment challenge, especially as advanced systems with chain-of-thought (CoT) reasoning may strategically deceive humans. Unlike traditional honesty issues on LLMs, which could be…

Artificial Intelligence · Computer Science 2025-06-06 Kai Wang , Yihao Zhang , Meng Sun

People tell lies when seeking rewards. Large language models (LLMs) are aligned to human values with reinforcement learning where they get rewards if they satisfy human preference. We find that this also induces dishonesty in helpful and…

Computation and Language · Computer Science 2024-06-06 Youcheng Huang , Jingkun Tang , Duanyu Feng , Zheng Zhang , Wenqiang Lei , Jiancheng Lv , Anthony G. Cohn

Large language models (LLMs) have shown strong capabilities, enabling concise, context-aware answers in question answering (QA) tasks. The lack of transparency in complex LLMs has inspired extensive research aimed at developing methods to…

Computation and Language · Computer Science 2025-09-22 Yangyi Li , Mengdi Huai

Large language models (LLMs), a recent advance in deep learning and machine intelligence, have manifested astonishing capacities, now considered among the most promising for artificial general intelligence. With human-like capabilities,…

Artificial Intelligence · Computer Science 2025-09-19 Zhilun Zhou , Jing Yi Wang , Nicholas Sukiennik , Chen Gao , Fengli Xu , Yong Li , James Evans

Large language models (LLMs) are trained on extensive datasets that encapsulate substantial world knowledge. However, their outputs often include confidently stated inaccuracies. Earlier works suggest that LLMs encode truthfulness as a…

Computation and Language · Computer Science 2025-06-03 Yuntai Bao , Xuhong Zhang , Tianyu Du , Xinkui Zhao , Zhengwen Feng , Hao Peng , Jianwei Yin

Recently Multimodal Large Language Models (MLLMs) have achieved considerable advancements in vision-language tasks, yet produce potentially harmful or untrustworthy content. Despite substantial work investigating the trustworthiness of…

Artificial Intelligence · Computer Science 2026-01-14 Yanxu Zhu , Shitong Duan , Xiangxu Zhang , Jitao Sang , Peng Zhang , Tun Lu , Xiao Zhou , Jing Yao , Xiaoyuan Yi , Xing Xie

Large Language Models (LLMs) have demonstrated impressive capabilities across various domains, prompting a surge in their practical applications. However, concerns have arisen regarding the trustworthiness of LLMs outputs, particularly in…

Computation and Language · Computer Science 2024-05-08 Danna Zheng , Danyang Liu , Mirella Lapata , Jeff Z. Pan

Large language models (LLMs) are increasingly used to simulate survey responses, but synthetic data can be misaligned with the human population, leading to unreliable inference. We develop a general framework that converts LLM-simulated…

Methodology · Statistics 2026-05-21 Chengpiao Huang , Yuhang Wu , Kaizheng Wang

Large language models (LLMs) are complex artificial intelligence systems capable of understanding, generating and translating human language. They learn language patterns by analyzing large amounts of text data, allowing them to perform…

Cryptography and Security · Computer Science 2024-03-15 Biwei Yan , Kun Li , Minghui Xu , Yueyan Dong , Yue Zhang , Zhaochun Ren , Xiuzhen Cheng

As artificial intelligence (AI) systems, particularly large language models (LLMs), become increasingly integrated into decision-making processes, the ability to trust their outputs is crucial. To earn human trust, LLMs must be well…

Machine Learning · Computer Science 2025-02-14 Mark Steyvers , Heliodoro Tejeda , Aakriti Kumar , Catarina Belem , Sheer Karny , Xinyue Hu , Lukas Mayer , Padhraic Smyth

Large language models (LLMs) demonstrate outstanding capabilities, but challenges remain regarding their ability to solve complex reasoning tasks, as well as their transparency, robustness, truthfulness, and ethical alignment. In this…

Computers and Society · Computer Science 2023-12-19 Konstantin Hebenstreit , Robert Praas , Matthias Samwald

In recent years, Large Language Models (LLMs) have become fundamental to a broad spectrum of artificial intelligence applications. As the use of LLMs expands, precisely estimating the uncertainty in their predictions has become crucial.…

Artificial Intelligence · Computer Science 2024-10-29 Mohammad Beigi , Sijia Wang , Ying Shen , Zihao Lin , Adithya Kulkarni , Jianfeng He , Feng Chen , Ming Jin , Jin-Hee Cho , Dawei Zhou , Chang-Tien Lu , Lifu Huang

Large Language Models (LLMs) have made significant advances in natural language processing, but their underlying mechanisms are often misunderstood. Despite exhibiting coherent answers and apparent reasoning behaviors, LLMs rely on…

Computation and Language · Computer Science 2024-08-05 Bo Zhou , Daniel Geißler , Paul Lukowicz

Large language models (LLMs) have demonstrated impressive capabilities in natural language processing. However, their internal mechanisms are still unclear and this lack of transparency poses unwanted risks for downstream applications.…

Computation and Language · Computer Science 2023-11-30 Haiyan Zhao , Hanjie Chen , Fan Yang , Ninghao Liu , Huiqi Deng , Hengyi Cai , Shuaiqiang Wang , Dawei Yin , Mengnan Du

Large language models (LLMs) are revolutionizing every aspect of society. They are increasingly used in problem-solving tasks to substitute human assessment and reasoning. LLMs are trained on what humans write and are thus exposed to human…

Software Engineering · Computer Science 2025-10-14 Fengfei Sun , Ningke Li , Kailong Wang , Lorenz Goette

Large Language Models (LLMs) should answer factual questions truthfully, grounded in objective knowledge, regardless of user context such as self-disclosed personal information, or system personalization. In this paper, we present the first…

Computation and Language · Computer Science 2025-10-16 Nil-Jana Akpinar , Chia-Jung Lee , Vanessa Murdock , Pietro Perona

Current Large Language Models (LLMs) are unparalleled in their ability to generate grammatically correct, fluent text. LLMs are appearing rapidly, and debates on LLM capacities have taken off, but reflection is lagging behind. Thus, in this…

Computation and Language · Computer Science 2023-11-01 Bram M. A. van Dijk , Tom Kouwenhoven , Marco R. Spruit , Max J. van Duijn

Large Language Models (LLMs) have demonstrated remarkable capabilities in performing complex cognitive tasks. However, their complexity and lack of transparency have raised several trustworthiness concerns, including the propagation of…

Machine Learning · Computer Science 2023-11-07 Satyapriya Krishna

The rapid progress in Large Language Models (LLMs) could transform many fields, but their fast development creates significant challenges for oversight, ethical creation, and building user trust. This comprehensive review looks at key trust…

Computers and Society · Computer Science 2024-07-22 Md Meftahul Ferdaus , Mahdi Abdelguerfi , Elias Ioup , Kendall N. Niles , Ken Pathak , Steven Sloan