English
Related papers

Related papers: Too Consistent to Detect: A Study of Self-Consiste…

200 papers

Large Language Models (LLMs) have grown increasingly powerful, yet ensuring their decisions remain transparent and trustworthy requires self-consistency -- no contradictions in their internal reasoning. Our study reveals that even on simple…

Computation and Language · Computer Science 2025-06-24 Zhenru Lin , Jiawen Tao , Yang Yuan , Andrew Chi-Chih Yao

Large Language Models (LLMs) have shown great potential in Natural Language Processing (NLP) tasks. However, recent literature reveals that LLMs generate nonfactual responses intermittently, which impedes the LLMs' reliability for further…

Computation and Language · Computer Science 2024-03-22 Yukun Zhao , Lingyong Yan , Weiwei Sun , Guoliang Xing , Chong Meng , Shuaiqiang Wang , Zhicong Cheng , Zhaochun Ren , Dawei Yin

Large language models (LLMs) have achieved widespread success on a variety of in-context few-shot tasks, but this success is typically evaluated via correctness rather than consistency. We argue that self-consistency is an important…

Computation and Language · Computer Science 2024-02-09 Angelica Chen , Jason Phang , Alicia Parrish , Vishakh Padmakumar , Chen Zhao , Samuel R. Bowman , Kyunghyun Cho

Large language models (LLMs) have recently achieved significant success across various application domains, garnering substantial attention from different communities. Unfortunately, even for the best LLM, many \textit{faults} still exist…

Software Engineering · Computer Science 2024-11-06 Qiang Hu , Jin Wen , Maxime Cordy , Yuheng Huang , Wei Ma , Xiaofei Xie , Lei Ma

The reliability of large language models (LLMs) is greatly compromised by their tendency to hallucinate, underscoring the need for precise identification of knowledge gaps within LLMs. Various methods for probing such gaps exist, ranging…

Computation and Language · Computer Science 2025-06-02 Raoyuan Zhao , Abdullatif Köksal , Ali Modarressi , Michael A. Hedderich , Hinrich Schütze

Large language models (LLMs) are becoming useful in many domains due to their impressive abilities that arise from large training datasets and large model sizes. However, research on LLM-based approaches to document inconsistency detection…

Computation and Language · Computer Science 2026-04-09 Nelvin Tan , Yaowen Zhang , James Asikin Cheung , Fusheng Liu , Yu-Ching Shih , Dong Yang

A popular approach for improving the correctness of output from large language models (LLMs) is Self-Consistency - poll the LLM multiple times and output the most frequent solution. Existing Self-Consistency techniques always generate a…

Computation and Language · Computer Science 2023-11-17 Pranjal Aggarwal , Aman Madaan , Yiming Yang , Mausam

Large language models (LLMs) that do not give consistent answers across contexts are problematic when used for tasks with expectations of consistency, e.g., question-answering, explanations, etc. Our work presents an evaluation benchmark…

Computation and Language · Computer Science 2023-10-23 Henning Bartsch , Ole Jorgensen , Domenic Rosati , Jason Hoelscher-Obermaier , Jacob Pfau

The wide adoption of Large language models (LLMs) makes their dependability a pressing concern. Detection of errors is the first step to mitigating their impact on a system and thus, efficient error detection for LLMs is an important issue.…

Artificial Intelligence · Computer Science 2025-09-17 Jinhua Zhu , Javier Conde , Zhen Gao , Pedro Reviriego , Shanshan Liu , Fabrizio Lombardi

In a plethora of recent work, large language models (LLMs) demonstrated impressive reasoning ability, but many proposed downstream reasoning tasks only focus on final answers. Two fundamental questions persist: 1) how consistent is the…

Computation and Language · Computer Science 2024-10-22 Ziyi Liu , Soumya Sanyal , Isabelle Lee , Yongkang Du , Rahul Gupta , Yang Liu , Jieyu Zhao

Large language models (LLMs) have shown tremendous success in following user instructions and generating helpful responses. Nevertheless, their robustness is still far from optimal, as they may generate significantly inconsistent responses…

Computation and Language · Computer Science 2024-03-25 Yukun Zhao , Lingyong Yan , Weiwei Sun , Guoliang Xing , Shuaiqiang Wang , Chong Meng , Zhicong Cheng , Zhaochun Ren , Dawei Yin

Large Language Models (LLMs) are widely believed to possess self-correction capabilities, yet recent studies suggest that intrinsic self-correction--where models correct their own outputs without external feedback--remains largely…

Artificial Intelligence · Computer Science 2026-01-06 Yin Li

Code Large Language Models (Code LLMs) are being increasingly employed in real-life applications, so evaluating them is critical. While the conventional accuracy evaluates the performance of Code LLMs on a set of individual tasks, their…

Machine Learning · Computer Science 2024-02-27 Marcus J. Min , Yangruibo Ding , Luca Buratti , Saurabh Pujar , Gail Kaiser , Suman Jana , Baishakhi Ray

Large Language Models (LLMs) changed the way we design and interact with software systems. Their ability to process and extract information from text has drastically improved productivity in a number of routine tasks. Developers that want…

Machine Learning · Computer Science 2025-08-26 Federico Errica , Giuseppe Siracusano , Davide Sanvito , Roberto Bifulco

Mechanistic approaches to deception in large language models (LLMs) often rely on "lie detectors", that is, truth probes trained to identify internal representations of model outputs as false. The lie detector approach to LLM deception…

Computation and Language · Computer Science 2026-03-12 Tom-Felix Berger

Large Language Models (LLMs) exhibit remarkable fluency and competence across various natural language tasks. However, recent research has highlighted their sensitivity to variations in input prompts. To deploy LLMs in a safe and reliable…

Computation and Language · Computer Science 2025-04-30 Harsh Raj , Vipul Gupta , Domenic Rosati , Subhabrata Majumdar

Large language models (LLMs) have shown potential as general evaluators along with the evident benefits of speed and cost. While their correlation against human annotators has been widely studied, consistency as evaluators is still…

Computation and Language · Computer Science 2024-12-03 Noah Lee , Jiwoo Hong , James Thorne

Large language models (LLMs) provide detailed and impressive responses to queries in English. However, are they really consistent at responding to the same query in other languages? The popular way of evaluating for multilingual performance…

Computation and Language · Computer Science 2025-05-29 Ashim Gupta , Maitrey Mehta , Zhichao Xu , Vivek Srikumar

Evaluating consistency in large language models (LLMs) is crucial for ensuring reliability, particularly in complex, multi-step interactions between humans and LLMs. Traditional self-consistency methods often miss subtle semantic changes in…

Artificial Intelligence · Computer Science 2025-06-18 Zhaochen Hong , Haofei Yu , Jiaxuan You

Large language models (LLMs) have demonstrated impressive capabilities, but still suffer from inconsistency issues (e.g. LLMs can react differently to disturbances like rephrasing or inconsequential order change). In addition to these…

Computation and Language · Computer Science 2024-06-19 Zhe Yang , Yichang Zhang , Tianyu Liu , Jian Yang , Junyang Lin , Chang Zhou , Zhifang Sui
‹ Prev 1 2 3 10 Next ›