English
Related papers

Related papers: Firm or Fickle? Evaluating Large Language Models C…

200 papers

Large language models (LLMs) often exhibit deficient reasoning or generate hallucinations. To address these, studies prefixed with "Self-" such as Self-Consistency, Self-Improve, and Self-Refine have been initiated. They share a…

Computation and Language · Computer Science 2024-09-19 Xun Liang , Shichao Song , Zifan Zheng , Hanyu Wang , Qingchen Yu , Xunkai Li , Rong-Hua Li , Yi Wang , Zhonghao Wang , Feiyu Xiong , Zhiyu Li

There is a growing literature on reasoning by large language models (LLMs), but the discussion on the uncertainty in their responses is still lacking. Our aim is to assess the extent of confidence that LLMs have in their answers and how it…

Computation and Language · Computer Science 2024-12-23 Yudi Pawitan , Chris Holmes

Semantic consistency of a language model is broadly defined as the model's ability to produce semantically-equivalent outputs, given semantically-equivalent inputs. We address the task of assessing question-answering (QA) semantic…

Computation and Language · Computer Science 2023-11-03 Ella Rabinovich , Samuel Ackerman , Orna Raz , Eitan Farchi , Ateret Anaby-Tavor

At the staggering pace with which the capabilities of large language models (LLMs) are increasing, creating future-proof evaluation sets to assess their understanding becomes more and more challenging. In this paper, we propose a novel…

Computation and Language · Computer Science 2023-12-21 Xenia Ohmer , Elia Bruni , Dieuwke Hupkes

Consistency, which refers to the capability of generating the same predictions for semantically similar contexts, is a highly desirable property for a sound language understanding model. Although recent pretrained language models (PLMs)…

Computation and Language · Computer Science 2021-08-17 Myeongjun Jang , Deuk Sin Kwon , Thomas Lukasiewicz

In the realm of Large Language Model (LLM) functionalities, providing reliable information is paramount, yet reports suggest that LLM outputs lack consistency. This inconsistency, often at-tributed to randomness in token sampling,…

Computation and Language · Computer Science 2024-10-22 Yanggyu Lee , Jihie Kim

Large language models (LLMs) are increasingly used to support the analysis of complex financial disclosures, yet their reliability, behavioral consistency, and transparency remain insufficiently understood in high-stakes settings. This…

Computation and Language · Computer Science 2026-01-21 Md Talha Mohsin

This study provides the first comprehensive assessment of consistency and reproducibility in Large Language Model (LLM) outputs in finance and accounting research. We evaluate how consistently LLMs produce outputs given identical inputs…

General Finance · Quantitative Finance 2025-09-16 Julian Junyan Wang , Victor Xiaoqi Wang

Generative AI (Gen AI) with large language models (LLMs) are being widely adopted across the industry, academia and government. Cybersecurity is one of the key sectors where LLMs can be and/or are already being used. There are a number of…

Cryptography and Security · Computer Science 2025-03-12 Aditya Patwardhan , Vivek Vaidya , Ashish Kundu

To enhance Large Language Models' (LLMs) reliability, calibration is essential -- the model's assessed confidence scores should align with the actual likelihood of its responses being correct. However, current confidence elicitation methods…

Computation and Language · Computer Science 2024-10-29 Yukun Huang , Yixin Liu , Raghuveer Thirukovalluru , Arman Cohan , Bhuwan Dhingra

Large language models (LLMs) that do not give consistent answers across contexts are problematic when used for tasks with expectations of consistency, e.g., question-answering, explanations, etc. Our work presents an evaluation benchmark…

Computation and Language · Computer Science 2023-10-23 Henning Bartsch , Ole Jorgensen , Domenic Rosati , Jason Hoelscher-Obermaier , Jacob Pfau

Evaluating consistency in large language models (LLMs) is crucial for ensuring reliability, particularly in complex, multi-step interactions between humans and LLMs. Traditional self-consistency methods often miss subtle semantic changes in…

Artificial Intelligence · Computer Science 2025-06-18 Zhaochen Hong , Haofei Yu , Jiaxuan You

Multilingual large-scale Pretrained Language Models (PLMs) have been shown to store considerable amounts of factual knowledge, but large variations are observed across languages. With the ultimate goal of ensuring that users with different…

Computation and Language · Computer Science 2025-05-20 Jirui Qi , Raquel Fernández , Arianna Bisazza

Large language models (LLMs) have demonstrated remarkable capabilities across a wide range of tasks in various domains. Despite their impressive performance, they can be unreliable due to factual errors in their generations. Assessing their…

Computation and Language · Computer Science 2024-03-26 Jiahui Geng , Fengyu Cai , Yuxia Wang , Heinz Koeppl , Preslav Nakov , Iryna Gurevych

In recent years, large language models (LLMs) have demonstrated significant success in performing varied natural language tasks such as language translation, question-answering, summarizing, fact-checking, etc. Despite LLMs' impressive…

Computation and Language · Computer Science 2025-03-03 Bishwamittra Ghosh , Sarah Hasan , Naheed Anjum Arafat , Arijit Khan

In this work, we report our efforts to advance the standard operation procedure of developing Large Language Models (LLMs) or LLMs-based systems or services in industry. We introduce the concept of Large Language Model Development Lifecycle…

Computation and Language · Computer Science 2024-08-12 Fufangchen Zhao , Guoqiang Jin , Rui Zhao , Jiangheng Huang , Fei Tan

Large Language Models (LLMs) have acquired ubiquitous attention for their performances across diverse domains. Our study here searches through LLMs' cognitive abilities and confidence dynamics. We dive deep into understanding the alignment…

Computation and Language · Computer Science 2023-09-29 Aniket Kumar Singh , Suman Devkota , Bishal Lamichhane , Uttam Dhakal , Chandra Dhakal

Large Language Models (LLMs) demonstrate remarkable capabilities in text generation, yet their emotional consistency and semantic coherence in social media contexts remain insufficiently understood. This study investigates how LLMs handle…

Computation and Language · Computer Science 2025-11-05 Wentao Xu , Wenlu Fan , Yuqi Zhu , Bin Wang

Large language models (LLMs) have shown potential as general evaluators along with the evident benefits of speed and cost. While their correlation against human annotators has been widely studied, consistency as evaluators is still…

Computation and Language · Computer Science 2024-12-03 Noah Lee , Jiwoo Hong , James Thorne

Large language models (LLMs) often need to balance their internal parametric knowledge with external information, such as user beliefs and content from retrieved documents, in real-world scenarios like RAG or chat-based systems. A model's…

Computation and Language · Computer Science 2026-04-27 Shuowei Li , Haoxin Li , Wenda Chu , Yi Fang