English
Related papers

Related papers: Classifying Unreliable Narrators with Large Langua…

200 papers

Large Language Model (LLM) evaluation is currently one of the most important areas of research, with existing benchmarks proving to be insufficient and not completely representative of LLMs' various capabilities. We present a curated…

Computation and Language · Computer Science 2024-06-05 Aisha Khatun , Daniel G. Brown

Large Language Models (LLMs) are known to produce very high-quality tests and responses to our queries. But how much can we trust this generated text? In this paper, we study the problem of uncertainty quantification in LLMs. We propose a…

Computation and Language · Computer Science 2025-04-28 Muhammad Mubashar , Shireen Kudukkil Manchingal , Fabio Cuzzolin

Unlearning in large language models (LLMs) aims to remove harmful training data while preserving overall utility. However, we find that existing methods often hallucinate, generate abnormal token sequences, or behave inconsistently, raising…

Machine Learning · Computer Science 2026-05-12 Renjie Gu , Jiazhen Du , Yihua Zhang , Sijia Liu

Large Language Models (LLMs) are increasingly deployed in real-world applications where users engage in extended, mixed-topic conversations that depend on prior context. Yet, their reliability under realistic multi-turn interactions remains…

Computation and Language · Computer Science 2026-03-03 Jiyoon Myung

Large language models (LLMs) are prone to hallucinations, i.e., statements unsupported by the input or training data, hindering reliable deployment. In parallel, numerous uncertainty estimation (UE) methods have been proposed to quantify…

Computation and Language · Computer Science 2026-05-27 Yedidia Agnimo , Anna Korba , Annabelle Blangero , Nicolas Chesneau , Karteek Alahari

Sharing personal narratives is a fundamental aspect of human social behavior as it helps share our life experiences. We can tell stories and rely on our background to understand their context, similarities, and differences. A substantial…

Computation and Language · Computer Science 2020-05-28 Belen Saldias , Deb Roy

As LLMs rapidly advance, increasing concerns arise regarding risks about actual authorship of texts we see online and in real world. The task of distinguishing LLM-authored texts is complicated by the nuanced and overlapping behaviors of…

Computation and Language · Computer Science 2025-06-25 Jiazhou Ji , Ruizhe Li , Shujun Li , Jie Guo , Weidong Qiu , Zheng Huang , Chiyu Chen , Xiaoyu Jiang , Xinru Lu

Large language models (LLMs) are trained on vast amounts of text from the internet, which contains both factual and misleading information about the world. While unintuitive from a classic view of LMs, recent work has shown that the truth…

Computation and Language · Computer Science 2024-02-07 Nitish Joshi , Javier Rando , Abulhair Saparov , Najoung Kim , He He

Large language models (LLMs) turn writing into a live exchange between humans and software. We characterize this new medium as a discursive network that treats people and LLMs as equal nodes and tracks how their statements circulate. We…

Computation and Language · Computer Science 2025-07-24 Juan B. Gutiérrez

Large language models (LLMs) have the potential to aid and improve human decision-making in classification tasks, not only by providing fairly accurate predictions, but also in their ability to generate cogent narrative explanations of…

Human-Computer Interaction · Computer Science 2026-05-25 Laura R. Marusich , Mary Grace Kozuch Dhooghe , Jonathan Z. Bakdash , Murat Kantarcioglu

Machine Learning (ML) has become an integral part of our society, commonly used in critical domains such as finance, healthcare, and transportation. Therefore, it is crucial to evaluate not only whether ML models make correct predictions…

Machine Learning · Computer Science 2024-06-11 Steven Cho , Seaton Cousins-Baxter , Stefano Ruberto , Valerio Terragni

Large Language Models (LLMs) have revolutionised natural language processing, exhibiting impressive human-like capabilities. In particular, LLMs are capable of "lying", knowingly outputting false statements. Hence, it is of interest and…

Computation and Language · Computer Science 2024-10-22 Lennart Bürger , Fred A. Hamprecht , Boaz Nadler

Large Language Models (LLMs) have demonstrated an alarming ability to impersonate humans in conversation, raising concerns about their potential misuse in scams and deception. Humans have a right to know if they are conversing to an LLM. We…

Computation and Language · Computer Science 2024-12-23 Gilad Gressel , Rahul Pankajakshan , Yisroel Mirsky

Explanations of machine learning (ML) model predictions generated by Explainable AI (XAI) techniques such as SHAP are essential for people using ML outputs for decision-making. We explore the potential of Large Language Models (LLMs) to…

Computation and Language · Computer Science 2024-12-09 Alexandra Zytek , Sara Pido , Sarah Alnegheimish , Laure Berti-Equille , Kalyan Veeramachaneni

Large Language Models (LLMs) are employed across various high-stakes domains, where the reliability of their outputs is crucial. One commonly used method to assess the reliability of LLMs' responses is uncertainty estimation, which gauges…

Large Language Models (LLMs), characterized by being trained on broad amounts of data in a self-supervised manner, have shown impressive performance across a wide range of tasks. Indeed, their generative abilities have aroused interest on…

Machine Learning · Computer Science 2024-07-30 Jorge García-Carrasco , Alejandro Maté , Juan Trujillo

Large language models (LLMs) are increasingly used in high-stakes settings, where overconfident responses can mislead users. Reliable confidence estimation has been shown to enhance trust and task accuracy. Yet existing methods face…

Computation and Language · Computer Science 2025-09-30 Linwei Tao , Yi-Fan Yeh , Bo Kai , Minjing Dong , Tao Huang , Tom A. Lamb , Jialin Yu , Philip H. S. Torr , Chang Xu

The applicability of Large Language Models (LLMs) in temporal reasoning tasks over data that is not present during training is still a field that remains to be explored. In this paper we work on this topic, focusing on structured and…

Computation and Language · Computer Science 2025-12-03 Alfredo Garrachón Ruiz , Tomás de la Rosa , Daniel Borrajo

Large language models (LLMs) have revolutionized the field of natural language processing with their impressive reasoning and question-answering capabilities. However, these models are sometimes prone to generating credible-sounding but…

Computation and Language · Computer Science 2026-04-21 Ranganath Krishnan , Piyush Khanna , Omesh Tickoo

Applications of narrative theories using large language models (LLMs) deliver promising use-cases in automatic story generation and understanding tasks. Our survey examines how natural language processing (NLP) research engages with fields…

Computation and Language · Computer Science 2026-02-19 David Y. Liu , Aditya Joshi , Paul Dawson