English
Related papers

Related papers: Do Large Language Models Get Caught in Hofstadter-…

200 papers

We identify a previously unknown calibration property of large language models: providing one confirmed intermediate fact toward a multi-step reasoning chain increases the model's confident-wrong-answer rate before full evidence eliminates…

Computation and Language · Computer Science 2026-04-30 Ashish Balkishan Lathkar

Safety benchmark scores provide incomplete evidence of deployment readiness: aligned language models often adhere to rigid rules even when a situational update flips which action is safe. We term this failure brittle safety. To diagnose it,…

Artificial Intelligence · Computer Science 2026-05-28 Dasol Choi , Alex Kwon

Language models influence the external world: they query APIs that read and write to web pages, generate content that shapes human behavior, and run system commands as autonomous agents. These interactions form feedback loops: LLM outputs…

Machine Learning · Computer Science 2024-06-10 Alexander Pan , Erik Jones , Meena Jagadeesan , Jacob Steinhardt

Recursive language-model loops often settle into recognizable attractor-like patterns. The practical question is how much injected text is needed to move a settled loop somewhere else, and whether that move lasts. We study this in 30-step…

Artificial Intelligence · Computer Science 2026-05-06 Pawel Kaplanski

Large language models often produce unsupported claims. We frame this as a misclassification error at the output boundary, where internally generated completions are emitted as if they were grounded in evidence. This motivates a composite…

Computation and Language · Computer Science 2026-04-09 Angelina Hintsanen

Large language models can follow complex procedures yet fail at a seemingly trivial final step: reporting a value they themselves computed moments earlier. We study this phenomenon as \emph{procedural hallucination}: failure to execute a…

Machine Learning · Statistics 2026-02-24 Ahmed Karim , Fatima Sheaib , Zein Khamis , Maggie Chlon , Jad Awada , Leon Chlon

Hallucinations pose a critical challenge to the real-world deployment of large language models (LLMs) in high-stakes domains. In this paper, we present a framework for stress testing factual fidelity in LLMs in the presence of adversarial…

Computation and Language · Computer Science 2025-11-13 Arka Dutta , Sujan Dutta , Rijul Magu , Soumyajit Datta , Munmun De Choudhury , Ashiqur R. KhudaBukhsh

Large language model (LLM)-driven AI systems may exhibit an inference failure mode we term `neural howlround,' a self-reinforcing cognitive loop where certain highly weighted inputs become dominant, leading to entrenched response patterns…

Computation and Language · Computer Science 2025-04-14 Seth Drake

Large vision-language models can produce object hallucinations in image descriptions, highlighting the need for effective detection and mitigation strategies. Prior work commonly relies on the model's attention weights on visual tokens as a…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 Reihaneh Zohrabi , Hosein Hasani , Akshita Gupta , Mahdieh Soleymani Baghshah , Anna Rohrbach , Marcus Rohrbach

As large language models (LLMs) increasingly mediate both content generation and moderation, linguistic evasion strategies known as Algospeak have intensified the coevolution between evaders and detectors. This research formalizes the…

Computation and Language · Computer Science 2026-05-08 Jan Fillies , Ronald E. Robertson , Jeffrey Hancock

Large Language Models (LLMs) have shown impressive capabilities but still suffer from the issue of hallucinations. A significant type of this issue is the false premise hallucination, which we define as the phenomenon when LLMs generate…

Computation and Language · Computer Science 2024-03-01 Hongbang Yuan , Pengfei Cao , Zhuoran Jin , Yubo Chen , Daojian Zeng , Kang Liu , Jun Zhao

Large language models often fail to satisfy formatting instructions when they must simultaneously perform demanding tasks. We study this behaviour through a prospective memory inspired lens from cognitive psychology, using a controlled…

Computation and Language · Computer Science 2026-03-26 Avni Mittal

Persistent language-model agents increasingly combine tool use, tiered memory, reflective prompting, and runtime adaptation. In such systems, behavior is shaped not only by current prompts but by mutable internal conditions that influence…

Artificial Intelligence · Computer Science 2026-05-13 Krti Tallam

As synthetic data becomes increasingly prevalent in training language models, particularly through generated dialogue, concerns have emerged that these models may deviate from authentic human language patterns, potentially losing the…

Computation and Language · Computer Science 2024-09-25 Xufeng Duan , Bei Xiao , Xuemei Tang , Zhenguang G. Cai

Large language models have demonstrated remarkable proficiency in long and complex reasoning tasks. However, they frequently exhibit a problematic reliance on familiar reasoning patterns, a phenomenon we term \textit{reasoning rigidity}.…

Artificial Intelligence · Computer Science 2025-05-26 Doohyuk Jang , Yoonjeon Kim , Chanjae Park , Hyun Ryu , Eunho Yang

Large language models (LLMs) have exploded in popularity in the past few years and have achieved undeniably impressive results on benchmarks as varied as question answering and text summarization. We provide a simple new prompting strategy…

Computation and Language · Computer Science 2022-12-14 Joshua Albrecht , Ellie Kitanidis , Abraham J. Fetterman

Large Language Models (LLMs) have revolutionized conversational AI, yet their robustness in extended multi-turn dialogues remains poorly understood. Existing evaluation frameworks focus on static benchmarks and single-turn assessments,…

Computation and Language · Computer Science 2026-02-05 Yubo Li , Ramayya Krishnan , Rema Padman

In modern LLMs, linguistic features function not as stylistic artifacts but as probes of probability mass, allocated under training alignment objectives. Language models trained with contemporary pipelines exhibit severe reshaping of…

Computation and Language · Computer Science 2026-05-29 Rohan Mahapatra

Reinforcement Learning from Human Feedback (RLHF) assumes annotator preferences reflect stable internal states. We challenge this through three experiments spanning the preference pipeline. In a human choice blindness study, 91% of…

Computation and Language · Computer Science 2026-03-10 Wenbin Wu

People increasingly use large language models (LLMs) for everyday moral and interpersonal guidance, yet these systems cannot interrogate missing context and judge dilemmas as presented. We introduce a perturbation framework for testing the…

Computation and Language · Computer Science 2026-03-09 Tom van Nuenen , Pratik S. Sachdeva