English

A novel hallucination classification framework

Computation and Language 2025-10-08 v1 Artificial Intelligence

Abstract

This work introduces a novel methodology for the automatic detection of hallucinations generated during large language model (LLM) inference. The proposed approach is based on a systematic taxonomy and controlled reproduction of diverse hallucination types through prompt engineering. A dedicated hallucination dataset is subsequently mapped into a vector space using an embedding model and analyzed with unsupervised learning techniques in a reduced-dimensional representation of hallucinations with veridical responses. Quantitative evaluation of inter-centroid distances reveals a consistent correlation between the severity of informational distortion in hallucinations and their spatial divergence from the cluster of correct outputs. These findings provide theoretical and empirical evidence that even simple classification algorithms can reliably distinguish hallucinations from accurate responses within a single LLM, thereby offering a lightweight yet effective framework for improving model reliability.

Keywords

Cite

@article{arxiv.2510.05189,
  title  = {A novel hallucination classification framework},
  author = {Maksym Zavhorodnii and Dmytro Dehtiarov and Anna Konovalenko},
  journal= {arXiv preprint arXiv:2510.05189},
  year   = {2025}
}

Comments

15 pages, 3 figures

R2 v1 2026-07-01T06:19:49.614Z