English

UQLM: A Python Package for Uncertainty Quantification in Large Language Models

Computation and Language 2026-03-05 v2 Artificial Intelligence Machine Learning

Abstract

Hallucinations, defined as instances where Large Language Models (LLMs) generate false or misleading content, pose a significant challenge that impacts the safety and trust of downstream applications. We introduce UQLM, a Python package for LLM hallucination detection using state-of-the-art uncertainty quantification (UQ) techniques. This toolkit offers a suite of UQ-based scorers that compute response-level confidence scores ranging from 0 to 1. This library provides an off-the-shelf solution for UQ-based hallucination detection that can be easily integrated to enhance the reliability of LLM outputs.

Keywords

Cite

@article{arxiv.2507.06196,
  title  = {UQLM: A Python Package for Uncertainty Quantification in Large Language Models},
  author = {Dylan Bouchard and Mohit Singh Chauhan and David Skarbrevik and Ho-Kyeong Ra and Viren Bajaj and Zeya Ahmad},
  journal= {arXiv preprint arXiv:2507.06196},
  year   = {2026}
}

Comments

Accepted by JMLR; UQLM Repository: https://github.com/cvs-health/uqlm

R2 v1 2026-07-01T03:52:02.779Z