English

Fine-Tuning Language Models to Know What They Know

Neural and Evolutionary Computing 2026-05-26 v2 Artificial Intelligence Computation and Language Neurons and Cognition

Abstract

Evaluating true metacognition in Large Language Models (LLMs) is difficult due to biases and heuristics. This paper presents a framework to measure and enhance LLM metacognition while controlling for these biases. A measurement method using the dtype2d'_{\rm type2} metric is established to isolate metacognitive ability. The Evolution Strategy for Metacognitive Alignment (ESMA) is proposed, demonstrating robust generalization across unseen datasets, languages, and newly acquired knowledge. Finally, parameter analysis reveals that these improvements are driven by a sparse set of parameters, offering new pathways for targeted metacognitive optimization.

Keywords

Cite

@article{arxiv.2602.02605,
  title  = {Fine-Tuning Language Models to Know What They Know},
  author = {Sangjun Park and Elliot Meyerson and Xin Qiu and Risto Miikkulainen},
  journal= {arXiv preprint arXiv:2602.02605},
  year   = {2026}
}

Comments

Preprint

R2 v1 2026-07-01T09:32:43.924Z