English

QCD in Language Models: What do they really know about QCD?

High Energy Physics - Phenomenology 2025-12-03 v1 Data Analysis, Statistics and Probability

Abstract

This study presents an analysis of modern open-source large language models (LLMs) -- including Llama, Qwen, and Gemma -- to evaluate their encoded knowledge of Quantum Chromodynamics (QCD). Through reverse engineering of these models' representations, we uncover the naturally idiosyncratic patterns in how foundational QCD concepts are embedded within their parameter spaces. Our methodology combines targeted probing techniques and knowledge extraction protocols to assess the models' understanding of critical QCD principles like color confinement, asymptotic freedom, and the running coupling constant. This work provides a tool for utilizing LLMs as an assistant in physics research, while also highlighting current limitations in their representation of advanced quantum field theory concepts that future model development should address.

Keywords

Cite

@article{arxiv.2512.02072,
  title  = {QCD in Language Models: What do they really know about QCD?},
  author = {Antonin Sulc and Patrick L. S. Connor},
  journal= {arXiv preprint arXiv:2512.02072},
  year   = {2025}
}

Comments

6 pages, 4 figures, presented at EPS HEP 2025 by Patrick L.S. Connor as Oral Presentation

R2 v1 2026-07-01T08:04:26.256Z