English

A unified foundational framework for knowledge injection and evaluation of Large Language Models in Combustion Science

Computation and Language 2026-03-06 v1 Artificial Intelligence

Abstract

To advance foundation Large Language Models (LLMs) for combustion science, this study presents the first end-to-end framework for developing domain-specialized models for the combustion community. The framework comprises an AI-ready multimodal knowledge base at the 3.5 billion-token scale, extracted from over 200,000 peer-reviewed articles, 8,000 theses and dissertations, and approximately 400,000 lines of combustion CFD code; a rigorous and largely automated evaluation benchmark (CombustionQA, 436 questions across eight subfields); and a three-stage knowledge-injection pathway that progresses from lightweight retrieval-augmented generation (RAG) to knowledge-graph-enhanced retrieval and continued pretraining. We first quantitatively validate Stage 1 (naive RAG) and find a hard ceiling: standard RAG accuracy peaks at 60%, far surpassing zero-shot performance (23%) yet well below the theoretical upper bound (87%). We further demonstrate that this stage's performance is severely constrained by context contamination. Consequently, building a domain foundation model requires structured knowledge graphs and continued pretraining (Stages 2 and 3).

Keywords

Cite

@article{arxiv.2603.04452,
  title  = {A unified foundational framework for knowledge injection and evaluation of Large Language Models in Combustion Science},
  author = {Zonglin Yang and Runze Mao and Tianhao Wu and Han Li and QingGuo Zhou and Zhi X. Chen},
  journal= {arXiv preprint arXiv:2603.04452},
  year   = {2026}
}

Comments

5 figures, 1 table