English

StoicLLM: Preference Optimization for Philosophical Alignment in Small Language Models

Computation and Language 2026-05-13 v1

Abstract

While large language models excel at factual adaptation, their ability to internalize nuanced philosophical frameworks under severe data constraints remains underexplored. We investigate this by specializing small LLMs on micro-datasets of foundational Stoic texts using preference optimization (ORPO, AlphaPO). Evaluated via a multi-model critic bank, our results show that just 300 high-fidelity examples can induce strong alignment with inward-facing Stoic virtues, closely approaching few-shot prompting while freeing the context window. Critically, however, all models, including few-shot baselines, exhibit a persistent failure on Stoicism's outward-facing cosmopolitan duties, pointing to a representational limitation of small models that micro-dataset adaptation alone cannot overcome.

Keywords

Cite

@article{arxiv.2605.11483,
  title  = {StoicLLM: Preference Optimization for Philosophical Alignment in Small Language Models},
  author = {Ishmam Khan and Sindhuja Thogarrati and Shuo Zhang},
  journal= {arXiv preprint arXiv:2605.11483},
  year   = {2026}
}