English

Prism: Policy Reuse via Interpretable Strategy Mapping in Reinforcement Learning

Machine Learning 2026-04-06 v1 Artificial Intelligence

Abstract

We present PRISM (Policy Reuse via Interpretable Strategy Mapping), a framework that grounds reinforcement learning agents' decisions in discrete, causally validated concepts and uses those concepts as a zero-shot transfer interface between agents trained with different algorithms. PRISM clusters each agent's encoder features into KK concepts via K-means. Causal intervention establishes that these concepts directly drive - not merely correlate with - agent behavior: overriding concept assignments changes the selected action in 69.4% of interventions (p=8.6×1086p = 8.6 \times 10^{-86}, 2500 interventions). Concept importance and usage frequency are dissociated: the most-used concept (C47, 33.0% frequency) causes only a 9.4% win-rate drop when ablated, while ablating C16 (15.4% frequency) collapses win rate from 100% to 51.8%. Because concepts causally encode strategy, aligning them via optimal bipartite matching transfers strategic knowledge zero-shot. On Go~7×\times7 with three independently trained agents, concept transfer achieves 69.5%±\pm3.2% and 76.4%±\pm3.4% win rate against a standard engine across the two successful transfer pairs (10 seeds), compared to 3.5% for a random agent and 9.2% without alignment. Transfer succeeds when the source policy is strong; geometric alignment quality predicts nothing (R20R^2 \approx 0). The framework is scoped to domains where strategic state is naturally discrete: the identical pipeline on Atari Breakout yields bottleneck policies at random-agent performance, confirming that the Go results reflect a structural property of the domain.

Keywords

Cite

@article{arxiv.2604.02353,
  title  = {Prism: Policy Reuse via Interpretable Strategy Mapping in Reinforcement Learning},
  author = {Thomas Pravetz},
  journal= {arXiv preprint arXiv:2604.02353},
  year   = {2026}
}

Comments

13 pages, 3 figures, 5 tables

R2 v1 2026-07-01T11:51:40.275Z