The Objective Decides: When a Learned Dynamics Model Uses a Conserved Quantity
摘要
A linear probe that recovers a conserved quantity from a learned dynamics model's activations is routinely read as evidence that the model uses that quantity. We show this inference is unsound. Across mechanical, circuit, and partial-differential-equation (PDE) systems, and on a 158M-parameter pretrained PDE foundation model, energy and other invariants are linearly decodable at yet causally inert on next-state prediction: overwriting the decoded direction with a donor state's value (single-step activation interchange) leaves the forward pass essentially unchanged (transfer-corr ). The same direction in the same representation becomes causally load-bearing () the moment the training objective rewards the invariant, so deployment is a property of the objective, not of the representation or the probe. We further show that when an invariant is deployed is governed by a precise algebraic predicate (its relation to the prediction output), by flipping a single invariant from inert to load-bearing by changing only the output's algebra. Finally, the gap has teeth: across models that all decode the target at , the deployment gap forecasts out-of-distribution (OOD) accuracy () where decodability is blind. We argue that causal deployment, not decodability, is what interpretability should measure when the question is whether a model uses a piece of knowledge, and we give a cheap instrument for measuring it.
引用
@article{arxiv.2607.03728,
title = {The Objective Decides: When a Learned Dynamics Model Uses a Conserved Quantity},
author = {Chih-Ting Liao and Xin Cao},
journal= {arXiv preprint arXiv:2607.03728},
year = {2026}
}