English

Distance-Misaligned Training in Graph Transformers and Adaptive Graph-Aware Control

Machine Learning 2026-04-27 v1 Artificial Intelligence

Abstract

Graph Transformers can mix information globally, but this flexibility also creates failure modes: some tasks require long-range communication while others are better served by local interaction. We study this through a synthetic node-classification benchmark on contextual stochastic block model graphs, where labels are generated by a controllable mixture of local and far-shell signals. We define distance-misaligned training as a mismatch between where label-relevant information lies and where the model allocates communication over graph distance. On this benchmark, we find three points. First, the preferred graph-distance bias changes systematically with task locality. Second, an oracle adaptive controller, given offline access to the task-side distance target, nearly matches the best fixed bias across regimes and strongly improves over a neutral baseline on mixed and local tasks. Third, a task-agnostic zero-gap controller is weaker, indicating that adaptation alone is not enough and that the control target matters. These results suggest that distance-resolved diagnosis is useful for understanding Graph Transformer failures and for designing graph-aware control.

Keywords

Cite

@article{arxiv.2604.22413,
  title  = {Distance-Misaligned Training in Graph Transformers and Adaptive Graph-Aware Control},
  author = {Qinhan Hou and Jing Tang},
  journal= {arXiv preprint arXiv:2604.22413},
  year   = {2026}
}

Comments

Accepted by Graph Signal Processing Workshop 2026 as an extended abstract

R2 v1 2026-07-01T12:33:38.504Z