English

Fairness is Not Flat: Geometric Phase Transitions Against Shortcut Learning

Machine Learning 2026-04-14 v1 Artificial Intelligence

Abstract

Deep Neural Networks are highly susceptible to shortcut learning, frequently memorizing low-dimensional spurious correlations instead of underlying causal mechanisms. This phenomenon not only degrades out-of-distribution robustness but also induces severe demographic biases in sensitive applications. In this paper, we propose a geometric \textit{a priori} methodology to mitigate shortcut learning. By deploying a zero-hidden-layer (N=1N=1) Topological Auditor, we mathematically isolate features that monopolize the gradient without human intervention. We empirically demonstrate a Capacity Phase Transition: once linear shortcuts are pruned, networks are forced to utilize higher geometric capacity (N16N \geq 16) to curve the decision boundary and learn ethical representations. Our approach outperforms L1 Regularization -- which collapses into demographic bias -- and operates at a fraction of the computational cost of post-hoc methods like Just Train Twice (JTT), successfully reducing counterfactual gender vulnerability from 21.18\% to 7.66\%.

Keywords

Cite

@article{arxiv.2604.11704,
  title  = {Fairness is Not Flat: Geometric Phase Transitions Against Shortcut Learning},
  author = {Nicolas Rodriguez-Alvarez and Fernando Rodriguez-Merino},
  journal= {arXiv preprint arXiv:2604.11704},
  year   = {2026}
}
R2 v1 2026-07-01T12:06:53.042Z