English

White-Box mHC: Electromagnetic Spectrum-Aware and Interpretable Stream Interactions for Hyperspectral Image Classification

Computer Vision and Pattern Recognition 2026-01-23 v1

Abstract

In hyperspectral image classification (HSIC), most deep learning models rely on opaque spectral-spatial feature mixing, limiting their interpretability and hindering understanding of internal decision mechanisms. We present physical spectrum-aware white-box mHC, named ES-mHC, a hyper-connection framework that explicitly models interactions among different electromagnetic spectrum groupings (residual stream in mHC) interactions using structured, directional matrices. By separating feature representation from interaction structure, ES-mHC promotes electromagnetic spectrum grouping specialization, reduces redundancy, and exposes internal information flow that can be directly visualized and spatially analyzed. Using hyperspectral image classification as a representative testbed, we demonstrate that the learned hyper-connection matrices exhibit coherent spatial patterns and asymmetric interaction behaviors, providing mechanistic insight into the model internal dynamics. Furthermore, we find that increasing the expansion rate accelerates the emergence of structured interaction patterns. These results suggest that ES-mHC transforms HSIC from a purely black-box prediction task into a structurally transparent, partially white-box learning process.

Keywords

Cite

@article{arxiv.2601.15757,
  title  = {White-Box mHC: Electromagnetic Spectrum-Aware and Interpretable Stream Interactions for Hyperspectral Image Classification},
  author = {Yimin Zhu and Lincoln Linlin Xu and Zhengsen Xu and Zack Dewis and Mabel Heffring and Saeid Taleghanidoozdoozan and Motasem Alkayid and Quinn Ledingham and Megan Greenwood},
  journal= {arXiv preprint arXiv:2601.15757},
  year   = {2026}
}
R2 v1 2026-07-01T09:15:26.712Z