中文

SABER: A Semantic-Aligned Brain Network Analysis Framework via Multi-scale Hypergraphs

机器学习 2026-07-02 v1 人工智能 多媒体

摘要

Effective brain disease diagnosis requires the synergy of brain connectivity patterns and high-level semantic knowledge. Existing methods, however, largely treat semantics from large language models (LLMs) as auxiliary features or supervision, limiting their direct role in decision-making and constraining classification stability and robustness. To overcome this, we propose a semantic-aligned brain network framework that actively integrates LLM-derived semantics into the prediction process. Specifically, ROI-level semantics are first incorporated via global self-attention to enrich node representations and provide whole-brain context. Multi-scale hypergraphs are then constructed to explicitly model functional subnetworks and multi-ROI interactions, addressing the locality limitations of traditional GNNs and capturing high-order dependencies. Finally, a decision-level semantic alignment mechanism selectively injects patient-specific textual embeddings into graph representations, enabling semantics to directly guide predictions without perturbing the underlying network structure. Experiments on public brain network datasets ABIDE and ADHD-200 demonstrate state-of-the-art performance, enhanced stability, and improved interpretability, particularly in small-sample settings.

引用

@article{arxiv.2607.01901,
  title  = {SABER: A Semantic-Aligned Brain Network Analysis Framework via Multi-scale Hypergraphs},
  author = {Yidan Xu and Xiangmin Han and Rundong Xue and Huihui Ye},
  journal= {arXiv preprint arXiv:2607.01901},
  year   = {2026}
}

备注

Accepted to IEEE International Conference on Multimedia and Expo (ICME) 2026;