English

A Robust Multi-Scale Framework with Test-Time Adaptation for sEEG-Based Speech Decoding

Human-Computer Interaction 2025-09-30 v1

Abstract

Decoding speech from stereo-electroencephalography (sEEG) signals has emerged as a promising direction for brain-computer interfaces (BCIs). Its clinical applicability, however, is limited by the inherent non-stationarity of neural signals, which causes domain shifts between training and testing, undermining decoding reliability. To address this challenge, a two-stage framework is proposed for enhanced robustness. First, a multi-scale decomposable mixing (MDM) module is introduced to model the hierarchical temporal dynamics of speech production, learning stable multi-timescale representations from sEEG signals. Second, a source-free online test-time adaptation (TTA) method performs entropy minimization to adapt the model to distribution shifts during inference. Evaluations on the public DU-IN spoken word decoding benchmark show that the approach outperforms state-of-the-art models, particularly in challenging cases. This study demonstrates that combining invariant feature learning with online adaptation is a principled strategy for developing reliable BCI systems. Our code is available at https://github.com/lyyi599/MDM-TENT.

Keywords

Cite

@article{arxiv.2509.24700,
  title  = {A Robust Multi-Scale Framework with Test-Time Adaptation for sEEG-Based Speech Decoding},
  author = {Suli Wang and Yang-yang Li and Siqi Cai and Haizhou Li},
  journal= {arXiv preprint arXiv:2509.24700},
  year   = {2025}
}
R2 v1 2026-07-01T06:04:24.282Z