English

SIMON: Saliency-aware Integrative Multi-view Object-centric Neural Decoding

Computer Vision and Pattern Recognition 2026-05-04 v1 Neurons and Cognition

Abstract

Recent EEG-to-image retrieval methods leverage pretrained vision encoders and foveation-inspired priors, but typically assume a fixed, center-focused view. This center bias conflicts with content-driven human attention, creating a geometric-semantic dissociation between visual features and EEG responses. We propose SIMON, a saliency-aware multi-view framework for zero-shot EEG-to-image retrieval. SIMON combines foreground segmentation and saliency prediction to select fixation centers via Saliency-Aware Sampling (SAS), then generates foveated views that emphasize informative object regions while suppressing background clutter. On THINGS-EEG, SIMON achieves state-of-the-art performance in both intra-subject and inter-subject settings, reaching an average Top-1 accuracy of 69.7% and 19.6%, respectively, consistently outperforming recent competitive baselines. Analyses across sampling granularity, EEG channel topology, and visual/brain encoder backbones further support the robustness of saliency-aware multi-view integration. Our code and models are publicly available at https://github.com/simonlink666/SIMON.

Keywords

Cite

@article{arxiv.2605.00401,
  title  = {SIMON: Saliency-aware Integrative Multi-view Object-centric Neural Decoding},
  author = {YuSheng Lin and Ji-Hwa Tsai and Chun-Shu Wei},
  journal= {arXiv preprint arXiv:2605.00401},
  year   = {2026}
}
R2 v1 2026-07-01T12:44:47.712Z