English

MAIS: Memory-Attention for Interactive Segmentation

Computer Vision and Pattern Recognition 2025-05-13 v1 Artificial Intelligence Machine Learning

Abstract

Interactive medical segmentation reduces annotation effort by refining predictions through user feedback. Vision Transformer (ViT)-based models, such as the Segment Anything Model (SAM), achieve state-of-the-art performance using user clicks and prior masks as prompts. However, existing methods treat interactions as independent events, leading to redundant corrections and limited refinement gains. We address this by introducing MAIS, a Memory-Attention mechanism for Interactive Segmentation that stores past user inputs and segmentation states, enabling temporal context integration. Our approach enhances ViT-based segmentation across diverse imaging modalities, achieving more efficient and accurate refinements.

Keywords

Cite

@article{arxiv.2505.07511,
  title  = {MAIS: Memory-Attention for Interactive Segmentation},
  author = {Mauricio Orbes-Arteaga and Oeslle Lucena and Sabastien Ourselin and M. Jorge Cardoso},
  journal= {arXiv preprint arXiv:2505.07511},
  year   = {2025}
}
R2 v1 2026-06-28T23:29:30.230Z