English

SwinVFTR: A Novel Volumetric Feature-learning Transformer for 3D OCT Fluid Segmentation

Image and Video Processing 2025-01-06 v3 Computer Vision and Pattern Recognition

Abstract

Accurately segmenting fluid in 3D optical coherence tomography (OCT) images is critical for detecting eye diseases but remains challenging. Traditional autoencoder-based methods struggle with resolution loss and information recovery. While transformer-based models improve segmentation, they arent optimized for 3D OCT volumes, which vary by vendor and extraction technique. To address this, we propose SwinVFTR, a transformer architecture for precise fluid segmentation in 3D OCT images. SwinVFTR employs channel-wise volumetric sampling and a shifted window transformer block to improve fluid localization. Moreover, a novel volumetric attention block enhances spatial and depth-wise attention. Trained using multi-class dice loss, SwinVFTR outperforms existing models on Spectralis, Cirrus, and Topcon OCT datasets, achieving mean dice scores of 0.72, 0.59, and 0.68, respectively, along with superior performance in mean intersection-over-union (IOU) and structural similarity (SSIM) metrics.

Keywords

Cite

@article{arxiv.2303.09233,
  title  = {SwinVFTR: A Novel Volumetric Feature-learning Transformer for 3D OCT Fluid Segmentation},
  author = {Khondker Fariha Hossain and Sharif Amit Kamran and Alireza Tavakkoli and George Bebis and Sal Baker},
  journal= {arXiv preprint arXiv:2303.09233},
  year   = {2025}
}

Comments

Accepted to IEEE International Symposium on Biomedical Imaging (ISBI 2025)

R2 v1 2026-06-28T09:20:01.837Z