English

F2PASeg: Feature Fusion for Pituitary Anatomy Segmentation in Endoscopic Surgery

Computer Vision and Pattern Recognition 2025-08-08 v1 Systems and Control Image and Video Processing Systems and Control

Abstract

Pituitary tumors often cause deformation or encapsulation of adjacent vital structures. Anatomical structure segmentation can provide surgeons with early warnings of regions that pose surgical risks, thereby enhancing the safety of pituitary surgery. However, pixel-level annotated video stream datasets for pituitary surgeries are extremely rare. To address this challenge, we introduce a new dataset for Pituitary Anatomy Segmentation (PAS). PAS comprises 7,845 time-coherent images extracted from 120 videos. To mitigate class imbalance, we apply data augmentation techniques that simulate the presence of surgical instruments in the training data. One major challenge in pituitary anatomy segmentation is the inconsistency in feature representation due to occlusions, camera motion, and surgical bleeding. By incorporating a Feature Fusion module, F2PASeg is proposed to refine anatomical structure segmentation by leveraging both high-resolution image features and deep semantic embeddings, enhancing robustness against intraoperative variations. Experimental results demonstrate that F2PASeg consistently segments critical anatomical structures in real time, providing a reliable solution for intraoperative pituitary surgery planning. Code: https://github.com/paulili08/F2PASeg.

Keywords

Cite

@article{arxiv.2508.05465,
  title  = {F2PASeg: Feature Fusion for Pituitary Anatomy Segmentation in Endoscopic Surgery},
  author = {Lumin Chen and Zhiying Wu and Tianye Lei and Xuexue Bai and Ming Feng and Yuxi Wang and Gaofeng Meng and Zhen Lei and Hongbin Liu},
  journal= {arXiv preprint arXiv:2508.05465},
  year   = {2025}
}