English

Breaking the Resource Wall: Geometry-Guided Sequence Modeling for Efficient Semantic Segmentation

Computer Vision and Pattern Recognition 2026-05-05 v2

Abstract

High-performance semantic segmentation has achieved significant progress in recent years, often driven by increasingly large backbones and higher computational budgets. While effective, such approaches introduce substantial computational overhead and limit accessibility under constrained hardware settings. In this paper, we propose DGM-Net (Directional Geometric Mamba Network), an efficient architecture that improves modeling capability through structural design rather than increasing model capacity. We introduce Directional Geometric Mamba (G-Mamba), a linear-complexity O(N) operator as an alternative to conventional context modeling modules such as ASPP and PPM. To further enhance structural awareness in state space model (SSM)-based modeling, we design the DGM-Module, which extracts centripetal flow fields and topological skeletons to guide the scanning process and improve boundary preservation. Without relying on large-scale pretraining or heavy backbone scaling, DGM-Net achieves 80.8% mIoU within 28k iterations, 82.3% mIoU on Cityscapes test set, and 45.24% mIoU on ADE20K. In addition, the model maintains stable performance under constrained hardware settings (e.g., batch size of 2 on 8GB VRAM), highlighting its efficiency and practicality. These results demonstrate that incorporating geometric guidance into SSM-based architectures provides an effective and resource-efficient direction for semantic segmentation.

Keywords

Cite

@article{arxiv.2604.23399,
  title  = {Breaking the Resource Wall: Geometry-Guided Sequence Modeling for Efficient Semantic Segmentation},
  author = {Sheng-Wei Chan and Hsin-Jui Pan and Chun-Po Shen and Chia-Min Lin and Yung-Che Wang and Jen-Shiun Chiang},
  journal= {arXiv preprint arXiv:2604.23399},
  year   = {2026}
}

Comments

15 pages, 8 figures. Code will be released at: https://github.com/henrychan0719/DGM-Net

R2 v1 2026-07-01T12:35:16.996Z