English

Poly-YOLO: higher speed, more precise detection and instance segmentation for YOLOv3

Computer Vision and Pattern Recognition 2020-06-01 v2 Machine Learning Image and Video Processing

Abstract

We present a new version of YOLO with better performance and extended with instance segmentation called Poly-YOLO. Poly-YOLO builds on the original ideas of YOLOv3 and removes two of its weaknesses: a large amount of rewritten labels and inefficient distribution of anchors. Poly-YOLO reduces the issues by aggregating features from a light SE-Darknet-53 backbone with a hypercolumn technique, using stairstep upsampling, and produces a single scale output with high resolution. In comparison with YOLOv3, Poly-YOLO has only 60% of its trainable parameters but improves mAP by a relative 40%. We also present Poly-YOLO lite with fewer parameters and a lower output resolution. It has the same precision as YOLOv3, but it is three times smaller and twice as fast, thus suitable for embedded devices. Finally, Poly-YOLO performs instance segmentation using bounding polygons. The network is trained to detect size-independent polygons defined on a polar grid. Vertices of each polygon are being predicted with their confidence, and therefore Poly-YOLO produces polygons with a varying number of vertices.

Keywords

Cite

@article{arxiv.2005.13243,
  title  = {Poly-YOLO: higher speed, more precise detection and instance segmentation for YOLOv3},
  author = {Petr Hurtik and Vojtech Molek and Jan Hula and Marek Vajgl and Pavel Vlasanek and Tomas Nejezchleba},
  journal= {arXiv preprint arXiv:2005.13243},
  year   = {2020}
}

Comments

18 pages, 15 figures, submitted to IEEE Transactions on Pattern Analysis and Machine Intelligence (under review), Source code is available at https://gitlab.com/irafm-ai/poly-yolo

R2 v1 2026-06-23T15:50:50.267Z