English

Deep CNN-based Speech Balloon Detection and Segmentation for Comic Books

Computer Vision and Pattern Recognition 2019-02-22 v1 Machine Learning Neurons and Cognition

Abstract

We develop a method for the automated detection and segmentation of speech balloons in comic books, including their carrier and tails. Our method is based on a deep convolutional neural network that was trained on annotated pages of the Graphic Narrative Corpus. More precisely, we are using a fully convolutional network approach inspired by the U-Net architecture, combined with a VGG-16 based encoder. The trained model delivers state-of-the-art performance with an F1-score of over 0.94. Qualitative results suggest that wiggly tails, curved corners, and even illusory contours do not pose a major problem. Furthermore, the model has learned to distinguish speech balloons from captions. We compare our model to earlier results and discuss some possible applications.

Keywords

Cite

@article{arxiv.1902.08137,
  title  = {Deep CNN-based Speech Balloon Detection and Segmentation for Comic Books},
  author = {David Dubray and Jochen Laubrock},
  journal= {arXiv preprint arXiv:1902.08137},
  year   = {2019}
}

Comments

10 pages, 5 figures, 2 tables

R2 v1 2026-06-23T07:47:22.058Z