English

E^2VTS: Energy-Efficient Video Text Spotting from Unmanned Aerial Vehicles

Computer Vision and Pattern Recognition 2022-06-07 v1

Abstract

Unmanned Aerial Vehicles (UAVs) based video text spotting has been extensively used in civil and military domains. UAV's limited battery capacity motivates us to develop an energy-efficient video text spotting solution. In this paper, we first revisit RCNN's crop & resize training strategy and empirically find that it outperforms aligned RoI sampling on a real-world video text dataset captured by UAV. To reduce energy consumption, we further propose a multi-stage image processor that takes videos' redundancy, continuity, and mixed degradation into account. Lastly, the model is pruned and quantized before deployed on Raspberry Pi. Our proposed energy-efficient video text spotting solution, dubbed as E^2VTS, outperforms all previous methods by achieving a competitive tradeoff between energy efficiency and performance. All our codes and pre-trained models are available at https://github.com/wuzhenyusjtu/LPCVC20-VideoTextSpotting.

Keywords

Cite

@article{arxiv.2206.02281,
  title  = {E^2VTS: Energy-Efficient Video Text Spotting from Unmanned Aerial Vehicles},
  author = {Zhenyu Hu and Zhenyu Wu and Pengcheng Pi and Yunhe Xue and Jiayi Shen and Jianchao Tan and Xiangru Lian and Zhangyang Wang and Ji Liu},
  journal= {arXiv preprint arXiv:2206.02281},
  year   = {2022}
}