English

Towards Robust Drone Vision in the Wild

Computer Vision and Pattern Recognition 2022-08-29 v1

Abstract

The past few years have witnessed the burst of drone-based applications where computer vision plays an essential role. However, most public drone-based vision datasets focus on detection and tracking. On the other hand, the performance of most existing image super-resolution methods is sensitive to the dataset, specifically, the degradation model between high-resolution and low-resolution images. In this thesis, we propose the first image super-resolution dataset for drone vision. Image pairs are captured by two cameras on the drone with different focal lengths. We collect data at different altitudes and then propose pre-processing steps to align image pairs. Extensive empirical studies show domain gaps exist among images captured at different altitudes. Meanwhile, the performance of pretrained image super-resolution networks also suffers a drop on our dataset and varies among altitudes. Finally, we propose two methods to build a robust image super-resolution network at different altitudes. The first feeds altitude information into the network through altitude-aware layers. The second uses one-shot learning to quickly adapt the super-resolution model to unknown altitudes. Our results reveal that the proposed methods can efficiently improve the performance of super-resolution networks at varying altitudes.

Keywords

Cite

@article{arxiv.2208.12655,
  title  = {Towards Robust Drone Vision in the Wild},
  author = {Xiaoyu Lin},
  journal= {arXiv preprint arXiv:2208.12655},
  year   = {2022}
}

Comments

Master's thesis

R2 v1 2026-06-25T02:00:20.923Z