English

Knowledge Distillation for Feature Extraction in Underwater VSLAM

Computer Vision and Pattern Recognition 2024-02-05 v1

Abstract

In recent years, learning-based feature detection and matching have outperformed manually-designed methods in in-air cases. However, it is challenging to learn the features in the underwater scenario due to the absence of annotated underwater datasets. This paper proposes a cross-modal knowledge distillation framework for training an underwater feature detection and matching network (UFEN). In particular, we use in-air RGBD data to generate synthetic underwater images based on a physical underwater imaging formation model and employ these as the medium to distil knowledge from a teacher model SuperPoint pretrained on in-air images. We embed UFEN into the ORB-SLAM3 framework to replace the ORB feature by introducing an additional binarization layer. To test the effectiveness of our method, we built a new underwater dataset with groundtruth measurements named EASI (https://github.com/Jinghe-mel/UFEN-SLAM), recorded in an indoor water tank for different turbidity levels. The experimental results on the existing dataset and our new dataset demonstrate the effectiveness of our method.

Keywords

Cite

@article{arxiv.2303.17981,
  title  = {Knowledge Distillation for Feature Extraction in Underwater VSLAM},
  author = {Jinghe Yang and Mingming Gong and Girish Nair and Jung Hoon Lee and Jason Monty and Ye Pu},
  journal= {arXiv preprint arXiv:2303.17981},
  year   = {2024}
}

Comments

Accepted by IEEE International Conference on Robotics and Automation (ICRA 2023),6 pages

R2 v1 2026-06-28T09:42:56.440Z