English

Lightweight Change Detection in Heterogeneous Remote Sensing Images with Online All-Integer Pruning Training

Computer Vision and Pattern Recognition 2024-05-06 v1

Abstract

Detection of changes in heterogeneous remote sensing images is vital, especially in response to emergencies like earthquakes and floods. Current homogenous transformation-based change detection (CD) methods often suffer from high computation and memory costs, which are not friendly to edge-computation devices like onboard CD devices at satellites. To address this issue, this paper proposes a new lightweight CD method for heterogeneous remote sensing images that employs the online all-integer pruning (OAIP) training strategy to efficiently fine-tune the CD network using the current test data. The proposed CD network consists of two visual geometry group (VGG) subnetworks as the backbone architecture. In the OAIP-based training process, all the weights, gradients, and intermediate data are quantized to integers to speed up training and reduce memory usage, where the per-layer block exponentiation scaling scheme is utilized to reduce the computation errors of network parameters caused by quantization. Second, an adaptive filter-level pruning method based on the L1-norm criterion is employed to further lighten the fine-tuning process of the CD network. Experimental results show that the proposed OAIP-based method attains similar detection performance (but with significantly reduced computation complexity and memory usage) in comparison with state-of-the-art CD methods.

Keywords

Cite

@article{arxiv.2405.01920,
  title  = {Lightweight Change Detection in Heterogeneous Remote Sensing Images with Online All-Integer Pruning Training},
  author = {Chengyang Zhang and Weiming Li and Gang Li and Huina Song and Zhaohui Song and Xueqian Wang and Antonio Plaza},
  journal= {arXiv preprint arXiv:2405.01920},
  year   = {2024}
}
R2 v1 2026-06-28T16:15:14.764Z