English

MASNet:Improve Performance of Siamese Networks with Mutual-attention for Remote Sensing Change Detection Tasks

Computer Vision and Pattern Recognition 2022-06-07 v1 Artificial Intelligence

Abstract

Siamese networks are widely used for remote sensing change detection tasks. A vanilla siamese network has two identical feature extraction branches which share weights, these two branches work independently and the feature maps are not fused until about to be sent to a decoder head. However we find that it is critical to exchange information between two feature extraction branches at early stage for change detection task. In this work we present Mutual-Attention Siamese Network (MASNet), a general siamese network with mutual-attention plug-in, so to exchange information between the two feature extraction branches. We show that our modification improve the performance of siamese networks on multi change detection datasets, and it works for both convolutional neural network and visual transformer.

Keywords

Cite

@article{arxiv.2206.02331,
  title  = {MASNet:Improve Performance of Siamese Networks with Mutual-attention for Remote Sensing Change Detection Tasks},
  author = {Hongbin Zhou and Yupeng Ren and Qiankun Li and Jun Yin and Yonggang Lin},
  journal= {arXiv preprint arXiv:2206.02331},
  year   = {2022}
}

Comments

XXIV ISPRS Congress