Long-range dependencies modeling, widely used in capturing spatiotemporal correlation, has shown to be effective in CNN dominated computer vision tasks. Yet neither stacks of convolutional operations to enlarge receptive fields nor recent nonlocal modules is computationally efficient. In this paper, we present a generic family of lightweight global descriptors for modeling the interactions between positions across different dimensions (e.g., channels, frames). This descriptor enables subsequent convolutions to access the informative global features with negligible computational complexity and parameters. Benchmark experiments show that the proposed method can complete state-of-the-art long-range mechanisms with a significant reduction in extra computing cost. Code available at https://github.com/HolmesShuan/Compact-Global-Descriptor.
@article{arxiv.1907.09665,
title = {Compact Global Descriptor for Neural Networks},
author = {Xiangyu He and Ke Cheng and Qiang Chen and Qinghao Hu and Peisong Wang and Jian Cheng},
journal= {arXiv preprint arXiv:1907.09665},
year = {2020}
}
Comments
This paper will be included in our future works as a subsection