Using multiple streams can improve the overall system performance by mitigating the data transfer overhead on heterogeneous systems. Currently, very few cases have been streamed to demonstrate the streaming performance impact and a systematic investigation of streaming necessity and how-to over a large number of test cases remains a gap. In this paper, we use a total of 56 benchmarks to build a statistical view of the data transfer overhead, and give an in-depth analysis of the impacting factors. Among the heterogeneous codes, we identify two types of non-streamable codes and three types of streamable codes, for which a streaming approach has been proposed. Our experimental results on the CPU-MIC platform show that, with multiple streams, we can improve the application performance by up 90%. Our work can serve as a generic flow of using multiple streams on heterogeneous platforms.
@article{arxiv.1608.03044,
title = {Streaming Applications on Heterogeneous Platforms},
author = {Zhaokui Li and Jianbin Fang and Tao Tang and Xuhao Chen and Canqun Yang},
journal= {arXiv preprint arXiv:1608.03044},
year = {2016}
}
Comments
Accepted in The 13th IFIP International Conference on Network and Parallel Computing (NPC'16). arXiv admin note: text overlap with arXiv:1603.08619