Gerbil: A Fast and Memory-Efficient $k$-mer Counter with GPU-Support
Abstract
A basic task in bioinformatics is the counting of -mers in genome strings. The -mer counting problem is to build a histogram of all substrings of length in a given genome sequence. We present the open source -mer counting software Gerbil that has been designed for the efficient counting of -mers for . Given the technology trend towards long reads of next-generation sequencers, support for large becomes increasingly important. While existing -mer counting tools suffer from excessive memory resource consumption or degrading performance for large , Gerbil is able to efficiently support large without much loss of performance. Our software implements a two-disk approach. In the first step, DNA reads are loaded from disk and distributed to temporary files that are stored at a working disk. In a second step, the temporary files are read again, split into -mers and counted via a hash table approach. In addition, Gerbil can optionally use GPUs to accelerate the counting step. For large , we outperform state-of-the-art open source -mer counting tools for large genome data sets.
Cite
@article{arxiv.1607.06618,
title = {Gerbil: A Fast and Memory-Efficient $k$-mer Counter with GPU-Support},
author = {Marius Erbert and Steffen Rechner and Matthias Müller-Hannemann},
journal= {arXiv preprint arXiv:1607.06618},
year = {2016}
}
Comments
A short version of this paper will appear in the proceedings of WABI 2016