English

fplyr: the split-apply-combine strategy for big data in R

Computation 2020-06-23 v2

Abstract

We present fplyr, a new package for the R language to deal with big files. It allows users to easily implement the split-apply-combine strategy for files that are too big to fit into the available memory, without relying on data bases nor introducing non-native R classes. A custom function can be applied independently to each group of observations, and the results may be either returned or directly printed to one or more output files.

Keywords

Cite

@article{arxiv.2005.04711,
  title  = {fplyr: the split-apply-combine strategy for big data in R},
  author = {Federico Marotta},
  journal= {arXiv preprint arXiv:2005.04711},
  year   = {2020}
}

Comments

6 pages, 1 figure

R2 v1 2026-06-23T15:26:16.123Z