English

NewsEdits: A Dataset of Revision Histories for News Articles (Technical Report: Data Processing)

Computation and Language 2022-07-01 v2 Digital Libraries

Abstract

News article revision histories have the potential to give us novel insights across varied fields of linguistics and social sciences. In this work, we present, to our knowledge, the first publicly available dataset of news article revision histories, or NewsEdits. Our dataset is multilingual; it contains 1,278,804 articles with 4,609,430 versions from over 22 English- and French-language newspaper sources based in three countries. Across version pairs, we count 10.9 million added sentences; 8.9 million changed sentences and 6.8 million removed sentences. Within the changed sentences, we derive 72 million atomic edits. NewsEdits is, to our knowledge, the largest corpus of revision histories of any domain.

Keywords

Cite

@article{arxiv.2104.09647,
  title  = {NewsEdits: A Dataset of Revision Histories for News Articles (Technical Report: Data Processing)},
  author = {Alexander Spangher and Jonathan May},
  journal= {arXiv preprint arXiv:2104.09647},
  year   = {2022}
}

Comments

11 pages