English

Combining Counting Processes and Classification Improves a Stopping Rule for Technology Assisted Review

Information Retrieval 2023-12-07 v1 Computation and Language

Abstract

Technology Assisted Review (TAR) stopping rules aim to reduce the cost of manually assessing documents for relevance by minimising the number of documents that need to be examined to ensure a desired level of recall. This paper extends an effective stopping rule using information derived from a text classifier that can be trained without the need for any additional annotation. Experiments on multiple data sets (CLEF e-Health, TREC Total Recall, TREC Legal and RCV1) showed that the proposed approach consistently improves performance and outperforms several alternative methods.

Keywords

Cite

@article{arxiv.2312.03171,
  title  = {Combining Counting Processes and Classification Improves a Stopping Rule for Technology Assisted Review},
  author = {Reem Bin-Hezam and Mark Stevenson},
  journal= {arXiv preprint arXiv:2312.03171},
  year   = {2023}
}

Comments

Accepted at EMNLP 2023 Findings

R2 v1 2026-06-28T13:42:19.712Z