Overview of the TREC 2025 RAGTIME Track

Dawn Lawrie; Sean MacAvaney; James Mayfield; Luca Soldaini; Eugene Yang; Andrew Yates

Overview of the TREC 2025 RAGTIME Track

Information Retrieval 2026-05-11 v2 Computation and Language

Authors: Dawn Lawrie , Sean MacAvaney , James Mayfield , Luca Soldaini , Eugene Yang , Andrew Yates

Abstract

The principal goal of the RAG TREC Instrument for Multilingual Evaluation (RAGTIME) track at TREC is to study report generation from multilingual source documents. The track has created a document collection containing Arabic, Chinese, English, and Russian news stories. RAGTIME includes three task types: Multilingual Report Generation, English Report Generation, and Multilingual Information Retrieval (MLIR). A total of 125 runs were submitted by 13 participating teams (and as baselines by the track coordinators) for three tasks. This overview describes these three tasks and presents the available results.

Keywords

RAG multilingual evaluation report generation information retrieval TREC

Cite

@article{arxiv.2602.10024,
  title  = {Overview of the TREC 2025 RAGTIME Track},
  author = {Dawn Lawrie and Sean MacAvaney and James Mayfield and Luca Soldaini and Eugene Yang and Andrew Yates},
  journal= {arXiv preprint arXiv:2602.10024},
  year   = {2026}
}

Comments

14 pages, 3 figures, final version of the RAGTIME 2025 overview paper

Overview of the TREC 2025 RAGTIME Track

Abstract

Keywords

Cite

Comments

Related papers