This paper presents the third edition of the LongEval Lab, part of the CLEF 2025 conference, which continues to explore the challenges of temporal persistence in Information Retrieval (IR). The lab features two tasks designed to provide researchers with test data that reflect the evolving nature of user queries and document relevance over time. By evaluating how model performance degrades as test data diverge temporally from training data, LongEval seeks to advance the understanding of temporal dynamics in IR systems. The 2025 edition aims to engage the IR and NLP communities in addressing the development of adaptive models that can maintain retrieval quality over time in the domains of web search and scientific retrieval.
@article{arxiv.2503.08541,
title = {LongEval at CLEF 2025: Longitudinal Evaluation of IR Model Performance},
author = {Matteo Cancellieri and Alaa El-Ebshihy and Tobias Fink and Petra Galuščáková and Gabriela Gonzalez-Saez and Lorraine Goeuriot and David Iommi and Jüri Keller and Petr Knoth and Philippe Mulhem and Florina Piroi and David Pride and Philipp Schaer},
journal= {arXiv preprint arXiv:2503.08541},
year = {2025}
}
Comments
Accepted for ECIR 2025. To be published in Advances in Information Retrieval - 47th European Conference on Information Retrieval, ECIR 2025, Lucca, Italy, April 6-10, 2025, Proceedings