Towards impactful challenges: post-challenge paper, benchmarks and other dissemination actions
Abstract
The conclusion of an AI challenge is not the end of its lifecycle; ensuring a long-lasting impact requires meticulous post-challenge activities. The long-lasting impact also needs to be organised. This chapter covers the various activities after the challenge is formally finished. This work identifies target audiences for post-challenge initiatives and outlines methods for collecting and organizing challenge outputs. The multiple outputs of the challenge are listed, along with the means to collect them. The central part of the chapter is a template for a typical post-challenge paper, including possible graphs and advice on how to turn the challenge into a long-lasting benchmark.
Keywords
Cite
@article{arxiv.2312.06036,
title = {Towards impactful challenges: post-challenge paper, benchmarks and other dissemination actions},
author = {Antoine Marot and David Rousseau and Zhen and Xu},
journal= {arXiv preprint arXiv:2312.06036},
year = {2025}
}
Comments
5th chapter of book "AI Competitions and Benchmarks: the science behind the contests" see: https://sites.google.com/chalearn.org/book/home