English

Towards Sharing Task Environments to Support Reproducible Evaluations of Interactive Recommender Systems

Information Retrieval 2019-09-17 v2 Artificial Intelligence

Abstract

Beyond sharing datasets or simulations, we believe the Recommender Systems (RS) community should share Task Environments. In this work, we propose a high-level logical architecture that will help to reason about the core components of a RS Task Environment, identify the differences between Environments, datasets and simulations; and most importantly, understand what needs to be shared about Environments to achieve reproducible experiments. The work presents itself as valuable initial groundwork, open to discussion and extensions.

Keywords

Cite

@article{arxiv.1909.06133,
  title  = {Towards Sharing Task Environments to Support Reproducible Evaluations of Interactive Recommender Systems},
  author = {Andrea Barraza-Urbina and Mathieu d'Aquin},
  journal= {arXiv preprint arXiv:1909.06133},
  year   = {2019}
}

Comments

Included in the Offline Evaluation for Recommender Systems Workshop (REVEAL'19), collocated with ACM RecSys 2019. REVEAL'19, September 20th, 2019, Copenhagen, Denmark

R2 v1 2026-06-23T11:14:23.858Z