Report on the 1st Workshop on Large Language Model for Evaluation in Information Retrieval (LLM4Eval 2024) at SIGIR 2024

Hossein A. Rahmani; Clemencia Siro; Mohammad Aliannejadi; Nick Craswell; Charles L. A. Clarke; Guglielmo Faggioli; Bhaskar Mitra; Paul Thomas; Emine Yilmaz

Report on the 1st Workshop on Large Language Model for Evaluation in Information Retrieval (LLM4Eval 2024) at SIGIR 2024

Information Retrieval 2024-08-13 v1

Authors: Hossein A. Rahmani , Clemencia Siro , Mohammad Aliannejadi , Nick Craswell , Charles L. A. Clarke , Guglielmo Faggioli , Bhaskar Mitra , Paul Thomas , Emine Yilmaz

View on arXiv ↗ PDF ↗

Abstract

The first edition of the workshop on Large Language Model for Evaluation in Information Retrieval (LLM4Eval 2024) took place in July 2024, co-located with the ACM SIGIR Conference 2024 in the USA (SIGIR 2024). The aim was to bring information retrieval researchers together around the topic of LLMs for evaluation in information retrieval that gathered attention with the advancement of large language models and generative AI. Given the novelty of the topic, the workshop was focused around multi-sided discussions, namely panels and poster sessions of the accepted proceedings papers.

Keywords

Large Language Model Information Retrieval evaluation workshop SIGIR

Cite

@article{arxiv.2408.05388,
  title  = {Report on the 1st Workshop on Large Language Model for Evaluation in Information Retrieval (LLM4Eval 2024) at SIGIR 2024},
  author = {Hossein A. Rahmani and Clemencia Siro and Mohammad Aliannejadi and Nick Craswell and Charles L. A. Clarke and Guglielmo Faggioli and Bhaskar Mitra and Paul Thomas and Emine Yilmaz},
  journal= {arXiv preprint arXiv:2408.05388},
  year   = {2024}
}

Comments

LLM4Eval Workshop Report

Report on the 1st Workshop on Large Language Model for Evaluation in Information Retrieval (LLM4Eval 2024) at SIGIR 2024

Abstract

Keywords

Cite

Comments

Related papers