English

PythonSaga: Redefining the Benchmark to Evaluate Code Generating LLMs

Computation and Language 2024-07-08 v4 Artificial Intelligence

Abstract

Driven by the surge in code generation using large language models (LLMs), numerous benchmarks have emerged to evaluate these LLMs capabilities. We conducted a large-scale human evaluation of HumanEval and MBPP, two popular benchmarks for Python code generation, analyzing their diversity and difficulty. Our findings unveil a critical bias towards a limited set of programming concepts, neglecting most of the other concepts entirely. Furthermore, we uncover a worrying prevalence of easy tasks, potentially inflating model performance estimations. To address these limitations, we propose a novel benchmark, PythonSaga, featuring 185 hand-crafted prompts on a balanced representation of 38 programming concepts across diverse difficulty levels. The robustness of our benchmark is demonstrated by the poor performance of existing Code-LLMs.

Keywords

Cite

@article{arxiv.2401.03855,
  title  = {PythonSaga: Redefining the Benchmark to Evaluate Code Generating LLMs},
  author = {Ankit Yadav and Himanshu Beniwal and Mayank Singh},
  journal= {arXiv preprint arXiv:2401.03855},
  year   = {2024}
}
R2 v1 2026-06-28T14:11:09.202Z