English
Related papers

Related papers: Cer-Eval: Certifiable and Cost-Efficient Evaluatio…

200 papers

Evaluating large language models (LLMs) has become increasingly challenging as model capabilities advance rapidly. While recent models often achieve higher scores on standard benchmarks, these improvements do not consistently reflect…

Computation and Language · Computer Science 2025-08-21 Haiquan Hu , Jiazhi Jiang , Shiyou Xu , Ruhan Zeng , Tian Wang

As large language models (LLMs) become increasingly versatile, numerous large scale benchmarks have been developed to thoroughly assess their capabilities. These benchmarks typically consist of diverse datasets and prompts to evaluate…

Machine Learning · Computer Science 2024-10-10 Yang Li , Jie Ma , Miguel Ballesteros , Yassine Benajiba , Graham Horwood

Evaluating LLMs and text-to-image models is a computationally intensive task often overlooked. Efficient evaluation is crucial for understanding the diverse capabilities of these models and enabling comparisons across a growing number of…

The increasing versatility of language models (LMs) has given rise to a new class of benchmarks that comprehensively assess a broad range of capabilities. Such benchmarks are associated with massive computational costs, extending to…

Computation and Language · Computer Science 2024-04-02 Yotam Perlitz , Elron Bandel , Ariel Gera , Ofir Arviv , Liat Ein-Dor , Eyal Shnarch , Noam Slonim , Michal Shmueli-Scheuer , Leshem Choshen

The rapid advancement of large language models (LLMs) has significantly improved code completion tasks, yet the trade-off between accuracy and computational cost remains a critical challenge. While using larger models and incorporating…

Software Engineering · Computer Science 2025-02-17 Boyuan Chen , Mingzhi Zhu , Brendan Dolan-Gavitt , Muhammad Shafique , Siddharth Garg

The rapid advancement of large language models (LLMs) and the development of increasingly large and diverse evaluation benchmarks have introduced substantial computational challenges for model assessment. In this paper, we present EffiEval,…

Computation and Language · Computer Science 2025-08-14 Yaoning Wang , Jiahao Ying , Yixin Cao , Yubo Ma , Yugang Jiang

While Large Language Models (LLMs) have shown promise in software engineering, their application to unit testing remains largely confined to isolated test generation or oracle prediction, neglecting the broader challenge of test suite…

Evaluating the quality of text generated by large language models (LLMs) remains a significant challenge. Traditional metrics often fail to align well with human judgments, particularly in tasks requiring creativity and nuance. In this…

Computation and Language · Computer Science 2024-09-11 Jayr Pereira , Andre Assumpcao , Roberto Lotufo

Large language models (LLMs) are widely used as scalable evaluators of model responses in lieu of human annotators. However, imperfect sensitivity and specificity of the LLM judges induce bias in naive evaluation scores. We propose a simple…

Machine Learning · Computer Science 2026-02-10 Chungpa Lee , Thomas Zeng , Jongwon Jeong , Jy-yong Sohn , Kangwook Lee

Benchmarks establish a standardized evaluation framework to systematically assess the performance of large language models (LLMs), facilitating objective comparisons and driving advancements in the field. However, existing benchmarks fail…

Computation and Language · Computer Science 2026-02-16 Ziqian Zhang , Xingjian Hu , Yue Huang , Kai Zhang , Ruoxi Chen , Yixin Liu , Qingsong Wen , Kaidi Xu , Xiangliang Zhang , Neil Zhenqiang Gong , Lichao Sun

We investigate the calibration of large language models' (LLMs') confidence across diverse tasks. The results of our preregistered study show that the current crop of LLMs are, like people, too sure they are right: confidence exceeds…

Artificial Intelligence · Computer Science 2026-05-26 Noam Michael , Daniel BenShushan , Jacob Bien , Don A. Moore

Significant progress has been made in automatic text evaluation with the introduction of large language models (LLMs) as evaluators. However, current sample-wise evaluation paradigm suffers from the following issues: (1) Sensitive to prompt…

Computation and Language · Computer Science 2024-01-02 Peiwen Yuan , Shaoxiong Feng , Yiwei Li , Xinglin Wang , Boyuan Pan , Heda Wang , Kan Li

Large Language Models (LLMs) are transforming scholarly tasks like search and summarization, but their reliability remains uncertain. Current evaluation metrics for testing LLM reliability are primarily automated approaches that prioritize…

Human-Computer Interaction · Computer Science 2026-02-25 Anna Martin-Boyle , William Humphreys , Martha Brown , Cara Leckey , Harmanpreet Kaur

With the development of Large Language Models (LLMs), numerous benchmarks have been proposed to measure and compare the capabilities of different LLMs. However, evaluating LLMs is costly due to the large number of test instances and their…

Computation and Language · Computer Science 2025-04-15 Xu-Xiang Zhong , Chao Yi , Han-Jia Ye

Rigorous statistical evaluations of large language models (LLMs), including valid error bars and significance testing, are essential for meaningful and reliable performance assessment. Currently, when such statistical measures are reported,…

Artificial Intelligence · Computer Science 2025-05-29 Sam Bowyer , Laurence Aitchison , Desi R. Ivanova

The versatility of large language models (LLMs) led to the creation of diverse benchmarks that thoroughly test a variety of language models' abilities. These benchmarks consist of tens of thousands of examples making evaluation of LLMs very…

Computation and Language · Computer Science 2024-05-28 Felipe Maia Polo , Lucas Weber , Leshem Choshen , Yuekai Sun , Gongjun Xu , Mikhail Yurochkin

Evaluating large language models at scale remains a practical bottleneck for many organizations. While existing evaluation frameworks work well for thousands of examples, they struggle when datasets grow to hundreds of thousands or millions…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-04-01 Subhadip Mitra

Background: The use of large language models (LLMs) in the title-abstract screening process of systematic reviews (SRs) has shown promising results, but suffers from limited performance evaluation. Aims: Create a benchmark dataset to…

Software Engineering · Computer Science 2025-12-25 Aleksi Huotala , Miikka Kuutila , Mika Mäntylä

Evaluating large language models (LLMs) in diverse and challenging scenarios is essential to align them with human preferences. To mitigate the prohibitive costs associated with human evaluations, utilizing a powerful LLM as a judge has…

Computation and Language · Computer Science 2025-03-10 Tianjun Wei , Wei Wen , Ruizhi Qiao , Xing Sun , Jianghong Ma

The emergence of large language models (LLMs) has transformed research and practice across a wide range of domains. Within the computing education research (CER) domain, LLMs have garnered significant attention, particularly in the context…

Artificial Intelligence · Computer Science 2024-11-25 Charles Koutcheme , Nicola Dainese , Arto Hellas , Sami Sarsa , Juho Leinonen , Syed Ashraf , Paul Denny