English
Related papers

Related papers: Automating Benchmark Design

200 papers

The rapid evolution of Large Language Models (LLMs) has outpaced the development of model evaluation, highlighting the need for continuous curation of new, challenging benchmarks. However, manual curation of high-quality, human-aligned…

Machine Learning · Computer Science 2024-10-16 Tianle Li , Wei-Lin Chiang , Evan Frick , Lisa Dunlap , Tianhao Wu , Banghua Zhu , Joseph E. Gonzalez , Ion Stoica

Recently, Large Language Models (LLMs) have demonstrated significant potential in automating software engineering tasks. Generating software architecture designs from requirement documents is a crucial step in software development. However,…

Software Engineering · Computer Science 2026-04-09 Minxiao Li , Shuying Yan , Li Zhang , Yang Liu , Fang Liu

Standard single-turn, static benchmarks fall short in evaluating the nuanced capabilities of Large Language Models (LLMs) on complex tasks such as software engineering. In this work, we propose a novel interactive evaluation framework that…

Artificial Intelligence · Computer Science 2025-08-27 Dimitrios Rontogiannis , Maxime Peyrard , Nicolas Baldwin , Martin Josifoski , Robert West , Dimitrios Gunopulos

Autonomous coding agents can produce strong tabular baselines quickly on Kaggle-style tasks. Practical value depends on end-to-end correctness and reliability under time limits. This paper introduces TML-Bench, a tabular benchmark for data…

Machine Learning · Computer Science 2026-03-09 Mykola Pinchuk

Machine learning (ML) has become a vital part in many aspects of our daily life. However, building well performing machine learning applications requires highly specialized data scientists and domain experts. Automated machine learning…

Machine Learning · Computer Science 2021-01-27 Marc-André Zöller , Marco F. Huber

Benchmarks establish a standardized evaluation framework to systematically assess the performance of large language models (LLMs), facilitating objective comparisons and driving advancements in the field. However, existing benchmarks fail…

Computation and Language · Computer Science 2026-02-16 Ziqian Zhang , Xingjian Hu , Yue Huang , Kai Zhang , Ruoxi Chen , Yixin Liu , Qingsong Wen , Kaidi Xu , Xiangliang Zhang , Neil Zhenqiang Gong , Lichao Sun

Large Language Models (LLMs) have shown remarkable capabilities as autonomous agents, yet existing benchmarks either focus on single-agent tasks or are confined to narrow domains, failing to capture the dynamics of multi-agent coordination…

Multiagent Systems · Computer Science 2025-03-05 Kunlun Zhu , Hongyi Du , Zhaochen Hong , Xiaocheng Yang , Shuyi Guo , Zhe Wang , Zhenhailong Wang , Cheng Qian , Xiangru Tang , Heng Ji , Jiaxuan You

Large Language Models (LLMs) have made significant strides in front-end code generation. However, existing benchmarks exhibit several critical limitations: many tasks are overly simplistic, test cases often lack rigor, and end-to-end…

Software Engineering · Computer Science 2025-06-19 Hongda Zhu , Yiwen Zhang , Bing Zhao , Jingzhe Ding , Siyao Liu , Tong Liu , Dandan Wang , Yanan Liu , Zhaojian Li

With the booming demand for machine learning applications, it has been recognized that the number of knowledgeable data scientists can not scale with the growing data volumes and application needs in our digital world. In response to this…

Machine Learning · Computer Science 2023-04-13 Hassan Eldeeb , Mohamed Maher , Radwa Elshawi , Sherif Sakr

The evaluation of large language models (LLMs) has predominantly relied on static datasets, which offer limited scalability and fail to capture the evolving reasoning capabilities of recent models. To overcome these limitations, we propose…

Computation and Language · Computer Science 2026-03-02 Seungdong Yoa , Sanghyu Yoon , Suhee Yoon , Dongmin Kim , Ye Seul Sim , Junhyun Lee , Woohyung Lim

As agent capabilities advance, existing benchmarks, such as $\tau^2$-Bench, are becoming increasingly saturated. Yet constructing new benchmark tasks remains complex, costly, and labor-intensive. Moreover, the standard approach, in which…

Artificial Intelligence · Computer Science 2026-05-28 Tomer Keren , Nitay Calderon , Asaf Yehudai , Yotam Perlitz , Michal Shmueli-Scheuer , Roi Reichert

Given the remarkable performance of Large Language Models (LLMs), an important question arises: Can LLMs conduct human-like scientific research and discover new knowledge, and act as an AI scientist? Scientific discovery is an iterative…

Machine Learning · Computer Science 2025-02-24 Tingting Chen , Srinivas Anumasa , Beibei Lin , Vedant Shah , Anirudh Goyal , Dianbo Liu

The rapid evolution of large language models (LLMs) has transformed conversational agents, enabling complex human-machine interactions. However, evaluation frameworks often focus on single tasks, failing to capture the dynamic nature of…

Computation and Language · Computer Science 2025-02-10 Pietro Alessandro Aluffi , Patrick Zietkiewicz , Marya Bazzi , Matt Arderne , Vladimirs Murevics

AI tools to support real world decision making must be able to build simulation models that inform their recommendations and render them interpretable. Tools that can automate aspects of modeling practice must complement human expertise,…

Artificial Intelligence · Computer Science 2026-05-29 Sara Metcalf , William Schoenberg

The rapid adoption of LLM-based agentic systems has produced a rich ecosystem of frameworks (smolagents, LangGraph, AutoGen, CAMEL, LlamaIndex, i.a.). Yet existing benchmarks are model-centric: they fix the agentic setup and do not compare…

Artificial Intelligence · Computer Science 2026-03-11 Cornelius Emde , Alexander Rubinstein , Anmol Goel , Ahmed Heakl , Sangdoo Yun , Seong Joon Oh , Martin Gubri

Modern AI benchmarks operate at a complexity that outpaces traditional verification methods. Tasks authored by domain experts often contain implicit assumptions, incomplete environment specifications, and brittle evaluation logic that human…

Computation and Language · Computer Science 2026-05-27 Junlin Wang , Federico Bianchi , Shang Zhu , Fan Nie , Yongchan Kwon , Bhuwan Dhingra , James Zou

Current benchmarks for evaluating Large Language Models (LLMs) often do not exhibit enough writing style diversity, with many adhering primarily to standardized conventions. Such benchmarks do not fully capture the rich variety of…

Computation and Language · Computer Science 2025-09-29 Kimberly Le Truong , Riccardo Fogliato , Hoda Heidari , Zhiwei Steven Wu

Benchmarks are often used as a standard to understand LLM capabilities in different domains. However, aggregate benchmark scores provide limited insight into compositional skill gaps of LLMs and how to improve them. To make these weaknesses…

Computation and Language · Computer Science 2026-04-22 Sungeun An , Swanand Ravindra Kadhe , Shailja Thakur , Chad DeLuca , Hima Patel

Autoscaling has become a baseline expectation for cloud-native big data processing, and the design space has expanded beyond rule-based heuristics to include learned controllers and, most recently, large language model (LLM) agents. Yet…

Information Retrieval · Computer Science 2026-05-13 Venkata Krishna Prasanth Budigi , Siri Chandana Sirigiri

Dynamic Algorithm Configuration (DAC) aims to dynamically control a target algorithm's hyperparameters in order to improve its performance. Several theoretical and empirical results have demonstrated the benefits of dynamically controlling…

Artificial Intelligence · Computer Science 2021-12-07 Theresa Eimer , André Biedenkapp , Maximilian Reimer , Steven Adriaensen , Frank Hutter , Marius Lindauer