English
Related papers

Related papers: RewardHackingAgents: Benchmarking Evaluation Integ…

200 papers

LLM agents are increasingly expected to function as general-purpose systems capable of resolving open-ended user requests. While existing benchmarks focus on domain-aware environments for developing specialized agents, evaluating…

Artificial Intelligence · Computer Science 2026-02-24 Xiaochuan Li , Ryan Ming , Pranav Setlur , Abhijay Paladugu , Andy Tang , Hao Kang , Shuai Shao , Rong Jin , Chenyan Xiong

Autonomous agents have recently achieved remarkable progress across diverse domains, yet most evaluations focus on short-horizon, fully observable tasks. In contrast, many critical real-world tasks, such as large-scale software development,…

As Multimodal Large Language Models (MLLMs) advance, multimodal agents show promise in real-world tasks like web navigation and embodied intelligence. However, due to limitations in a lack of external feedback, these agents struggle with…

Computation and Language · Computer Science 2025-06-27 Tianyi Men , Zhuoran Jin , Pengfei Cao , Yubo Chen , Kang Liu , Jun Zhao

Rigorous security-focused evaluation of large language model (LLM) agents is imperative for establishing trust in their safe deployment throughout the software development lifecycle. However, existing benchmarks largely rely on synthetic…

Machine Learning · Computer Science 2025-10-23 Hwiwon Lee , Ziqi Zhang , Hanxiao Lu , Lingming Zhang

Benchmarks for large language models (LLMs) have predominantly assessed short-horizon, localized reasoning. Existing long-horizon suites (e.g. SWE-bench) rely on manually curated issues, so expanding or tuning difficulty demands expensive…

Machine Learning · Computer Science 2025-06-03 Kaivalya Hariharan , Uzay Girit , Atticus Wang , Jacob Andreas

Reinforcement learning (RL) trained language model agents with tool access are increasingly deployed in coding assistants, research tools, and autonomous systems. We introduce the Reward Hacking Benchmark (RHB), a suite of multi-step tasks…

Machine Learning · Computer Science 2026-05-06 Kunvar Thaman

Evaluation insights are limited by the availability of high-quality benchmarks. As models evolve, there is a need to create benchmarks that can measure progress on new and complex generative capabilities. However, manually creating new…

Machine Learning · Computer Science 2025-10-08 Natasha Butt , Varun Chandrasekaran , Neel Joshi , Besmira Nushi , Vidhisha Balachandran

Interactive agent benchmarks map an agent run to a binary outcome through outcome checks. When these checks rely on surface level signals or fail to capture the agent's actual action path, they cannot reliably determine whether the run…

Artificial Intelligence · Computer Science 2026-05-12 Shanshan Gao , Liyi Zhou

Automated \enquote{LLM-as-a-Judge} frameworks have become the de facto standard for scalable evaluation across natural language processing. For instance, in safety evaluation, these judges are relied upon to evaluate harmfulness in order to…

Computation and Language · Computer Science 2026-03-17 Leo Schwinn , Moritz Ladenburger , Tim Beyer , Mehrnaz Mofakhami , Gauthier Gidel , Stephan Günnemann

The pursuit of leaderboard rankings in Large Language Models (LLMs) has created a fundamental paradox: models excel at standardized tests while failing to demonstrate genuine language understanding and adaptability. Our systematic analysis…

Computation and Language · Computer Science 2024-12-06 Sourav Banerjee , Ayushi Agarwal , Eishkaran Singh

Recent work has embodied LLMs as agents, allowing them to access tools, perform actions, and interact with external content (e.g., emails or websites). However, external content introduces the risk of indirect prompt injection (IPI)…

Computation and Language · Computer Science 2024-08-06 Qiusi Zhan , Zhixiang Liang , Zifan Ying , Daniel Kang

As language models (LMs) are used to build autonomous agents in real environments, ensuring their adversarial robustness becomes a critical challenge. Unlike chatbots, agents are compound systems with multiple components taking actions,…

Machine Learning · Computer Science 2025-02-06 Chen Henry Wu , Rishi Shah , Jing Yu Koh , Ruslan Salakhutdinov , Daniel Fried , Aditi Raghunathan

The tendency to find and exploit "shortcuts" to complete tasks poses significant risks for reliable assessment and deployment of large language models (LLMs). For example, an LLM agent with access to unit tests may delete failing tests…

Machine Learning · Computer Science 2025-10-24 Ziqian Zhong , Aditi Raghunathan , Nicholas Carlini

AI agents could accelerate scientific discovery by automating hypothesis formation, experiment design, coding, execution, and analysis, yet existing benchmarks probe narrow skills in simplified settings. To address this gap, we introduce…

LLM agents are rapidly evolving from coding assistants into autonomous software engineering systems. However, existing evaluation methodologies remain largely centered on static, isolated, and short-horizon benchmarks that fail to capture…

Software Engineering · Computer Science 2026-05-28 Yipeng Ouyang , Xin Huang , Bingjie Liu , Zhongchun Zheng , Yuhao Gu , Xianwei Zhang

Large language model agents increasingly operate through environment-facing scaffolds that expose files, web pages, APIs, and logs. These observations influence tool use, state tracking, and action sequencing, yet their reliability and…

Artificial Intelligence · Computer Science 2026-05-13 Strick Sheng , Ziyue Wang , Liyi Zhou

We introduce EvilGenie, a benchmark for reward hacking in programming settings. We source problems from LiveCodeBench and create an environment in which agents can easily reward hack, such as by hardcoding test cases or editing the testing…

Machine Learning · Computer Science 2026-05-19 Jonathan Gabor , Jayson Lynch , Jonathan Rosenfeld

Large Language Models (LLMs) have demonstrated strong capabilities as autonomous agents through tool use, planning, and decision-making abilities, leading to their widespread adoption across diverse tasks. As task complexity grows,…

Multiagent Systems · Computer Science 2025-11-10 Ishan Kavathekar , Hemang Jain , Ameya Rathod , Ponnurangam Kumaraguru , Tanuja Ganu

As LLMs are increasingly deployed as agents, reliable assessment of their agentic capabilities has become essential. However, reported benchmark scores often jointly reflect model capability and the implementation choices each benchmark is…

Artificial Intelligence · Computer Science 2026-05-28 Pengyu Zhu , Lijun Li , Yaxing Lyu , Qianxin Luo , Jingyi Yang , Yi Liu , Tingfeng Hui , Xinyu Yuan , Li Sun , Sen Su , Jing Shao

Recent advances in browser-based LLM agents have shown promise for automating tasks ranging from simple form filling to hotel booking or online shopping. Current benchmarks measure agent performance in controlled environments, such as…

Artificial Intelligence · Computer Science 2025-10-07 Su Kara , Fazle Faisal , Suman Nath