English
Related papers

Related papers: LLMs Cannot Reliably Judge (Yet?): A Comprehensive…

200 papers

Retrieval Augmented Language Models (RALMs) have gained significant attention for their ability to generate accurate answer and improve efficiency. However, RALMs are inherently vulnerable to imperfect information due to their reliance on…

Computation and Language · Computer Science 2024-10-22 Seong-Il Park , Jay-Yoon Lee

The LLM-as-a-judge paradigm is widely used in both evaluating free-text model responses and reward modeling for model alignment and fine-tuning. Recently, fine-tuning judges with judge-specific data has emerged as an often preferred choice…

Computation and Language · Computer Science 2026-04-21 Janvijay Singh , Austin Xu , Yilun Zhou , Yefan Zhou , Dilek Hakkani-Tur , Shafiq Joty

The increasing integration of Large Language Models (LLMs) into society necessitates robust defenses against vulnerabilities from jailbreaking and adversarial prompts. This project proposes a recursive framework for enhancing the resistance…

Cryptography and Security · Computer Science 2024-12-10 Bryan Li , Sounak Bagchi , Zizhan Wang

The growing dependence on Large Language Models (LLMs) for finishing user instructions necessitates a comprehensive understanding of their robustness to complex task completion in real-world situations. To address this critical need, we…

Computation and Language · Computer Science 2024-03-07 Zekai Zhang , Yiduo Guo , Yaobo Liang , Dongyan Zhao , Nan Duan

Multimodal Large Language Models (MLLMs) have been widely adopted as MLLM-as-a-Judges due to their strong alignment with human judgment across various visual tasks. However, most existing judge models are optimized for single-task scenarios…

Computation and Language · Computer Science 2026-04-22 Junjie Wu , Xuan Kan , Zihao He , Shunwen Tan , Bo Pan , Kaitai Zhang

LLM-as-a-Judge is a widely used method for evaluating the performance of Large Language Models (LLMs) across various tasks. We address the challenge of quantifying the uncertainty of LLM-as-a-Judge evaluations. While uncertainty…

Large language models (LLMs) have become essential tools in software development, widely used for requirements engineering, code generation and review tasks. Software engineers often rely on LLMs to verify if code implementation satisfy…

Software Engineering · Computer Science 2026-03-03 Haolin Jin , Huaming Chen

Retrieval-Augmented Generation (RAG) has proven its effectiveness in alleviating hallucinations for Large Language Models (LLMs). However, existing automated evaluation metrics cannot fairly evaluate the outputs generated by RAG models…

Computation and Language · Computer Science 2025-02-27 Shuliang Liu , Xinze Li , Zhenghao Liu , Yukun Yan , Cheng Yang , Zheni Zeng , Zhiyuan Liu , Maosong Sun , Ge Yu

The rapid expansion of research on Large Language Model (LLM) safety and robustness has produced a fragmented and oftentimes buggy ecosystem of implementations, datasets, and evaluation methods. This fragmentation makes reproducibility and…

Artificial Intelligence · Computer Science 2025-11-07 Tim Beyer , Jonas Dornbusch , Jakob Steimle , Moritz Ladenburger , Leo Schwinn , Stephan Günnemann

Large Language Models (LLMs) are highly sensitive to subtle, non-semantic variations in prompt phrasing and formatting. In this work, we present the first systematic evaluation of 5 methods for improving prompt robustness within a unified…

Computation and Language · Computer Science 2025-08-18 Mikhail Seleznyov , Mikhail Chaichuk , Gleb Ershov , Alexander Panchenko , Elena Tutubalina , Oleg Somov

This paper presents an approach to developing assurance cases for adversarial robustness and regulatory compliance in large language models (LLMs). Focusing on both natural and code language tasks, we explore the vulnerabilities these…

Cryptography and Security · Computer Science 2024-10-10 Tomas Bueno Momcilovic , Dian Balta , Beat Buesser , Giulio Zizzo , Mark Purcell

LLM-as-a-Judge refers to the automatic modeling of preferences for responses generated by Large Language Models (LLMs), which is of significant importance for both LLM evaluation and reward modeling. Although generative LLMs have made…

Computation and Language · Computer Science 2026-01-13 Hui Huang , Yancheng He , Hongli Zhou , Rui Zhang , Wei Liu , Weixun Wang , Jiaheng Liu , Wenbo Su

Large Language Models (LLMs) have shown to be effective evaluators across various domains such as machine translations or the scientific domain. Current LLM-as-a-Judge approaches rely mostly on individual assessments or a single round of…

Computation and Language · Computer Science 2025-07-10 Isik Baran Sandan , Tu Anh Dinh , Jan Niehues

Large Language Models (LLMs) have achieved remarkable success in tasks requiring complex reasoning, such as code generation, mathematical problem solving, and algorithmic synthesis -- especially when aided by reasoning tokens and…

Computation and Language · Computer Science 2025-06-13 Jaechul Roh , Varun Gandhi , Shivani Anilkumar , Arin Garg

Typical evaluations of Large Language Models (LLMs) report a single metric per dataset, often representing the model's best-case performance under carefully selected settings. Unfortunately, this approach overlooks model robustness and…

Computation and Language · Computer Science 2025-03-04 Grigor Nalbandyan , Rima Shahbazyan , Evelina Bakhturina

Large Reasoning Models (LRMs) have emerged as a powerful advancement in multi-step reasoning tasks, offering enhanced transparency and logical consistency through explicit chains of thought (CoT). However, these models introduce novel…

Cryptography and Security · Computer Science 2026-04-15 Jiawei Chen , Yang Yang , Chao Yu , Yu Tian , Zhi Cao , Xue Yang , Linghao Li , Hang Su , Zhaoxia Yin

Large language models (LLMs) are increasingly used as automatic evaluators of generative AI outputs, a paradigm often referred to as "LLM-as-a-judge." In practice, LLM judges are imperfect predictions for the underlying truth and can…

Machine Learning · Computer Science 2026-01-12 Yiqun T Chen , Sizhu Lu , Sijia Li , Moran Guo , Shengyi Li

Large Language Models (LLMs) have demonstrated strong capabilities as autonomous agents through tool use, planning, and decision-making abilities, leading to their widespread adoption across diverse tasks. As task complexity grows,…

Multiagent Systems · Computer Science 2025-11-10 Ishan Kavathekar , Hemang Jain , Ameya Rathod , Ponnurangam Kumaraguru , Tanuja Ganu

Large language models (LLMs) have achieved impressive performance across various mathematical reasoning benchmarks. However, there are increasing debates regarding whether these models truly understand and apply mathematical knowledge or…

Computation and Language · Computer Science 2024-07-03 Qintong Li , Leyang Cui , Xueliang Zhao , Lingpeng Kong , Wei Bi

LLM-as-a-Judge has revolutionized AI evaluation by leveraging large language models for scalable assessments. However, as evaluands become increasingly complex, specialized, and multi-step, the reliability of LLM-as-a-Judge has become…

Computation and Language · Computer Science 2026-01-09 Runyang You , Hongru Cai , Caiqi Zhang , Qiancheng Xu , Meng Liu , Tiezheng Yu , Yongqi Li , Wenjie Li