English
Related papers

Related papers: Automated Concept Discovery for LLM-as-a-Judge Pre…

200 papers

LLM-based judges have emerged as a scalable alternative to human evaluation and are increasingly used to assess, compare, and improve models. However, the reliability of LLM-based judges themselves is rarely scrutinized. As LLMs become more…

Artificial Intelligence · Computer Science 2025-04-08 Sijun Tan , Siyuan Zhuang , Kyle Montgomery , William Y. Tang , Alejandro Cuadron , Chenguang Wang , Raluca Ada Popa , Ion Stoica

Large language models (LLMs) are known to produce varying responses depending on prompt phrasing, indicating that subtle guidance in phrasing can steer their answers. However, the impact of this framing bias on LLM-based evaluation, where…

Computation and Language · Computer Science 2026-01-21 Yerin Hwang , Dongryeol Lee , Taegwan Kang , Minwoo Lee , Kyomin Jung

Reliable evaluation of large language models (LLMs) is critical as their deployment rapidly expands, particularly in high-stakes domains such as business and finance. The LLM-as-a-Judge framework, which uses prompted LLMs to evaluate…

Computation and Language · Computer Science 2026-04-03 Michael Krumdick , Charles Lovering , Varshini Reddy , Seth Ebner , Chris Tanner

State of the art large language models (LLMs) have shown impressive performance on a variety of benchmark tasks and are increasingly used as components in larger applications, where LLM-based predictions serve as proxies for human…

Computation and Language · Computer Science 2024-06-14 Michael Franke , Polina Tsvilodub , Fausto Carcassi

The remarkable success of pretrained language models has motivated the study of what kinds of knowledge these models learn during pretraining. Reformulating tasks as fill-in-the-blanks problems (e.g., cloze tests) is a natural approach for…

Computation and Language · Computer Science 2020-11-10 Taylor Shin , Yasaman Razeghi , Robert L. Logan , Eric Wallace , Sameer Singh

As large language models (LLMs) grow more capable, they face increasingly diverse and complex tasks, making reliable evaluation challenging. The paradigm of LLMs as judges has emerged as a scalable solution, yet prior work primarily focuses…

Computation and Language · Computer Science 2025-11-03 Weiyuan Li , Xintao Wang , Siyu Yuan , Rui Xu , Jiangjie Chen , Qingqing Dong , Yanghua Xiao , Deqing Yang

Pre-trained large language models (LLMs) can now be easily adapted for specific business purposes using custom prompts or fine tuning. These customizations are often iteratively re-engineered to improve some aspect of performance, but after…

Computation and Language · Computer Science 2024-07-15 Jennifer Healey , Laurie Byrum , Md Nadeem Akhtar , Moumita Sinha

Large language models are increasingly used as judges (LLM-as-a-judge) to evaluate model outputs at scale, but their assessments often diverge systematically from human judgments. We present Bridge, a unified statistical framework that…

Machine Learning · Computer Science 2025-12-03 Felipe Maia Polo , Xinhe Wang , Mikhail Yurochkin , Gongjun Xu , Moulinath Banerjee , Yuekai Sun

Learning from preference feedback is a common practice for aligning large language models~(LLMs) with human value. Conventionally, preference data is learned and encoded into a scalar reward model that connects a value head with an LLM to…

Computation and Language · Computer Science 2025-09-03 Ziyi Ye , Xiangsheng Li , Qiuchi Li , Qingyao Ai , Yujia Zhou , Wei Shen , Dong Yan , Yiqun Liu

Using LLMs to evaluate text, that is, LLM-as-a-judge, is increasingly being used at scale to augment or even replace human annotations. As such, it is imperative that we understand the potential biases and risks of doing so. In this work,…

Computation and Language · Computer Science 2025-10-10 Jasmina Gajcin , Erik Miehling , Rahul Nair , Elizabeth Daly , Radu Marinescu , Seshu Tirupathi

Large language models (LLMs) have achieved remarkable performance on diverse benchmarks, yet existing evaluation practices largely rely on coarse summary metrics that obscure underlying reasoning abilities. In this work, we propose novel…

Methodology · Statistics 2026-03-17 Jia Liu , Zhiyu Xu , Yuqi Gu

Applying large language models (LLMs) to assist in psycho-counseling is an emerging and meaningful approach, driven by the significant gap between patient needs and the availability of mental health support. However, current LLMs struggle…

Computation and Language · Computer Science 2026-04-14 Mian Zhang , Shaun M. Eack , Zhiyu Zoey Chen

Large Language Models (LLMs) have revolutionized artificial intelligence, demonstrating remarkable computational power and linguistic capabilities. However, these models are inherently prone to various biases stemming from their training…

Computation and Language · Computer Science 2025-02-14 Riccardo Cantini , Giada Cosenza , Alessio Orsino , Domenico Talia

Large language models (LLMs) can already identify patterns and reason effectively, yet their variable accuracy hampers adoption in high-stakes decision-making applications. In this paper, we study this issue from a venture capital…

Artificial Intelligence · Computer Science 2025-10-28 Rick Chen , Joseph Ternasky , Aaron Ontoyin Yin , Xianling Mu , Fuat Alican , Yigit Ihlamur

Time series anomaly detection is critical for supply chain management to take proactive operations, but faces challenges: classical unsupervised anomaly detection based on exploiting data patterns often yields results misaligned with…

Machine Learning · Computer Science 2026-01-28 Haoting Zhang , Shekhar Jain

Automatic generation of educational materials using large language models (LLMs) is becoming increasingly common, but assigning difficulty levels to such materials still requires substantial human effort. LLM-as-a-Judge has therefore…

Computation and Language · Computer Science 2026-05-13 Yo Ehara

LLM-as-a-Judge has become a dominant approach in automated evaluation systems, playing critical roles in model alignment, leaderboard construction, quality control, and so on. However, the scalability and trustworthiness of this approach…

Machine Learning · Computer Science 2026-05-15 Jinming Yang , Zheng Hu , Chuxian Qiu , Zhenyu Deng , Xinshan Jiao , Tao Zhou

Despite growing interest in using Large Language Models (LLMs) for educational assessment, it remains unclear how closely they align with human scoring. We present a systematic evaluation of instruction-tuned LLMs across three open…

Computation and Language · Computer Science 2026-04-02 Filip J. Kucia , Anirban Chakraborty , Anna Wróblewska

Large language models (LLMs) are widely used as scalable evaluators of model responses in lieu of human annotators. However, imperfect sensitivity and specificity of the LLM judges induce bias in naive evaluation scores. We propose a simple…

Machine Learning · Computer Science 2026-02-10 Chungpa Lee , Thomas Zeng , Jongwon Jeong , Jy-yong Sohn , Kangwook Lee

The effective training and evaluation of retrieval systems require a substantial amount of relevance judgments, which are traditionally collected from human assessors -- a process that is both costly and time-consuming. Large Language…

Information Retrieval · Computer Science 2024-12-19 Hossein A. Rahmani , Emine Yilmaz , Nick Craswell , Bhaskar Mitra