English
Related papers

Related papers: On Evaluating LLM Alignment by Evaluating LLMs as …

200 papers

Evaluating Natural Language Generation (NLG) is crucial for the practical adoption of AI, but has been a longstanding research challenge. While human evaluation is considered the de-facto standard, it is expensive and lacks scalability.…

Computation and Language · Computer Science 2025-08-20 Maria Paz Oliva , Adriana Correia , Ivan Vankov , Viktor Botev

With the rise in capabilities of large language models (LLMs) and their deployment in real-world tasks, evaluating LLM alignment with human preferences has become an important challenge. Current benchmarks average preferences across all…

Artificial Intelligence · Computer Science 2026-04-22 Cristina Garbacea , Heran Wang , Chenhao Tan

Evaluating Large Language Models (LLMs) in open-ended scenarios is challenging because existing benchmarks and metrics can not measure them comprehensively. To address this problem, we propose to fine-tune LLMs as scalable judges (JudgeLM)…

Computation and Language · Computer Science 2025-03-04 Lianghui Zhu , Xinggang Wang , Xinlong Wang

As Large Language Models (LLMs) achieve remarkable breakthroughs, aligning their values with humans has become imperative for their responsible development and customized applications. However, there still lack evaluations of LLMs values…

Artificial Intelligence · Computer Science 2025-06-03 Jing Yao , Xiaoyuan Yi , Shitong Duan , Jindong Wang , Yuzhuo Bai , Muhua Huang , Peng Zhang , Tun Lu , Zhicheng Dou , Maosong Sun , Xing Xie

Despite the significant progress made by existing retrieval augmented language models (RALMs) in providing trustworthy responses and grounding in reliable sources, they often overlook effective alignment with human preferences. In the…

Computation and Language · Computer Science 2024-12-19 Zhuoran Jin , Hongbang Yuan , Tianyi Men , Pengfei Cao , Yubo Chen , Kang Liu , Jun Zhao

The growing interest in automatic survey generation (ASG), a task that traditionally required considerable time and effort, has been spurred by recent advances in large language models (LLMs). With advancements in retrieval-augmented…

Computation and Language · Computer Science 2025-08-18 Beichen Guo , Zhiyuan Wen , Yu Yang , Peng Gao , Ruosong Yang , Jiaxing Shen

Large language models (LLMs) can serve as judges that offer rapid and reliable assessments of other LLM outputs. However, models may systematically assign overly favorable ratings to their own outputs, a phenomenon known as self-bias, which…

Computation and Language · Computer Science 2025-08-12 Evangelia Spiliopoulou , Riccardo Fogliato , Hanna Burnsky , Tamer Soliman , Jie Ma , Graham Horwood , Miguel Ballesteros

Large Language Models (LLMs) have demonstrated impressive performance in biomedical relation extraction, even in zero-shot scenarios. However, evaluating LLMs in this task remains challenging due to their ability to generate human-like…

Computation and Language · Computer Science 2025-06-03 Md Tahmid Rahman Laskar , Israt Jahan , Elham Dolatabadi , Chun Peng , Enamul Hoque , Jimmy Huang

LLM-as-a-judge has become a promising paradigm for using large language models (LLMs) to evaluate natural language generation (NLG), but the uncertainty of its evaluation remains underexplored. This lack of reliability may limit its…

Computation and Language · Computer Science 2025-09-24 Huanxin Sheng , Xinyi Liu , Hangfeng He , Jieyu Zhao , Jian Kang

The LLM-as-a-judge paradigm, in which a judge LLM system replaces human raters in rating the outputs of other generative AI (GenAI) systems, plays a critical role in scaling and standardizing GenAI evaluations. To validate such judge…

Machine Learning · Computer Science 2025-10-28 Luke Guerdan , Solon Barocas , Kenneth Holstein , Hanna Wallach , Zhiwei Steven Wu , Alexandra Chouldechova

As educational systems evolve, ensuring that assessment items remain aligned with content standards is essential for maintaining fairness and instructional relevance. Traditional human alignment reviews are accurate but slow and…

Artificial Intelligence · Computer Science 2025-11-26 Farzan Karimi-Malekabadi , Pooya Razavi , Sonya Powers

A common technique for aligning large language models (LLMs) relies on acquiring human preferences by comparing multiple generations conditioned on a fixed context. This method, however, relies solely on pairwise comparisons, where the…

Computation and Language · Computer Science 2025-01-09 Hritik Bansal , Ashima Suvarna , Gantavya Bhatt , Nanyun Peng , Kai-Wei Chang , Aditya Grover

In the rapidly evolving domain of Natural Language Generation (NLG) evaluation, introducing Large Language Models (LLMs) has opened new avenues for assessing generated content quality, e.g., coherence, creativity, and context relevance.…

Computation and Language · Computer Science 2024-06-13 Zhen Li , Xiaohan Xu , Tao Shen , Can Xu , Jia-Chen Gu , Yuxuan Lai , Chongyang Tao , Shuai Ma

In recent years, Large Language Models (LLMs) have gained immense attention due to their notable emergent capabilities, surpassing those seen in earlier language models. A particularly intriguing application of LLMs is their role as…

Computation and Language · Computer Science 2023-11-02 Xue-Yong Fu , Md Tahmid Rahman Laskar , Cheng Chen , Shashi Bhushan TN

Aligning LLM-based judges with human preferences is a significant challenge, as they are difficult to calibrate and often suffer from rubric sensitivity, bias, and instability. Overcoming this challenge advances key applications, such as…

Aligning large language models (LLMs) to human preferences is a crucial step in building helpful and safe AI tools, which usually involve training on supervised datasets. Popular algorithms such as Direct Preference Optimization (DPO) rely…

Computation and Language · Computer Science 2025-06-05 Honggen Zhang , Xufeng Zhao , Igor Molybog , June Zhang

Evaluating the quality of arguments is a crucial aspect of any system leveraging argument mining. However, it is a challenge to obtain reliable and consistent annotations regarding argument quality, as this usually requires domain-specific…

Computation and Language · Computer Science 2024-04-16 Nailia Mirzakhmedova , Marcel Gohsen , Chia Hao Chang , Benno Stein

Research on the 'cultural alignment' of Large Language Models (LLMs) has emerged in response to growing interest in understanding representation across diverse stakeholders. Current approaches to evaluating cultural alignment through…

Computers and Society · Computer Science 2025-04-10 Ariba Khan , Stephen Casper , Dylan Hadfield-Menell

With the advancements in Large Language Models (LLMs), Vision-Language Models (VLMs) have reached a new level of sophistication, showing notable competence in executing intricate cognition and reasoning tasks. However, existing evaluation…

Computer Vision and Pattern Recognition · Computer Science 2023-11-27 Yuanfeng Ji , Chongjian Ge , Weikai Kong , Enze Xie , Zhengying Liu , Zhengguo Li , Ping Luo

This research investigates prompt designs of evaluating generated texts using large language models (LLMs). While LLMs are increasingly used for scoring various inputs, creating effective prompts for open-ended text evaluation remains…

Computation and Language · Computer Science 2024-06-28 KuanChao Chu , Yi-Pei Chen , Hideki Nakayama