English
Related papers

Related papers: Rethinking Human Preference Evaluation of LLM Rati…

200 papers

Automatic reviewing helps handle a large volume of papers, provides early feedback and quality control, reduces bias, and allows the analysis of trends. We evaluate the alignment of automatic paper reviews with human reviews using an arena…

As a relative quality comparison of model responses, human and Large Language Model (LLM) preferences serve as common alignment goals in model fine-tuning and criteria in evaluation. Yet, these preferences merely reflect broad tendencies,…

Computation and Language · Computer Science 2024-02-20 Junlong Li , Fan Zhou , Shichao Sun , Yikai Zhang , Hai Zhao , Pengfei Liu

Generating free-text rationales is among the emergent capabilities of Large Language Models (LLMs). These rationales have been found to enhance LLM performance across various NLP tasks. Recently, there has been growing interest in using…

Computation and Language · Computer Science 2024-06-21 Mohamed Elaraby , Diane Litman , Xiang Lorraine Li , Ahmed Magooda

An essential aspect of evaluating Large Language Models (LLMs) is identifying potential biases. This is especially relevant considering the substantial evidence that LLMs can replicate human social biases in their text outputs and further…

Human-Computer Interaction · Computer Science 2024-05-21 Paula Akemi Aoyagui , Sharon Ferguson , Anastasia Kuzminykh

Large language models (LLMs), a recent advance in deep learning and machine intelligence, have manifested astonishing capacities, now considered among the most promising for artificial general intelligence. With human-like capabilities,…

Artificial Intelligence · Computer Science 2025-09-19 Zhilun Zhou , Jing Yi Wang , Nicholas Sukiennik , Chen Gao , Fengli Xu , Yong Li , James Evans

We study how well large language models (LLMs) explain their generations through rationales -- a set of tokens extracted from the input text that reflect the decision-making process of LLMs. Specifically, we systematically study rationales…

Computation and Language · Computer Science 2024-10-23 Mohsen Fayyaz , Fan Yin , Jiao Sun , Nanyun Peng

Reinforcement learning (RL) faces challenges in evaluating policy trajectories within intricate game tasks due to the difficulty in designing comprehensive and precise reward functions. This inherent difficulty curtails the broader…

Artificial Intelligence · Computer Science 2024-07-02 Zichao Shen , Tianchen Zhu , Qingyun Sun , Shiqi Gao , Jianxin Li

We explore how large language models (LLMs) can enhance the proposal selection process at large user facilities, offering a scalable, consistent, and cost-effective alternative to traditional human review. Proposal selection depends on…

Artificial Intelligence · Computer Science 2025-12-12 Lijie Ding , Janell Thomson , Jon Taylor , Changwoo Do

This paper investigates the ability of large language models (LLMs) to solve statistical tasks, as well as their capacity to assess the quality of reasoning. While state-of-the-art LLMs have demonstrated remarkable performance in a range of…

Computation and Language · Computer Science 2026-01-22 Crish Nagarkar , Leonid Bogachev , Serge Sharoff

Do large language models (LLMs) display rational reasoning? LLMs have been shown to contain human biases due to the data they have been trained on; whether this is reflected in rational reasoning remains less clear. In this paper, we answer…

Computation and Language · Computer Science 2024-02-16 Olivia Macmillan-Scott , Mirco Musolesi

Rapid advancements in Large Language models (LLMs) has significantly enhanced their reasoning capabilities. Despite improved performance on benchmarks, LLMs exhibit notable gaps in their cognitive processes. Additionally, as reflections of…

Computation and Language · Computer Science 2024-12-06 Ammar Shaikh , Raj Abhijit Dandekar , Sreedath Panat , Rajat Dandekar

In many applications, human and LLM evaluators use assessments of relevant criteria to create an overall evaluation for an item or individual. For example, in admissions, committees assess candidates on attributes such as test scores, GPA,…

Machine Learning · Computer Science 2026-05-19 Madeline Celi Kitch , Nihar B. Shah

We investigate whether large language models (LLMs) can generate effective, user-facing explanations from a mathematically interpretable recommendation model. The model is based on constrained matrix factorization, where user types are…

Artificial Intelligence · Computer Science 2025-10-02 Maxime Manderlier , Fabian Lecron , Olivier Vu Thanh , Nicolas Gillis

Human preference judgments are pivotal in guiding large language models (LLMs) to produce outputs that align with human values. Human evaluations are also used in summarization tasks to compare outputs from various systems, complementing…

Computation and Language · Computer Science 2023-10-31 Yebowen Hu , Kaiqiang Song , Sangwoo Cho , Xiaoyang Wang , Hassan Foroosh , Fei Liu

What enables large language models (LLMs) to effectively model user preferences in sequential recommendation? Our investigation reveals that existing preference-alignment approaches largely rely on binary pairwise comparisons, overlooking…

Information Retrieval · Computer Science 2026-04-20 Zhongyu Ouyang , Qianlong Wen , Chunhui Zhang , Yanfang Ye , Soroush Vosoughi

Ensuring that large language models (LLMs) reflect diverse user values and preferences is crucial as their user bases expand globally. It is therefore encouraging to see the growing interest in LLM personalization within the research…

Computation and Language · Computer Science 2024-06-18 Yijiang River Dong , Tiancheng Hu , Nigel Collier

Large language models (LLMs) have shown promising abilities as cost-effective and reference-free evaluators for assessing language generation quality. In particular, pairwise LLM evaluators, which compare two generated texts and determine…

Computation and Language · Computer Science 2024-10-15 Han Zhou , Xingchen Wan , Yinhong Liu , Nigel Collier , Ivan Vulić , Anna Korhonen

As large language models (LLMs) like GPT become increasingly prevalent, it is essential that we assess their capabilities beyond language processing. This paper examines the economic rationality of GPT by instructing it to make budgetary…

General Economics · Economics 2023-11-07 Yiting Chen , Tracy Xiao Liu , You Shan , Songfa Zhong

Large Language Models (LLMs) increasingly show reasoning rationales alongside their answers, turning "reasoning" into a user-interface element. While step-by-step rationales are typically associated with model performance, how they…

Human-Computer Interaction · Computer Science 2026-03-10 Xin Sun , Shu Wei , Jos A Bosch , Isao Echizen , Saku Sugawara , Abdallah El Ali

In order for AI systems to communicate effectively with people, they must understand how we make decisions. However, people's decisions are not always rational, so the implicit internal models of human decision-making in Large Language…

Computation and Language · Computer Science 2025-03-11 Ryan Liu , Jiayi Geng , Joshua C. Peterson , Ilia Sucholutsky , Thomas L. Griffiths