English
Related papers

Related papers: How Many Human Judgments Are Enough? Feasibility L…

200 papers

Despite the parallel challenges that audio and text domains face in evaluating generative model outputs, preference learning remains remarkably underexplored in audio applications. Through a PRISMA-guided systematic review of approximately…

Sound · Computer Science 2025-11-19 Aaron Broukhim , Yiran Shen , Prithviraj Ammanabrolu , Nadir Weibel

Using language models to scalably approximate human preferences on text quality (LLM-as-a-judge) has become a standard practice applicable to many tasks. A judgment is often extracted from the judge's textual output alone, typically with…

Computation and Language · Computer Science 2025-09-29 Victor Wang , Michael J. Q. Zhang , Eunsol Choi

Many policies allocate harms or benefits that are uncertain in nature: they produce distributions over the population in which individuals have different probabilities of incurring harm or benefit. Comparing different policies thus involves…

Computers and Society · Computer Science 2021-03-11 Hoda Heidari , Solon Barocas , Jon Kleinberg , Karen Levy

With the increasing capabilities of LLMs, recent studies focus on understanding whose opinions are represented by them and how to effectively extract aligned opinion distributions. We conducted an empirical analysis of three straightforward…

Computation and Language · Computer Science 2024-11-18 Maja Pavlovic , Massimo Poesio

Large Language Models (LLMs) are increasingly used as chatbots, yet their ability to personalize responses to user preferences remains limited. We introduce PrefEval, a benchmark for evaluating LLMs' ability to infer, memorize and adhere to…

Machine Learning · Computer Science 2025-02-14 Siyan Zhao , Mingyi Hong , Yang Liu , Devamanyu Hazarika , Kaixiang Lin

Designing recommendation systems that serve content aligned with time varying preferences requires proper accounting of the feedback effects of recommendations on human behavior and psychological condition. We argue that modeling the…

Information Retrieval · Computer Science 2022-08-09 Mihaela Curmei , Andreas Haupt , Dylan Hadfield-Menell , Benjamin Recht

Fairness in both Machine Learning (ML) predictions and human decision-making is essential, yet both are susceptible to different forms of bias, such as algorithmic and data-driven in ML, and cognitive or subjective in humans. In this study,…

Computation and Language · Computer Science 2025-08-28 Junhua Liu , Roy Ka-Wei Lee , Kwan Hui Lim

Biased human decisions have consequential impacts across various domains, yielding unfair treatment of individuals and resulting in suboptimal outcomes for organizations and society. In recognition of this fact, organizations regularly…

Machine Learning · Computer Science 2024-12-11 Wanxue Dong , Maria De-Arteaga , Maytal Saar-Tsechansky

Large Language Models (LLMs) are increasingly used to automate relevance judgments for information retrieval (IR) tasks, often demonstrating agreement with human labels that approaches inter-human agreement. To assess the robustness and…

Information Retrieval · Computer Science 2025-04-18 Negar Arabzadeh , Charles L. A . Clarke

Attribution scores indicate the importance of different input parts and can, thus, explain model behaviour. Currently, prompt-based models are gaining popularity, i.a., due to their easier adaptability in low-resource settings. However, the…

Computation and Language · Computer Science 2024-03-11 Wei Zhou , Heike Adel , Hendrik Schuff , Ngoc Thang Vu

To overcome the limitations of automated metrics (e.g. BLEU, METEOR) for evaluating dialogue systems, researchers typically use human judgments to provide convergent evidence. While it has been demonstrated that human judgments can suffer…

Computation and Language · Computer Science 2019-09-24 Sashank Santhanam , Samira Shaikh

Societies often rely on human experts to take a wide variety of decisions affecting their members, from jail-or-release decisions taken by judges and stop-and-frisk decisions taken by police officers to accept-or-reject decisions taken by…

Machine Learning · Statistics 2018-05-29 Isabel Valera , Adish Singla , Manuel Gomez Rodriguez

As large language models (LLM) evolve in their capabilities, various recent studies have tried to quantify their behavior using psychological tools created to study human behavior. One such example is the measurement of "personality" of…

Computation and Language · Computer Science 2024-01-04 Akshat Gupta , Xiaoyang Song , Gopala Anumanchipalli

As generative large language models (LLMs) grow more performant and prevalent, we must develop comprehensive enough tools to measure and improve their fairness. Different prompt-based datasets can be used to measure social bias across…

Large language models (LLMs) are increasingly used as automatic evaluators in applications such as benchmarking, reward modeling, and self-refinement. Prior work highlights a potential self-preference bias where LLMs favor their own…

Computation and Language · Computer Science 2025-12-16 Wei-Lin Chen , Zhepei Wei , Xinyu Zhu , Shi Feng , Yu Meng

In this work, we consider how preference models in interactive recommendation systems determine the availability of content and users' opportunities for discovery. We propose an evaluation procedure based on stochastic reachability to…

Information Retrieval · Computer Science 2021-07-05 Mihaela Curmei , Sarah Dean , Benjamin Recht

Existing observational approaches for learning human preferences, such as inverse reinforcement learning, usually make strong assumptions about the observability of the human's environment. However, in reality, people make many important…

Machine Learning · Statistics 2021-10-29 Cassidy Laidlaw , Stuart Russell

People increasingly rely on Large Language Models (LLMs) for moral advice, which may influence humans' decisions. Yet, little is known about how closely LLMs align with human moral judgments. To address this, we introduce the Moral Dilemma…

Computation and Language · Computer Science 2025-07-24 Giuseppe Russo , Debora Nozza , Paul Röttger , Dirk Hovy

Current metrics for text-to-image models typically rely on statistical metrics which inadequately represent the real preference of humans. Although recent work attempts to learn these preferences via human annotated images, they reduce the…

Computer Vision and Pattern Recognition · Computer Science 2024-05-24 Sixian Zhang , Bohan Wang , Junqiang Wu , Yan Li , Tingting Gao , Di Zhang , Zhongyuan Wang

Large Language Models (LLMs) are increasingly applied to automate software engineering tasks, including the generation of UML class diagrams from natural language descriptions. While prior work demonstrates that LLMs can produce…

Software Engineering · Computer Science 2026-04-07 Rabia Iftikhar , Andreas Rausch