English
Related papers

Related papers: Evaluating Large Language Models for Fair and Reli…

200 papers

The rapid integration of Large Language Models (LLMs) in high-stakes decision-making -- such as allocating scarce resources like donor organs -- raises critical questions about their alignment with human moral values. We systematically…

Computers and Society · Computer Science 2026-04-21 John P. Dickerson , Hadi Hosseini , Samarth Khanna , Leona Pierce

Large Language Models (LLMs) have emerged as promising solutions for a variety of medical and clinical decision support applications. However, LLMs are often subject to different types of biases, which can lead to unfair treatment of…

Computation and Language · Computer Science 2024-08-23 Raphael Poulain , Hamed Fayyaz , Rahmatollah Beheshti

Kidney transplantation is the preferred treatment for end-stage renal disease, yet the scarcity of donors and inefficiencies in allocation systems create major bottlenecks, resulting in prolonged wait times and alarming mortality rates.…

Computer Science and Game Theory · Computer Science 2024-10-15 Sean Berry , Berk Gorgulu , Sait Tunc , Mucahit Cevik , Matthew J Ellis

AI algorithms increasingly make decisions that impact entire groups of humans. Since humans tend to hold varying and even conflicting preferences, AI algorithms responsible for making decisions on behalf of such groups encounter the problem…

Artificial Intelligence · Computer Science 2020-06-18 Rachel Freedman

The efficient and fair allocation of limited resources is a classical problem in economics and computer science. In kidney exchanges, a central market maker allocates living kidney donors to patients in need of an organ. Patients and donors…

Artificial Intelligence · Computer Science 2020-05-21 Rachel Freedman , Jana Schaich Borg , Walter Sinnott-Armstrong , John P. Dickerson , Vincent Conitzer

The growing interest in employing large language models (LLMs) for decision-making in social and economic contexts has raised questions about their potential to function as agents in these domains. A significant number of societal problems…

Computer Science and Game Theory · Computer Science 2025-11-25 Hadi Hosseini , Samarth Khanna

Recently, Large Language Models (LLMs) have demonstrated a superior ability to serve as ranking models. However, concerns have arisen as LLMs will exhibit discriminatory ranking behaviors based on users' sensitive attributes (\eg gender).…

Information Retrieval · Computer Science 2024-09-26 Chen Xu , Wenjie Wang , Yuxin Li , Liang Pang , Jun Xu , Tat-Seng Chua

This paper studies the performance of large language models (LLMs), particularly regarding demographic fairness, in solving real-world healthcare tasks. We evaluate state-of-the-art LLMs with three prevalent learning frameworks across six…

Computation and Language · Computer Science 2024-12-10 Yue Zhou , Barbara Di Eugenio , Lu Cheng

Large Language Models (LLMs) have shown powerful performance and development prospects and are widely deployed in the real world. However, LLMs can capture social biases from unprocessed training data and propagate the biases to downstream…

Computation and Language · Computer Science 2024-02-22 Yingji Li , Mengnan Du , Rui Song , Xin Wang , Ying Wang

Large Language Models (LLMs) have demonstrated remarkable success across various domains. However, despite their promising performance in numerous real-world applications, most of these algorithms lack fairness considerations. Consequently,…

Computation and Language · Computer Science 2024-12-20 Zhibo Chu , Zichong Wang , Wenbin Zhang

Kidney exchange programs have substantially increased transplantation rates but also raise critical concerns about fairness in organ allocation. We propose a novel framework leveraging Data Envelopment Analysis (DEA) to evaluate multiple…

Computers and Society · Computer Science 2025-12-09 Ali Kaazempur-Mofrad , Xiaowu Dai

The integration of Large Language Models (LLMs) in information retrieval has raised a critical reevaluation of fairness in the text-ranking models. LLMs, such as GPT models and Llama2, have shown effectiveness in natural language…

Information Retrieval · Computer Science 2024-06-27 Yuan Wang , Xuyang Wu , Hsin-Tai Wu , Zhiqiang Tao , Yi Fang

Regression-based predictive analytics used in modern kidney transplantation is known to inherit biases from training data. This leads to social discrimination and inefficient organ utilization, particularly in the context of a few social…

Human-Computer Interaction · Computer Science 2025-05-13 Mukund Telukunta , Venkata Sriram Siddhardh Nadendla , Morgan Stuart , Casey Canfield

As large language models (LLMs) become integral to intelligent user interfaces (IUIs), their role as decision-making agents raises critical concerns about alignment. Although extensive research has addressed issues such as factuality, bias,…

Artificial Intelligence · Computer Science 2025-04-23 Anna Karnysheva , Christian Drescher , Dietrich Klakow

A surge of recent work explores the ethical and societal implications of large-scale AI models that make "moral" judgments. Much of this literature focuses either on alignment with human judgments through various thought experiments or on…

Computers and Society · Computer Science 2025-09-05 Gaurab Pokharel , Shafkat Farabi , Patrick J. Fowler , Sanmay Das

The allocation of scarce donor organs constitutes one of the most consequential algorithmic challenges in healthcare. While the field is rapidly transitioning from rigid, rule-based systems to machine learning and data-driven optimization,…

Machine Learning · Computer Science 2026-05-27 Ioannis Anagnostides , Itai Zilberstein , Zachary W. Sollie , Arman Kilic , Tuomas Sandholm

General-purpose Large Language Models (LLMs) show significant potential in recruitment applications, where decisions require reasoning over unstructured text, balancing multiple criteria, and inferring fit and competence from indirect…

Computation and Language · Computer Science 2026-01-19 Morgane Hoffmann , Emma Jouffroy , Warren Jouanneau , Marc Palyart , Charles Pebereau

A kidney transplant can improve the life expectancy and quality of life of patients with end-stage renal failure. Even more patients could be helped with a transplant if the rate of kidneys that are discarded and not transplanted could be…

Bias and fairness risks in Large Language Models (LLMs) vary substantially across deployment contexts, yet existing approaches lack systematic guidance for selecting appropriate evaluation metrics. We present a decision framework that maps…

Computation and Language · Computer Science 2026-05-12 Dylan Bouchard

LLMs are increasingly used to boost productivity and support software engineering tasks. However, when applied to socially sensitive decisions such as team composition and task allocation, they raise concerns of fairness. Prior studies have…

‹ Prev 1 2 3 10 Next ›