English
Related papers

Related papers: Personalization Aids Pluralistic Alignment Under C…

200 papers

Whenever an AI model is used to predict a relevant (binary) outcome in AI-assisted decision making, it is widely agreed that, together with each prediction, the model should provide an AI confidence value. However, it has been unclear why…

Artificial Intelligence · Computer Science 2025-01-27 Nina L. Corvelo Benz , Manuel Gomez Rodriguez

Current alignment pipelines presume a single, universal notion of desirable behavior. However, human preferences often diverge across users, contexts, and cultures. As a result, disagreement collapses into the majority signal and minority…

Machine Learning · Computer Science 2025-06-10 Daniel Halpern , Evi Micha , Ariel D. Procaccia , Itai Shapira

Conventional automated decision-support systems often prioritize predictive accuracy, overlooking the complexities of real-world settings where stakeholders' preferences may diverge or conflict. This can lead to outcomes that disadvantage…

Machine Learning · Computer Science 2025-11-25 Vittoria Vineis , Giuseppe Perelli , Gabriele Tolomei

Recommender systems are personalized: we expect the results given to a particular user to reflect that user's preferences. Some researchers have studied the notion of calibration, how well recommendations match users' stated preferences,…

Information Retrieval · Computer Science 2019-09-17 Kun Lin , Nasim Sonboli , Bamshad Mobasher , Robin Burke

Given that there are a variety of stakeholders involved in, and affected by, decisions from machine learning (ML) models, it is important to consider that different stakeholders have different transparency needs. Previous work found that…

Human-Computer Interaction · Computer Science 2021-06-02 Ana Lucic , Madhulika Srikumar , Umang Bhatt , Alice Xiang , Ankur Taly , Q. Vera Liao , Maarten de Rijke

Appropriate reliance is critical to achieving synergistic human-AI collaboration. For instance, when users over-rely on AI assistance, their human-AI team performance is bounded by the model's capability. This work studies how the…

Human-Computer Interaction · Computer Science 2024-01-17 Shiye Cao , Anqi Liu , Chien-Ming Huang

AI alignment is about ensuring AI systems only pursue goals and activities that are beneficial to humans. Most of the current approach to AI alignment is to learn what humans value from their behavioural data. This paper proposes a…

Artificial Intelligence · Computer Science 2023-10-06 Pei-Yu Chen , Myrthe L. Tielman , Dirk K. J. Heylen , Catholijn M. Jonker , M. Birna van Riemsdijk

This paper considers the problem of how to allocate power among competing users sharing a frequency-selective interference channel. We model the interaction between selfish users as a non-cooperative game. As opposed to the existing…

Computer Science and Game Theory · Computer Science 2008-12-16 Yi Su , Mihaela van der Schaar

Ensuring AI models align with human values is essential for their safety and functionality. Reinforcement learning from human feedback (RLHF) leverages human preferences to achieve this alignment. However, when preferences are sourced from…

Machine Learning · Computer Science 2025-02-10 Ryan Bahlous-Boldi , Li Ding , Lee Spector , Scott Niekum

Just as people improve decision-making by consulting diverse human advisors, they can now also consult with multiple AI systems. Prior work on group decision-making shows that advice aggregation creates pressure to conform, leading to…

Human-Computer Interaction · Computer Science 2026-03-24 Yuta Tsuchiya , Yukino Baba

As AI systems become embedded in everyday practice, value misalignment has emerged as a pressing concern. Yet, dominant alignment approaches remain model centric, treating users as passive recipients of prespecified values rather than as…

Human-Computer Interaction · Computer Science 2026-04-22 Anne Arzberger , Enrico Liscio , Maria Luce Lupetti , Inigo Martinez de Rituerto de Troya , Jie Yang

As machine learning algorithms increasingly influence critical decision making in different application areas, understanding human strategic behavior in response to these systems becomes vital. We explore individuals' choice between…

Machine Learning · Computer Science 2026-03-17 Sura Alhanouti , Parinaz Naghizadeh

With AI systems becoming more powerful and pervasive, there is increasing debate about keeping their actions aligned with the broader goals and needs of humanity. This multi-disciplinary and multi-stakeholder debate must resolve many…

Artificial Intelligence · Computer Science 2021-12-21 Koen Holtman

Data is the new oil; this refrain is repeated extensively in the age of internet tracking, machine learning, and data analytics. As data collection becomes more personal and pervasive, however, public pressure is mounting for privacy…

Computer Science and Game Theory · Computer Science 2016-12-09 Jeffrey Pawlick , Quanyan Zhu

When organisations adopt commercial AI systems for decision support, they inherit value judgements embedded by vendors that are neither transparent nor renegotiable. The governance puzzle is not whether AI can support decisions but which…

Artificial Intelligence · Computer Science 2026-03-24 Taejin Park

Human-AI collaboration for decision-making strives to achieve team performance that exceeds the performance of humans or AI alone. However, many factors can impact success of Human-AI teams, including a user's domain expertise, mental…

Algorithmic predictions are increasingly used to inform the allocation of scarce resources. The promise of these methods is that, through machine learning, they can better identify the people who would benefit most from interventions.…

Cryptography and Security · Computer Science 2026-04-24 Ben Jacobsen , Nitin Kohli

Large language models (LLMs) are currently aligned using techniques such as reinforcement learning from human feedback (RLHF). However, these methods use scalar rewards that can only reflect user preferences on average. Pluralistic…

Computation and Language · Computer Science 2025-08-13 Jadie Adams , Brian Hu , Emily Veenhuis , David Joy , Bharadwaj Ravichandran , Aaron Bray , Anthony Hoogs , Arslan Basharat

Ranking plays a central role in connecting users and providers in Information Retrieval (IR) systems, making provider-side fairness an important challenge. While recent research has begun to address fairness in ranking, most existing…

Information Retrieval · Computer Science 2026-02-03 Yiteng Tu , Weihang Su , Shuguang Han , Yiqun Liu , Qingyao Ai

Individuals often navigate several options with incomplete knowledge of their own preferences. Information provisioning tools such as public rankings and personalized recommendations have become central to helping individuals make choices,…

Theoretical Economics · Economics 2025-06-05 Omar Besbes , Yash Kanoria , Akshit Kumar