English

User-Driven Value Alignment: Understanding Users' Perceptions and Strategies for Addressing Biased and Discriminatory Statements in AI Companions

Human-Computer Interaction 2025-02-14 v2

Abstract

Large language model-based AI companions are increasingly viewed by users as friends or romantic partners, leading to deep emotional bonds. However, they can generate biased, discriminatory, and harmful outputs. Recently, users are taking the initiative to address these harms and re-align AI companions. We introduce the concept of user-driven value alignment, where users actively identify, challenge, and attempt to correct AI outputs they perceive as harmful, aiming to guide the AI to better align with their values. We analyzed 77 social media posts about discriminatory AI statements and conducted semi-structured interviews with 20 experienced users. Our analysis revealed six common types of discriminatory statements perceived by users, how users make sense of those AI behaviors, and seven user-driven alignment strategies, such as gentle persuasion and anger expression. We discuss implications for supporting user-driven value alignment in future AI systems, where users and their communities have greater agency.

Keywords

Cite

@article{arxiv.2409.00862,
  title  = {User-Driven Value Alignment: Understanding Users' Perceptions and Strategies for Addressing Biased and Discriminatory Statements in AI Companions},
  author = {Xianzhe Fan and Qing Xiao and Xuhui Zhou and Jiaxin Pei and Maarten Sap and Zhicong Lu and Hong Shen},
  journal= {arXiv preprint arXiv:2409.00862},
  year   = {2025}
}

Comments

19 pages, 1 figure, Accepted by CHI '25