English
Related papers

Related papers: Interactive AI Alignment: Specification, Process, …

200 papers

In AI-assisted decision-making, humans often passively review AI's suggestion and decide whether to accept or reject it as a whole. In such a paradigm, humans are found to rarely trigger analytical thinking and face difficulties in…

Human-Computer Interaction · Computer Science 2025-03-13 Shuai Ma , Qiaoyi Chen , Xinru Wang , Chengbo Zheng , Zhenhui Peng , Ming Yin , Xiaojuan Ma

Complementary collaboration between humans and AI is essential for human-AI decision making. One feasible approach to achieving it involves accounting for the calibrated confidence levels of both AI and users. However, this process would…

Human-Computer Interaction · Computer Science 2025-12-08 Jingshu Li , Yitian Yang , Q. Vera Liao , Junti Zhang , Yi-Chieh Lee

Despite recent advances in the field of explainable artificial intelligence systems, a concrete quantitative measure for evaluating the usability of such systems is nonexistent. Ensuring the success of an explanatory interface in…

Human-Computer Interaction · Computer Science 2020-10-26 Byung Hyung Kim , Seunghun Koh , Sejoon Huh , Sungho Jo , Sunghee Choi

Interactions with AI assistants are increasingly personalized to individual users. As AI personalization is dynamic and machine-learning-driven, we have limited understanding of how personalization affects interaction outcomes and user…

Human-Computer Interaction · Computer Science 2026-02-18 Maximilian Eder , Clemens Lechner , Maurice Jakesch

With increased power and prevalence of AI systems, it is ever more critical that AI systems are designed to serve all, i.e., people with diverse values and perspectives. However, aligning models to serve pluralistic human values remains an…

Understanding the dynamics of human-AI interaction in question answering is crucial for enhancing collaborative efficiency. Extending from our initial formative study, which revealed challenges in human utilization of conversational AI…

Human-Computer Interaction · Computer Science 2025-09-01 Jaeyoon Song , Zahra Ashktorab , Qian Pan , Casey Dugan , Werner Geyer , Thomas W. Malone

In human-AI decision making, designing AI that complements human expertise has been a natural strategy to enhance human-AI collaboration, yet it often comes at the cost of decreased AI performance in areas of human strengths. This can…

Artificial Intelligence · Computer Science 2026-02-24 Hasan Amin , Ming Yin , Rajiv Khanna

Recent advances in AI -- including generative approaches -- have resulted in technology that can support humans in scientific discovery and forming decisions, but may also disrupt democracies and target individuals. The responsible use of…

AI alignment considers how we can encode AI systems in a way that is compatible with human values. The normative side of this problem asks what moral values or principles, if any, we should encode in AI. To this end, we present a framework…

Computers and Society · Computer Science 2023-01-11 Betty Li Hou , Brian Patrick Green

We describe cases where real recommender systems were modified in the service of various human values such as diversity, fairness, well-being, time well spent, and factual accuracy. From this we identify the current practice of values…

Information Retrieval · Computer Science 2021-07-26 Jonathan Stray , Ivan Vendrov , Jeremy Nixon , Steven Adler , Dylan Hadfield-Menell

The applications of generative AI have become extremely impressive, and the interplay between users and AI is even more so. Current human-AI interaction literature has taken a broad look at how humans interact with generative AI, but it…

Conversational AI systems are becoming famous in day to day lives. In this paper, we are trying to address the following key question: To identify whether design, as well as development efforts for search oriented conversational AI are…

Artificial Intelligence · Computer Science 2017-09-15 Mahipal Jadeja , Neelanshi Varia

The dominant practice of AI alignment assumes (1) that preferences are an adequate representation of human values, (2) that human rationality can be understood in terms of maximizing the satisfaction of preferences, and (3) that AI systems…

Artificial Intelligence · Computer Science 2024-11-12 Tan Zhi-Xuan , Micah Carroll , Matija Franklin , Hal Ashton

Conversational human-likeness plays a central role in human-AI interaction, yet it has remained difficult to define, measure, and optimize. As a result, improvements in human-like behavior are largely driven by scale or broad supervised…

Artificial Intelligence · Computer Science 2026-01-08 Masum Hasan , Junjie Zhao , Ehsan Hoque

Today, AI is increasingly being used in many high-stakes decision-making applications in which fairness is an important concern. Already, there are many examples of AI being biased and making questionable and unfair decisions. The AI…

Artificial Intelligence · Computer Science 2020-02-06 Yunfeng Zhang , Rachel K. E. Bellamy , Kush R. Varshney

From its inception, AI has had a rather ambivalent relationship with humans -- swinging between their augmentation and replacement. Now, as AI technologies enter our everyday lives at an ever increasing pace, there is a greater need for AI…

Artificial Intelligence · Computer Science 2024-05-28 Sarath Sreedharan , Anagha Kulkarni , Subbarao Kambhampati

Beneficial societal outcomes cannot be guaranteed by aligning individual AI systems with the intentions of their operators or users. Even an AI system that is perfectly aligned to the intentions of its operating organization can lead to bad…

Human decision makers increasingly delegate choices to AI agents, raising a natural question: does the AI implement the human principal's preferences or pursue its own? To study this question using revealed preference techniques, I…

Theoretical Economics · Economics 2026-03-31 Elchin Suleymanov

Value alignment is essential for building AI systems that can safely and reliably interact with people. However, what a person values -- and is even capable of valuing -- depends on the concepts that they are currently using to understand…

Artificial Intelligence · Computer Science 2023-11-01 Sunayana Rane , Mark Ho , Ilia Sucholutsky , Thomas L. Griffiths

The emergence of generative AI (GenAI) models, including large language models and text-to-image models, has significantly advanced the synergy between humans and AI with not only their outstanding capability but more importantly, the…

Human-Computer Interaction · Computer Science 2025-03-05 Leixian Shen , Haotian Li , Yifang Wang , Xing Xie , Huamin Qu