English
Related papers

Related papers: When Thinking Pays Off: Incentive Alignment for Hu…

200 papers

Artificial intelligence (AI) is increasingly being considered to assist human decision-making in high-stake domains (e.g. health). However, researchers have discussed an issue that humans can over-rely on wrong suggestions of the AI model…

Human-Computer Interaction · Computer Science 2023-08-09 Min Hun Lee , Chong Jun Chew

Existing approaches to algorithmic fairness aim to ensure equitable outcomes if human decision-makers comply perfectly with algorithmic decisions. However, perfect compliance with the algorithm is rarely a reality or even a desirable…

Machine Learning · Computer Science 2025-07-01 Haosen Ge , Hamsa Bastani , Osbert Bastani

Many domains now employ AI-based decision-making aids, and although the potential for AI systems to assist with decision making is much discussed, human-AI collaboration often underperforms due to factors such as (mis)trust in the AI system…

Human-Computer Interaction · Computer Science 2025-08-25 Nikita Haduong , Noah A. Smith

Several strands of research have aimed to bridge the gap between artificial intelligence (AI) and human decision-makers in AI-assisted decision-making, where humans are the consumers of AI model predictions and the ultimate decision-makers…

Human-Computer Interaction · Computer Science 2022-04-06 Charvi Rastogi , Yunfeng Zhang , Dennis Wei , Kush R. Varshney , Amit Dhurandhar , Richard Tomsett

Human feedback is critical for aligning AI systems to human values. As AI capabilities improve and AI is used to tackle more challenging tasks, verifying quality and safety becomes increasingly challenging. This paper explores how we can…

Artificial Intelligence · Computer Science 2025-10-31 Rishub Jain , Sophie Bridgers , Lili Janzer , Rory Greig , Tian Huey Teh , Vladimir Mikulik

A rising vision for AI in the open world centers on the development of systems that can complement humans for perceptual, diagnostic, and reasoning tasks. To date, systems aimed at complementing the skills of people have employed models…

Artificial Intelligence · Computer Science 2020-05-05 Bryan Wilder , Eric Horvitz , Ece Kamar

As AI becomes more prevalent throughout society, effective methods of integrating humans and AI systems that leverage their respective strengths and mitigate risk have become an important priority. In this paper, we introduce the paradigm…

Machine Learning · Computer Science 2023-10-24 Jiayi Wang , Zhengling Qi , Chengchun Shi

Many researchers motivate explainable AI with studies showing that human-AI team performance on decision-making tasks improves when the AI explains its recommendations. However, prior studies observed improvements from explanations only…

Artificial Intelligence · Computer Science 2021-01-14 Gagan Bansal , Tongshuang Wu , Joyce Zhou , Raymond Fok , Besmira Nushi , Ece Kamar , Marco Tulio Ribeiro , Daniel S. Weld

Given that Artificial Intelligence (AI) increasingly permeates our lives, it is critical that we systematically align AI objectives with the goals and values of humans. The human-AI alignment problem stems from the impracticality of…

Computers and Society · Computer Science 2022-07-05 John Nay , James Daily

Decision-making is increasingly supported by machine recommendations. In healthcare, for example, a clinical decision support system is used by the physician to find a treatment option for a patient. In doing so, people can rely too much on…

Human-Computer Interaction · Computer Science 2024-09-17 Simon WS Fischer

Artificial intelligence (AI) systems are increasingly used for providing advice to facilitate human decision making in a wide range of domains, such as healthcare, criminal justice, and finance. Motivated by limitations of the current…

Artificial Intelligence · Computer Science 2023-07-04 Gali Noti , Yiling Chen

Despite the growing interest in collaborative AI, designing systems that seamlessly integrate human input remains a major challenge. In this study, we developed a task to systematically examine human preferences for collaborative agents. We…

Artificial Intelligence · Computer Science 2025-10-28 Lukas William Mayer , Sheer Karny , Jackie Ayoub , Miao Song , Danyang Tian , Ehsan Moradi-Pari , Mark Steyvers

The use of Artificial Intelligence (AI), or more generally data-driven algorithms, has become ubiquitous in today's society. Yet, in many cases and especially when stakes are high, humans still make final decisions. The critical question,…

Artificial Intelligence · Computer Science 2024-10-15 Eli Ben-Michael , D. James Greiner , Melody Huang , Kosuke Imai , Zhichao Jiang , Sooahn Shin

Artificial Intelligence (AI) is advancing at an unprecedented pace, with clear potential to enhance decision-making and productivity. Yet, the collaborative decision-making process between humans and AI remains underdeveloped, often falling…

Human-Computer Interaction · Computer Science 2025-04-10 Bowen Lou , Tian Lu , T. S. Raghu , Yingjie Zhang

In AI-assisted decision-making, it is critical for human decision-makers to know when to trust AI and when to trust themselves. However, prior studies calibrated human trust only based on AI confidence indicating AI's correctness likelihood…

Human-Computer Interaction · Computer Science 2023-01-18 Shuai Ma , Ying Lei , Xinru Wang , Chengbo Zheng , Chuhan Shi , Ming Yin , Xiaojuan Ma

Generative AI is quickly becoming an integral part of people's everyday workflows. Early evidence has shown that while generative AI can increase individual-level productivity, it does so at the cost of collective diversity, potentially…

Human-Computer Interaction · Computer Science 2026-04-07 Nathanael Jo , Manish Raghavan

According to several empirical investigations, despite enhancing human capabilities, human-AI cooperation frequently falls short of expectations and fails to reach true synergy. We propose a task-driven framework that reverses prevalent…

Computers and Society · Computer Science 2026-05-26 Saleh Afroogh , Kush R. Varshney , Jason D'Cruz

Scientists and philosophers have debated whether humans can trust advanced artificial intelligence (AI) agents to respect humanity's best interests. Yet what about the reverse? Will advanced AI agents trust humans? Gauging an AI agent's…

Artificial Intelligence · Computer Science 2022-12-29 Tim Johnson , Nick Obradovich

Effective human-AI collaboration for physical task completion has significant potential in both everyday activities and professional domains. AI agents equipped with informative guidance can enhance human performance, but evaluating such…

Computer Vision and Pattern Recognition · Computer Science 2025-07-25 Filippos Bellos , Yayuan Li , Cary Shu , Ruey Day , Jeffrey M. Siskind , Jason J. Corso

In AI-assisted decision-making, humans often passively review AI's suggestion and decide whether to accept or reject it as a whole. In such a paradigm, humans are found to rarely trigger analytical thinking and face difficulties in…

Human-Computer Interaction · Computer Science 2025-03-13 Shuai Ma , Qiaoyi Chen , Xinru Wang , Chengbo Zheng , Zhenhui Peng , Ming Yin , Xiaojuan Ma