English
Related papers

Related papers: Doubting AI Predictions: Influence-Driven Second O…

200 papers

In many real world contexts, successful human-AI collaboration requires humans to productively integrate complementary sources of information into AI-informed decisions. However, in practice human decision-makers often lack understanding of…

Human-Computer Interaction · Computer Science 2023-01-30 Kenneth Holstein , Maria De-Arteaga , Lakshmi Tumati , Yanghuidi Cheng

How can we design AI tools that effectively support human decision-making by complementing and enhancing users' reasoning processes? Common recommendation-centric approaches face challenges such as inappropriate reliance or a lack of…

Human-Computer Interaction · Computer Science 2025-04-10 Leon Reicherts , Zelun Tony Zhang , Elisabeth von Oswald , Yuanting Liu , Yvonne Rogers , Mariam Hassib

In decision support applications of AI, the AI algorithm's output is framed as a suggestion to a human user. The user may ignore this advice or take it into consideration to modify their decision. With the increasing prevalence of such…

Artificial Intelligence · Computer Science 2022-06-03 Kailas Vodrahalli , Roxana Daneshjou , Tobias Gerstenberg , James Zou

Explainability techniques are rapidly being developed to improve human-AI decision-making across various cooperative work settings. Consequently, previous research has evaluated how decision-makers collaborate with imperfect AI by…

Human-Computer Interaction · Computer Science 2024-05-09 Katelyn Morrison , Philipp Spitzer , Violet Turri , Michelle Feng , Niklas Kühl , Adam Perer

Human-AI complementarity, the idea that combining human and AI judgments can outperform either alone, offers a promising pathway toward robust oversight of advanced AI systems. However, whether human-AI complementarity can be achieved on…

In AI-assisted decision-making, humans often passively review AI's suggestion and decide whether to accept or reject it as a whole. In such a paradigm, humans are found to rarely trigger analytical thinking and face difficulties in…

Human-Computer Interaction · Computer Science 2025-03-13 Shuai Ma , Qiaoyi Chen , Xinru Wang , Chengbo Zheng , Zhenhui Peng , Ming Yin , Xiaojuan Ma

Data-driven algorithmic matching systems promise to help human decision makers make better matching decisions in a wide variety of high-stakes application domains, such as healthcare and social service provision. However, existing systems…

Machine Learning · Computer Science 2025-08-20 Adrian Arnaiz-Rodriguez , Nina Corvelo Benz , Suhas Thejaswi , Nuria Oliver , Manuel Gomez-Rodriguez

AI systems increasingly support human decision-making. In many cases, despite the algorithm's superior performance, the final decision remains in human hands. For example, an AI may assist doctors in determining which diagnostic tests to…

Artificial Intelligence · Computer Science 2026-02-20 Gali Noti , Kate Donahue , Jon Kleinberg , Sigal Oren

Human-AI collaboration has the potential to transform various domains by leveraging the complementary strengths of human experts and Artificial Intelligence (AI) systems. However, unobserved confounding can undermine the effectiveness of…

Human-Computer Interaction · Computer Science 2025-02-27 Ruijiang Gao , Mingzhang Yin

Human-machine complementarity is important when neither the algorithm nor the human yield dominant performance across all instances in a given domain. Most research on algorithmic decision-making solely centers on the algorithm's…

Human-Computer Interaction · Computer Science 2021-12-14 Ruijiang Gao , Maytal Saar-Tsechansky , Maria De-Arteaga , Ligong Han , Min Kyung Lee , Matthew Lease

In many practical applications of AI, an AI model is used as a decision aid for human users. The AI provides advice that a human (sometimes) incorporates into their decision-making process. The AI advice is often presented with some measure…

Artificial Intelligence · Computer Science 2022-10-31 Kailas Vodrahalli , Tobias Gerstenberg , James Zou

People's decision-making abilities often fail to improve or may even erode when they rely on AI for decision-support, even when the AI provides informative explanations. We argue this is partly because people intuitively seek contrastive…

Human-Computer Interaction · Computer Science 2025-03-20 Zana Buçinca , Siddharth Swaroop , Amanda E. Paluch , Finale Doshi-Velez , Krzysztof Z. Gajos

Many important decisions in daily life are made with the help of advisors, e.g., decisions about medical treatments or financial investments. Whereas in the past, advice has often been received from human experts, friends, or family,…

Human-Computer Interaction · Computer Science 2022-04-15 Max Schemmer , Patrick Hemmer , Niklas Kühl , Carina Benz , Gerhard Satzger

As artificial intelligence (AI) systems play an increasingly prominent role in human decision-making, challenges surface in the realm of human-AI interactions. One challenge arises from the suboptimal AI policies due to the inadequate…

Machine Learning · Statistics 2024-03-22 Guanting Chen , Xiaocheng Li , Chunlin Sun , Hanzhao Wang

Existing approaches to algorithmic fairness aim to ensure equitable outcomes if human decision-makers comply perfectly with algorithmic decisions. However, perfect compliance with the algorithm is rarely a reality or even a desirable…

Machine Learning · Computer Science 2025-07-01 Haosen Ge , Hamsa Bastani , Osbert Bastani

The collaboration between humans and artificial intelligence (AI) holds the promise of achieving superior outcomes compared to either acting alone-a phenomenon called human-AI synergy. Nevertheless, our understanding of the conditions that…

We develop a decision-theoretic model of human-AI interaction to study when AI assistance improves or impairs human decision-making. A human decision-maker observes private information and receives a recommendation from an AI system, but…

Computer Science and Game Theory · Computer Science 2026-02-17 Saurabh Amin , Amine Bennouna , Daniel Huttenlocher , Dingwen Kong , Liang Lyu , Asuman Ozdaglar

Machine learning (ML) models are increasingly being used in application domains that often involve working together with human experts. In this context, it can be advantageous to defer certain instances to a single human expert when they…

Artificial Intelligence · Computer Science 2022-06-17 Patrick Hemmer , Sebastian Schellhammer , Michael Vössing , Johannes Jakubik , Gerhard Satzger

Joint human-AI inference holds immense potential to improve outcomes in human-supervised robot missions. Current day missions are generally in the AI-assisted setting, where the human operator makes the final inference based on the AI…

Human-Computer Interaction · Computer Science 2025-08-06 Duc-An Nguyen , Clara Colombatto , Steve Fleming , Ingmar Posner , Nick Hawes , Raunak Bhattacharyya

. It is typically assumed that for the successful use of machine learning algorithms, these algorithms should have a higher accuracy than a human expert. Moreover, if the average accuracy of ML algorithms is lower than that of a human…

Human-Computer Interaction · Computer Science 2024-11-19 Saveli Goldberg , Lev Salnikov , Noor Kaiser , Tushar Srivastava , Eugene Pinsky