English
Related papers

Related papers: Effect of Confidence and Explanation on Accuracy a…

200 papers

Artificial intelligence (AI) provides considerable opportunities to assist human work. However, one crucial challenge of human-AI collaboration is that many AI algorithms operate in a black-box manner where the way how the AI makes…

Human-Computer Interaction · Computer Science 2024-06-13 Julian Senoner , Simon Schallmoser , Bernhard Kratzwald , Stefan Feuerriegel , Torbjørn Netland

AI assistance in decision-making has become popular, yet people's inappropriate reliance on AI often leads to unsatisfactory human-AI collaboration performance. In this paper, through three pre-registered, randomized human subject…

Human-Computer Interaction · Computer Science 2024-01-17 Zhuoran Lu , Dakuo Wang , Ming Yin

Displaying confidence scores in human-AI interaction has been shown to help build trust between humans and AI systems. However, most existing research uses only the confidence score as a form of communication. As confidence scores are just…

Artificial Intelligence · Computer Science 2023-03-13 Thao Le , Tim Miller , Ronal Singh , Liz Sonenberg

Explainability techniques are rapidly being developed to improve human-AI decision-making across various cooperative work settings. Consequently, previous research has evaluated how decision-makers collaborate with imperfect AI by…

Human-Computer Interaction · Computer Science 2024-05-09 Katelyn Morrison , Philipp Spitzer , Violet Turri , Michelle Feng , Niklas Kühl , Adam Perer

Powerful predictive AI systems have demonstrated great potential in augmenting human decision making. Recent empirical work has argued that the vision for optimal human-AI collaboration requires 'appropriate reliance' of humans on AI…

Artificial Intelligence · Computer Science 2024-09-24 Gaole He , Abri Bharos , Ujwal Gadiraju

Recommender systems, while a powerful decision making tool, are often operationalized as black box models, such that their AI algorithms are not accessible or interpretable by human operators. This in turn can cause confusion and…

Human-Computer Interaction · Computer Science 2024-09-18 Divya Srivastava , Karen M. Feigh

Amid ongoing policy and managerial debates on keeping humans in the loop of AI decision-making, we investigate whether human involvement in AI-based service production benefits downstream consumers. Partnering with a large savings bank in…

General Economics · Economics 2025-06-05 Cathy , Yang , Kevin Bauer , Xitong Li , Oliver Hinz

Studies show that interactions with an AI system fosters trust in human users towards AI. An often overlooked element of such interaction dynamics is the (sense of) urgency when the human user is prompted by an AI agent, e.g., for advice or…

Artificial Intelligence · Computer Science 2026-04-10 Baran Shajari , Xiaoran Liu , Kyanna Dagenais , Istvan David

The unprecedented performance of machine learning models in recent years, particularly Deep Learning and transformer models, has resulted in their application in various domains such as finance, healthcare, and education. However, the…

Human-Computer Interaction · Computer Science 2023-12-20 Milad Rogha

Effective human-AI collaboration requires humans to accurately gauge AI capabilities and calibrate their trust accordingly. Humans often have context-dependent private information, referred to as Unique Human Knowledge (UHK), that is…

Human-Computer Interaction · Computer Science 2025-11-07 Zenan Chen , Ruijiang Gao , Yingzhi Liang

Trust calibration is necessary to ensure appropriate user acceptance in advanced automation technologies. A significant challenge to achieve trust calibration is to quantitatively estimate human trust in real-time. Although multiple trust…

Human-Computer Interaction · Computer Science 2023-04-17 Jundi Liu , Kumar Akash , Teruhisa Misu , Xingwei Wu

People work with AI systems to improve their decision making, but often under- or over-rely on AI predictions and perform worse than they would have unassisted. To help people appropriately rely on AI aids, we propose showing them behavior…

Human-Computer Interaction · Computer Science 2023-01-18 Ángel Alexander Cabrera , Adam Perer , Jason I. Hong

As artificial intelligence (AI) systems, particularly large language models (LLMs), become increasingly integrated into decision-making processes, the ability to trust their outputs is crucial. To earn human trust, LLMs must be well…

Machine Learning · Computer Science 2025-02-14 Mark Steyvers , Heliodoro Tejeda , Aakriti Kumar , Catarina Belem , Sheer Karny , Xinyue Hu , Lukas Mayer , Padhraic Smyth

Machine learning models are increasingly integrated into societally critical applications such as recidivism prediction and medical diagnosis, thanks to their superior predictive power. In these applications, however, full automation is…

Human-Computer Interaction · Computer Science 2020-03-18 Vivian Lai , Samuel Carton , Chenhao Tan

Artificial Intelligence (AI) is often an integral part of modern decision support systems. The best-performing predictive models used in AI-based decision support systems lack transparency. Explainable Artificial Intelligence (XAI) aims to…

Machine Learning · Computer Science 2025-02-25 Tuwe Löfström , Helena Löfström , Ulf Johansson , Cecilia Sönströd , Rudy Matela

AI explanations are often mentioned as a way to improve human-AI decision-making, but empirical studies have not found consistent evidence of explanations' effectiveness and, on the contrary, suggest that they can increase overreliance when…

Human-Computer Interaction · Computer Science 2023-06-16 Valerie Chen , Q. Vera Liao , Jennifer Wortman Vaughan , Gagan Bansal

In settings where users both need high accuracy and are time-pressured, such as doctors working in emergency rooms, we want to provide AI assistance that both increases decision accuracy and reduces decision-making time. Current literature…

Human-Computer Interaction · Computer Science 2024-02-13 Siddharth Swaroop , Zana Buçinca , Krzysztof Z. Gajos , Finale Doshi-Velez

AI design characteristics and human personality traits each impact the quality and outcomes of human-AI interactions. However, their relative and joint impacts are underexplored in imperfectly cooperative scenarios, where people and AI only…

Computation and Language · Computer Science 2026-04-20 Myke C. Cohen , Mingqian Zheng , Neel Bhandari , Hsien-Te Kao , Xuhui Zhou , Daniel Nguyen , Laura Cassani , Maarten Sap , Svitlana Volkova

AI systems increasingly assist human decision making by producing preliminary assessments of complex inputs. However, such AI-generated assessments can often be noisy or systematically biased, raising a central question: how should costly…

Machine Learning · Statistics 2026-03-17 Lezhi Tan , Naomi Sagan , Lihua Lei , Jose Blanchet

AI systems increasingly support human decision-making. In many cases, despite the algorithm's superior performance, the final decision remains in human hands. For example, an AI may assist doctors in determining which diagnostic tests to…

Artificial Intelligence · Computer Science 2026-02-20 Gali Noti , Kate Donahue , Jon Kleinberg , Sigal Oren