English
Related papers

Related papers: A Decision Theoretic Framework for Measuring AI Re…

200 papers

In this work, we empirically examine human-AI decision-making in the presence of explanations based on predicted outcomes. This type of explanation provides a human decision-maker with expected consequences for each decision alternative at…

Human-Computer Interaction · Computer Science 2022-08-31 Johannes Jakubik , Jakob Schöffer , Vincent Hoge , Michael Vössing , Niklas Kühl

Algorithms frequently assist, rather than replace, human decision-makers. However, the design and analysis of algorithms often focus on predicting outcomes and do not explicitly model their effect on human decisions. This discrepancy…

Human-Computer Interaction · Computer Science 2024-10-31 Bryce McLaughlin , Jann Spiess

Decision-making with information displays is a key focus of research in areas like human-AI collaboration and data visualization. However, what constitutes a decision problem, and what is required for an experiment to conclude that…

Human-Computer Interaction · Computer Science 2025-05-05 Jessica Hullman , Alex Kale , Jason Hartline

The increasing availability and use of artificial intelligence (AI) tools in educational settings has raised concerns about students' overreliance on these technologies. Overreliance occurs when individuals accept incorrect AI-generated…

Computers and Society · Computer Science 2025-06-18 Griffin Pitts , Neha Rani , Weedguet Mildort , Eva-Marie Cook

Evaluating the efficiency of human-AI interactions is challenging, including subjective and objective quality aspects. With the focus on the human experience of the explanations, evaluations of explanation methods have become mostly…

Artificial Intelligence · Computer Science 2024-05-10 Helena Löfström

Appropriate Trust in Artificial Intelligence (AI) systems has rapidly become an important area of focus for both researchers and practitioners. Various approaches have been used to achieve it, such as confidence scores, explanations,…

Human-Computer Interaction · Computer Science 2023-11-14 Siddharth Mehrotra , Chadha Degachi , Oleksandra Vereschak , Catholijn M. Jonker , Myrthe L. Tielman

AI predictive systems are increasingly embedded in decision making pipelines, shaping high stakes choices once made solely by humans. Yet robust decisions under uncertainty still rely on capabilities that current AI lacks: domain knowledge…

Artificial Intelligence · Computer Science 2025-10-28 Sima Noorani , Shayan Kiyani , George Pappas , Hamed Hassani

In AI-assisted decision-making, it is crucial but challenging for humans to achieve appropriate reliance on AI. This paper approaches this problem from a human-centered perspective, "human self-confidence calibration". We begin by proposing…

Human-Computer Interaction · Computer Science 2024-03-15 Shuai Ma , Xinru Wang , Ying Lei , Chuhan Shi , Ming Yin , Xiaojuan Ma

Complementary collaboration between humans and AI is essential for human-AI decision making. One feasible approach to achieving it involves accounting for the calibrated confidence levels of both AI and users. However, this process would…

Human-Computer Interaction · Computer Science 2025-12-08 Jingshu Li , Yitian Yang , Q. Vera Liao , Junti Zhang , Yi-Chieh Lee

AI systems increasingly assist human decision making by producing preliminary assessments of complex inputs. However, such AI-generated assessments can often be noisy or systematically biased, raising a central question: how should costly…

Machine Learning · Statistics 2026-03-17 Lezhi Tan , Naomi Sagan , Lihua Lei , Jose Blanchet

In AI-assisted decision-making, it is critical for human decision-makers to know when to trust AI and when to trust themselves. However, prior studies calibrated human trust only based on AI confidence indicating AI's correctness likelihood…

Human-Computer Interaction · Computer Science 2023-01-18 Shuai Ma , Ying Lei , Xinru Wang , Chengbo Zheng , Chuhan Shi , Ming Yin , Xiaojuan Ma

AI systems are fallible, and humans can make mistakes in deciding whether to trust AI over their own judgment. Thus, improving human-AI collaboration requires understanding when, why, and how humans decide to rely on AI. We study two…

Artificial Intelligence · Computer Science 2026-05-28 Maharshi Gor , Yoo Yeon Sung , Yu Hou , Eve Fleisig , Irene Ying , Tianyi Zhou , Jordan Boyd-Graber

As AI-based clinical decision support (AI-CDS) is introduced in more and more aspects of healthcare services, HCI research plays an increasingly important role in designing for complementarity between AI and clinicians. However, current…

Human-Computer Interaction · Computer Science 2025-04-11 Venkatesh Sivaraman , Katelyn Morrison , Will Epperson , Adam Perer

AI explanations are often mentioned as a way to improve human-AI decision-making, but empirical studies have not found consistent evidence of explanations' effectiveness and, on the contrary, suggest that they can increase overreliance when…

Human-Computer Interaction · Computer Science 2023-06-16 Valerie Chen , Q. Vera Liao , Jennifer Wortman Vaughan , Gagan Bansal

Today, AI is being increasingly used to help human experts make decisions in high-stakes scenarios. In these scenarios, full automation is often undesirable, not only due to the significance of the outcome, but also because human experts…

Artificial Intelligence · Computer Science 2020-01-08 Yunfeng Zhang , Q. Vera Liao , Rachel K. E. Bellamy

The rapid development of Artificial Intelligence (AI) requires developers and designers of AI systems to focus on the collaboration between humans and machines. AI explanations of system behavior and reasoning are vital for effective…

Human-Computer Interaction · Computer Science 2022-10-11 Ruben S. Verhagen , Siddharth Mehrotra , Mark A. Neerincx , Catholijn M. Jonker , Myrthe L. Tielman

Artificial intelligence (AI) is increasingly being considered to assist human decision-making in high-stake domains (e.g. health). However, researchers have discussed an issue that humans can over-rely on wrong suggestions of the AI model…

Human-Computer Interaction · Computer Science 2023-08-09 Min Hun Lee , Chong Jun Chew

Artificial intelligence (AI) systems increasingly achieve expert-level predictive accuracy in healthcare, yet improvements in model performance often fail to produce corresponding gains in patient outcomes. We term this disconnect the…

Artificial Intelligence · Computer Science 2026-01-13 Rifa Ferzana

A current concern in the field of Artificial Intelligence (AI) is to ensure the trustworthiness of AI systems. The development of explainability methods is one prominent way to address this, which has often resulted in the assumption that…

Human-Computer Interaction · Computer Science 2023-12-05 Roel Visser , Tobias M. Peters , Ingrid Scharlau , Barbara Hammer

The use of Artificial Intelligence (AI) in high-risk, decision-making scenarios presents technical, safety, and normative challenges; problems that may only be ameliorated by human oversight. However, notions of human oversight lack a…