English
Related papers

Related papers: How to Measure Human-AI Prediction Accuracy in Exp…

200 papers

Is explainability a false promise? This debate has emerged from the insufficient evidence that explanations help people in situations they are introduced for. More human-centered, application-grounded evaluations of explanations are needed…

Computation and Language · Computer Science 2024-11-06 Fateme Hashemi Chaleshtori , Atreya Ghosal , Alexander Gill , Purbid Bambroo , Ana Marasović

Scientists, policy-makers, business leaders, and members of the public care about what modern artificial intelligence systems are disposed to do. Yet terms such as capabilities, propensities, skills, values, and abilities are routinely used…

Computers and Society · Computer Science 2026-03-03 Konstantinos Voudouris , Mirko Thalmann , Alex Kipnis , José Hernández-Orallo , Eric Schulz

Humans frequently make decisions with the aid of artificially intelligent (AI) systems. A common pattern is for the AI to recommend an action to the human who retains control over the final decision. Researchers have identified ensuring…

Artificial Intelligence · Computer Science 2025-09-26 Ziyang Guo , Yifan Wu , Jason Hartline , Jessica Hullman

Algorithm fairness has become a central problem for the broad adoption of artificial intelligence. Although the past decade has witnessed an explosion of excellent work studying algorithm biases, achieving fairness in real-world AI…

Machine Learning · Computer Science 2023-09-06 James Enouen , Tianshu Sun , Yan Liu

We formalize Prescriptive Artificial Intelligence as a distinct paradigm for human-AI decision collaboration in high-stakes environments. Unlike predictive systems optimized for outcome accuracy, prescriptive systems are designed to…

Artificial Intelligence · Computer Science 2026-03-26 Pedro Passos , Patrick Moratori

Explainability is needed to establish confidence in machine learning results. Some explainable methods take a post hoc approach to explain the weights of machine learning models, others highlight areas of the input contributing to…

Machine Learning · Computer Science 2024-07-15 Paul Whitten , Francis Wolff , Chris Papachristou

The desirable properties of explanations in information systems have fueled the demands for transparency in artificial intelligence (AI) outputs. To address these demands, the field of explainable AI (XAI) has put forth methods that can…

Human-Computer Interaction · Computer Science 2025-04-22 Felix Haag

AI predictive systems are increasingly embedded in decision making pipelines, shaping high stakes choices once made solely by humans. Yet robust decisions under uncertainty still rely on capabilities that current AI lacks: domain knowledge…

Artificial Intelligence · Computer Science 2025-10-28 Sima Noorani , Shayan Kiyani , George Pappas , Hamed Hassani

There is currently a rapid increase in the number of challenge problem, benchmarking datasets and algorithmic optimization tests for evaluating AI systems. However, there does not currently exist an objective measure to determine the…

Artificial Intelligence · Computer Science 2020-10-06 Christopher Pereyda , Lawrence Holder

The field of eXplainable artificial intelligence (XAI) has produced a plethora of methods (e.g., saliency-maps) to gain insight into artificial intelligence (AI) models, and has exploded with the rise of deep learning (DL). However,…

Human-Computer Interaction · Computer Science 2024-04-12 Marvin Pafla , Kate Larson , Mark Hancock

Explainability techniques are rapidly being developed to improve human-AI decision-making across various cooperative work settings. Consequently, previous research has evaluated how decision-makers collaborate with imperfect AI by…

Human-Computer Interaction · Computer Science 2024-05-09 Katelyn Morrison , Philipp Spitzer , Violet Turri , Michelle Feng , Niklas Kühl , Adam Perer

Existing approaches for generating human-aware agent behaviors have considered different measures of interpretability in isolation. Further, these measures have been studied under differing assumptions, thus precluding the possibility of…

Artificial Intelligence · Computer Science 2021-04-23 Sarath Sreedharan , Anagha Kulkarni , David E. Smith , Subbarao Kambhampati

In this work, we empirically examine human-AI decision-making in the presence of explanations based on predicted outcomes. This type of explanation provides a human decision-maker with expected consequences for each decision alternative at…

Human-Computer Interaction · Computer Science 2022-08-31 Johannes Jakubik , Jakob Schöffer , Vincent Hoge , Michael Vössing , Niklas Kühl

One of the most important aims of the fields of robotics, artificial intelligence and artificial life is the design and construction of systems and machines as versatile and as reliable as living organisms at performing high level…

Artificial Intelligence · Computer Science 2014-12-24 Hector Zenil

Although AI holds promise for improving human decision making in societally critical domains, it remains an open question how human-AI teams can reliably outperform AI alone and human alone in challenging prediction tasks (also known as…

Artificial Intelligence · Computer Science 2021-10-07 Han Liu , Vivian Lai , Chenhao Tan

Research in artificial intelligence (AI)-assisted decision-making is experiencing tremendous growth with a constantly rising number of studies evaluating the effect of AI with and without techniques from the field of explainable AI (XAI) on…

Human-Computer Interaction · Computer Science 2022-06-02 Max Schemmer , Patrick Hemmer , Maximilian Nitsche , Niklas Kühl , Michael Vössing

Explainable artificial intelligence is a research field that tries to provide more transparency for autonomous intelligent systems. Explainability has been used, particularly in reinforcement learning and robotic scenarios, to better…

Artificial Intelligence · Computer Science 2022-07-08 Francisco Cruz , Charlotte Young , Richard Dazeley , Peter Vamplew

Decision-making with information displays is a key focus of research in areas like human-AI collaboration and data visualization. However, what constitutes a decision problem, and what is required for an experiment to conclude that…

Human-Computer Interaction · Computer Science 2025-05-05 Jessica Hullman , Alex Kale , Jason Hartline

AI systems are often used to make or contribute to important decisions in a growing range of applications, including criminal justice, hiring, and medicine. Since these decisions impact human lives, it is important that the AI systems act…

Artificial Intelligence · Computer Science 2021-03-16 Duncan C McElfresh , Lok Chan , Kenzie Doyle , Walter Sinnott-Armstrong , Vincent Conitzer , Jana Schaich Borg , John P Dickerson

In most conversations about explanation and AI, the recipient of the explanation (the explainee) is suspiciously absent, despite the problem being ultimately communicative in nature. We pose the problem `explaining AI systems' in terms of a…

Computation and Language · Computer Science 2023-05-23 Dylan Cope , Peter McBurney