English
Related papers

Related papers: Training Towards Critical Use: Learning to Situate…

200 papers

It is widely agreed that when AI models assist decision-makers in high-stakes domains by predicting an outcome of interest, they should communicate the confidence of their predictions. However, empirical evidence suggests that…

Machine Learning · Computer Science 2026-05-14 Nina Corvelo Benz , Eleni Straitouri , Manuel Gomez-Rodriguez

Several strands of research have aimed to bridge the gap between artificial intelligence (AI) and human decision-makers in AI-assisted decision-making, where humans are the consumers of AI model predictions and the ultimate decision-makers…

Human-Computer Interaction · Computer Science 2022-04-06 Charvi Rastogi , Yunfeng Zhang , Dennis Wei , Kush R. Varshney , Amit Dhurandhar , Richard Tomsett

AI explanations are often mentioned as a way to improve human-AI decision-making, but empirical studies have not found consistent evidence of explanations' effectiveness and, on the contrary, suggest that they can increase overreliance when…

Human-Computer Interaction · Computer Science 2023-06-16 Valerie Chen , Q. Vera Liao , Jennifer Wortman Vaughan , Gagan Bansal

AI-enabled capabilities are reaching the requisite level of maturity to be deployed in the real world, yet do not always make correct or safe decisions. One way of addressing these concerns is to leverage AI control systems alongside and in…

Machine Learning · Computer Science 2024-10-10 Walt Woods , Alexander Grushin , Simon Khan , Alvaro Velasquez

Recent AI trends seek to align AI models to learned human-centric objectives, such as personal preferences, utility, or societal values. Using standard preference elicitation methods, researchers and practitioners build models of human…

Machine Learning · Computer Science 2026-05-26 Cyrus Cousins , Vijay Keswani , Vincent Conitzer , Hoda Heidari , Jana Schaich Borg , Walter Sinnott-Armstrong

In settings where human decision-making relies on AI input, both the predictive accuracy of the AI system and the reliability of its confidence estimates influence decision quality. We highlight the role of AI metacognitive sensitivity --…

Artificial Intelligence · Computer Science 2025-08-15 ZhaoBin Li , Mark Steyvers

In many practical applications of AI, an AI model is used as a decision aid for human users. The AI provides advice that a human (sometimes) incorporates into their decision-making process. The AI advice is often presented with some measure…

Artificial Intelligence · Computer Science 2022-10-31 Kailas Vodrahalli , Tobias Gerstenberg , James Zou

Today, AI is being increasingly used to help human experts make decisions in high-stakes scenarios. In these scenarios, full automation is often undesirable, not only due to the significance of the outcome, but also because human experts…

Artificial Intelligence · Computer Science 2020-01-08 Yunfeng Zhang , Q. Vera Liao , Rachel K. E. Bellamy

As artificial intelligence (AI) systems become ubiquitous in professional contexts, there is an urgent need to equip workers, often with backgrounds outside of STEM, with the skills to use these tools effectively as well as responsibly,…

Computers and Society · Computer Science 2025-11-10 Christopher Bogart , Aparna Warrier , Arav Agarwal , Ross Higashi , Yufan Zhang , Jesse Flot , Jaromir Savelka , Heather Burte , Majd Sakr

Whenever a binary classifier is used to provide decision support, it typically provides both a label prediction and a confidence value. Then, the decision maker is supposed to use the confidence value to calibrate how much to trust the…

Machine Learning · Computer Science 2024-02-26 Nina L. Corvelo Benz , Manuel Gomez Rodriguez

Artificial intelligence (AI) is increasingly being considered to assist human decision-making in high-stake domains (e.g. health). However, researchers have discussed an issue that humans can over-rely on wrong suggestions of the AI model…

Human-Computer Interaction · Computer Science 2023-08-09 Min Hun Lee , Chong Jun Chew

AI systems increasingly support human decision-making. In many cases, despite the algorithm's superior performance, the final decision remains in human hands. For example, an AI may assist doctors in determining which diagnostic tests to…

Artificial Intelligence · Computer Science 2026-02-20 Gali Noti , Kate Donahue , Jon Kleinberg , Sigal Oren

A current concern in the field of Artificial Intelligence (AI) is to ensure the trustworthiness of AI systems. The development of explainability methods is one prominent way to address this, which has often resulted in the assumption that…

Human-Computer Interaction · Computer Science 2023-12-05 Roel Visser , Tobias M. Peters , Ingrid Scharlau , Barbara Hammer

The current literature on AI-advised decision making -- involving explainable AI systems advising human decision makers -- presents a series of inconclusive and confounding results. To synthesize these findings, we propose a simple theory…

Artificial Intelligence · Computer Science 2024-02-05 Raymond Fok , Daniel S. Weld

Artificial intelligence is transforming the way we work with information across disciplines and practical contexts. A growing range of disciplines are now involved in studying, developing, and assessing the use of AI in practice, but these…

Computers and Society · Computer Science 2024-09-20 Denis Newman-Griffis

Appropriate Trust in Artificial Intelligence (AI) systems has rapidly become an important area of focus for both researchers and practitioners. Various approaches have been used to achieve it, such as confidence scores, explanations,…

Human-Computer Interaction · Computer Science 2023-11-14 Siddharth Mehrotra , Chadha Degachi , Oleksandra Vereschak , Catholijn M. Jonker , Myrthe L. Tielman

People supported by AI-powered decision support tools frequently overrely on the AI: they accept an AI's suggestion even when that suggestion is wrong. Adding explanations to the AI decisions does not appear to reduce the overreliance and…

Human-Computer Interaction · Computer Science 2021-02-22 Zana Buçinca , Maja Barbara Malaya , Krzysztof Z. Gajos

In settings where users both need high accuracy and are time-pressured, such as doctors working in emergency rooms, we want to provide AI assistance that both increases decision accuracy and reduces decision-making time. Current literature…

Human-Computer Interaction · Computer Science 2024-02-13 Siddharth Swaroop , Zana Buçinca , Krzysztof Z. Gajos , Finale Doshi-Velez

Thanks to the great progress of machine learning in the last years, several Artificial Intelligence (AI) techniques have been increasingly moving from the controlled research laboratory settings to our everyday life. AI is clearly…

Artificial Intelligence · Computer Science 2021-06-07 Tatiana Tommasi , Silvia Bucci , Barbara Caputo , Pietro Asinari

Despite the growing prevalence of human-AI decision making, the human-AI team's decision performance often remains suboptimal, partially due to insufficient examination of humans' own reasoning. In this paper, we explore designing AI…

Human-Computer Interaction · Computer Science 2026-03-03 Harry Yizhou Tian , Hasan Amin , Ming Yin