English
Related papers

Related papers: Discretion in the Loop: Human Expertise in Algorit…

200 papers

AI tools increasingly guide targeted interventions in healthcare, education, and recruiting. Algorithms score individuals, trigger outreach to those above a threshold (e.g., high-risk or high-value), and encourage them to request service;…

Methodology · Statistics 2026-04-17 Carri W. Chan , Yi Han , Hannah Li , Benjamin L. Ranard

We present an empirical study of how both experienced tutors and non-tutors judge the correctness of tutor praise responses under different Artificial Intelligence (AI)-assisted interfaces, types of explanation (textual explanations vs.…

Human-Computer Interaction · Computer Science 2026-01-06 Eason Chen , Jeffrey Li , Scarlett Huang , Xinyi Tang , Jionghao Lin , Paulo Carvalho , Kenneth Koedinger

AI systems increasingly assist human decision making by producing preliminary assessments of complex inputs. However, such AI-generated assessments can often be noisy or systematically biased, raising a central question: how should costly…

Machine Learning · Statistics 2026-03-17 Lezhi Tan , Naomi Sagan , Lihua Lei , Jose Blanchet

Academic procrastination is a persistent challenge in computing education, yet evidence on the effectiveness of course-level interventions remains fragmented across diverse designs and contexts. We present a systematic literature review of…

Computers and Society · Computer Science 2026-04-07 Daniel Cheng , Oscar Heath , Daniyaal Farooqi , Evelyn Chou , Alice Gao , Jonathan Calver

Various processes in academic organizations include the decision points where selecting people through their assessment and ranking is performed, and the impact of wrong or right choices can be very high. How do we simultaneously ensure…

Computers and Society · Computer Science 2021-05-25 Valerii Semenets , Vagan Terziyan , Svitlana Gryshko , Mariia Golovianko

The increased use of algorithmic predictions in sensitive domains has been accompanied by both enthusiasm and concern. To understand the opportunities and risks of these technologies, it is key to study how experts alter their decisions…

Computers and Society · Computer Science 2020-02-21 Maria De-Arteaga , Riccardo Fogliato , Alexandra Chouldechova

Multiple lines of evidence suggest that predictive models may benefit from algorithmic triage. Under algorithmic triage, a predictive model does not predict all instances but instead defers some of them to human experts. However, the…

Machine Learning · Statistics 2021-11-19 Nastaran Okati , Abir De , Manuel Gomez-Rodriguez

Human-AI collaboration for decision-making strives to achieve team performance that exceeds the performance of humans or AI alone. However, many factors can impact success of Human-AI teams, including a user's domain expertise, mental…

Bayesian optimization has been successfully applied throughout Chemical Engineering for the optimization of functions that are expensive-to-evaluate, or where gradients are not easily obtainable. However, domain experts often possess…

Human-Computer Interaction · Computer Science 2024-04-18 Tom Savage , Ehecatl Antonio del Rio Chanona

It has long been observed that for practically any computational problem that has been intensely studied, different instances are best solved using different algorithms. This is particularly pronounced for computationally hard problems,…

Machine Learning · Computer Science 2018-11-29 Pascal Kerschke , Holger H. Hoos , Frank Neumann , Heike Trautmann

The increasing integration of AI-powered tools into expert workflows, such as medicine, law, and finance, raises a critical question: how does AI involvement influence a user's trust in the human expert, the AI system, and their…

Human-Computer Interaction · Computer Science 2026-02-13 Dennis Kim , Roya Daneshi , Bruce Draper , Sarath Sreedharan

How do algorithmic decision aids introduced in business decision processes affect task performance? In a first experiment, we study effective collaboration. Faced with a decision, subjects alone have a success rate of 72%; Aided by a…

Human-Computer Interaction · Computer Science 2020-09-18 Thomas Baudel , Manon Verbockhaven , Guillaume Roy , Victoire Cousergue , Rida Laarach

AI systems increasingly support human decision-making. In many cases, despite the algorithm's superior performance, the final decision remains in human hands. For example, an AI may assist doctors in determining which diagnostic tests to…

Artificial Intelligence · Computer Science 2026-02-20 Gali Noti , Kate Donahue , Jon Kleinberg , Sigal Oren

Recommender systems, while a powerful decision making tool, are often operationalized as black box models, such that their AI algorithms are not accessible or interpretable by human operators. This in turn can cause confusion and…

Human-Computer Interaction · Computer Science 2024-09-18 Divya Srivastava , Karen M. Feigh

Societies often rely on human experts to take a wide variety of decisions affecting their members, from jail-or-release decisions taken by judges and stop-and-frisk decisions taken by police officers to accept-or-reject decisions taken by…

Machine Learning · Statistics 2018-05-29 Isabel Valera , Adish Singla , Manuel Gomez Rodriguez

Algorithms have permeated throughout civil government and society, where they are being used to make high-stakes decisions about human lives. In this paper, we first develop a cohesive framework of algorithmic decision-making adapted for…

Human-Computer Interaction · Computer Science 2021-10-14 Devansh Saxena , Karla Badillo-Urquiola , Pamela Wisniewski , Shion Guha

When people receive advice while making difficult decisions, they often make better decisions in the moment and also increase their knowledge in the process. However, such incidental learning can only occur when people cognitively engage…

Human-Computer Interaction · Computer Science 2022-02-14 Krzysztof Z. Gajos , Lena Mamykina

The increasing availability and use of artificial intelligence (AI) tools in educational settings has raised concerns about students' overreliance on these technologies. Overreliance occurs when individuals accept incorrect AI-generated…

Computers and Society · Computer Science 2025-06-18 Griffin Pitts , Neha Rani , Weedguet Mildort , Eva-Marie Cook

As algorithms increasingly mediate competitive decision-making, their influence extends beyond individual outcomes to shaping strategic market dynamics. In two preregistered experiments, we examined how algorithmic advice affects human…

Human-Computer Interaction · Computer Science 2025-11-13 Tobias R. Rebholz , Maxwell Uphoff , Christian H. R. Bernges , Florian Scholten

A principal designs an algorithm that generates a publicly observable prediction of a binary state. She must decide whether to act directly based on the prediction or to delegate the decision to an agent with private information but…

Theoretical Economics · Economics 2024-02-22 Ruqing Xu