English
Related papers

Related papers: Discretion in the Loop: Human Expertise in Algorit…

200 papers

Consider learning a decision support assistant to serve as an intermediary between (oracle) expert behavior and (imperfect) human behavior: At each time, the algorithm observes an action chosen by a fallible agent, and decides whether to…

Machine Learning · Statistics 2023-10-31 Daniel Jarrett , Alihan Hüyük , Mihaela van der Schaar

Student dropout is a significant concern for educational institutions due to its social and economic impact, driving the need for risk prediction systems to identify at-risk students before enrollment. We explore the accuracy of such…

Behavioral scientists have classically documented aversion to algorithmic decision aids, from simple linear models to AI. Sentiment, however, is changing and possibly accelerating AI helper usage. AI assistance is, arguably, most valuable…

Artificial Intelligence · Computer Science 2023-07-28 Nikolos Gurney , John H. Miller , David V. Pynadath

The integration of users and experts in machine learning is a widely studied topic in artificial intelligence literature. Similarly, human-computer interaction research extensively explores the factors that influence the acceptance of AI as…

Human-Computer Interaction · Computer Science 2024-08-05 Jaroslaw Kornowicz , Kirsten Thommes

Research on intelligent tutoring systems has been exploring data-driven methods to deliver effective adaptive assistance. While much work has been done to provide adaptive assistance when students seek help, they may not seek help…

Artificial Intelligence · Computer Science 2022-07-08 Mehak Maniktala , Min Chi , Tiffany Barnes

Algorithms in public services such as child welfare, criminal justice, and education are increasingly being used to make high-stakes decisions about human lives. Drawing upon findings from a two-year ethnography conducted at a child welfare…

Human-Computer Interaction · Computer Science 2023-08-11 Devansh Saxena , Shion Guha

Expert decision-makers (DMs) in high-stakes AI-assisted decision-making (AIaDM) settings receive and reconcile recommendations from AI systems before making their final decisions. We identify distinct properties of these settings which are…

Human-Computer Interaction · Computer Science 2023-02-14 Nicholas Wolczynski , Maytal Saar-Tsechansky , Tong Wang

Machine learning algorithms are increasingly used to assist human decision-making. When the goal of machine assistance is to improve the accuracy of human decisions, it might seem appealing to design ML algorithms that complement human…

Computers and Society · Computer Science 2022-09-09 Nina Grgić-Hlača , Claude Castelluccia , Krishna P. Gummadi

This paper aims to address the challenge of selecting relevant courses for students by proposing the design and development of a course recommendation system. The course recommendation system utilises a combination of data analytics…

Computation and Language · Computer Science 2025-11-14 Rahul Soni , Basem Suleiman , Sonit Singh

The recent adoption of artificial intelligence in socio-technical systems raises concerns about the black-box nature of the resulting decisions in fields such as hiring, finance, admissions, etc. If data subjects -- such as job applicants,…

Human-Computer Interaction · Computer Science 2025-08-04 Kaustav Bhattacharjee , Jun Yuan , Aritra Dasgupta

While decision makers have begun to employ machine learning, machine learning models may make predictions that bias against certain demographic groups. Semi-automated bias detection tools often present reports of automatically-detected…

Human-Computer Interaction · Computer Science 2020-05-12 Po-Ming Law , Sana Malik , Fan Du , Moumita Sinha

As artificial intelligence (AI) systems play an increasingly prominent role in human decision-making, challenges surface in the realm of human-AI interactions. One challenge arises from the suboptimal AI policies due to the inadequate…

Machine Learning · Statistics 2024-03-22 Guanting Chen , Xiaocheng Li , Chunlin Sun , Hanzhao Wang

Algorithms are increasingly used to automate or aid human decisions, yet recent research shows that these algorithms may exhibit bias across legally protected demographic groups. However, data on these groups may be unavailable to…

Computers and Society · Computer Science 2026-02-17 Floris Holstege , Mackenzie Jorgensen , Kirtan Padh , Jurriaan Parie , Krsto Prorokovic , Joel Persson , Lukas Snoek

Research on children and youth's participation in different roles in the design of technologies is one of the core contributions in child-computer interaction studies. Building on this work, we situate youth as advisors to a group of high…

Human-Computer Interaction · Computer Science 2025-04-14 Daniel J. Noh , Deborah A. Fields , Luis Morales-Navarro , Alexis Cabrera-Sutch , Yasmin B. Kafai , Danaé Metaxa

The best algorithm for a computational problem generally depends on the "relevant inputs," a concept that depends on the application domain and often defies formal articulation. While there is a large literature on empirical approaches to…

Machine Learning · Computer Science 2016-09-06 Rishi Gupta , Tim Roughgarden

Trust in a recommendation system (RS) is often algorithmically incorporated using implicit or explicit feedback of user-perceived trustworthy social neighbors, and evaluated using user-reported trustworthiness of recommended items. However,…

Human-Computer Interaction · Computer Science 2021-09-20 Taha Hassan , Bob Edmison , Timothy Stelter , D. Scott McCrickard

Interactive AI systems increasingly employ a human-in-the-loop strategy. This creates new challenges for the HCI community when designing such systems. We reveal and investigate some of these challenges in a case study with an industry…

Human-Computer Interaction · Computer Science 2022-07-27 Changkun Ou , Daniel Buschek , Sven Mayer , Andreas Butz

Recommendation algorithms perform differently if the users, recommendation contexts, applications, and user interfaces vary even slightly. It is similarly observed in other fields, such as combinatorial problem solving, that algorithms…

Information Retrieval · Computer Science 2021-01-01 Andrew Collins , Laura Tierney , Joeran Beel

While Machine learning gives rise to astonishing results in automated systems, it is usually at the cost of large data requirements. This makes many successful algorithms from machine learning unsuitable for human-machine interaction, where…

Human-Computer Interaction · Computer Science 2021-09-30 Jan Philip Göpfert , Ulrike Kuhl , Lukas Hindemith , Heiko Wersing , Barbara Hammer

AI has the potential to augment human decision making. However, even high-performing models can produce inaccurate predictions when deployed. These inaccuracies, combined with automation bias, where humans overrely on AI predictions, can…

Human-Computer Interaction · Computer Science 2025-08-12 Sarah Jabbour , David Fouhey , Nikola Banovic , Stephanie D. Shepard , Ella Kazerooni , Michael W. Sjoding , Jenna Wiens