English
Related papers

Related papers: Integrating Expert Judgment and Algorithmic Decisi…

200 papers

Machine learning algorithms are increasingly used to assist human decision-making. When the goal of machine assistance is to improve the accuracy of human decisions, it might seem appealing to design ML algorithms that complement human…

Computers and Society · Computer Science 2022-09-09 Nina Grgić-Hlača , Claude Castelluccia , Krishna P. Gummadi

Uncertainty in artificial intelligence (AI) predictions poses urgent legal and ethical challenges for AI-assisted decision-making. We examine two algorithmic interventions that act as guardrails for human-AI collaboration: selective…

Computers and Society · Computer Science 2025-08-12 Holli Sargeant , Mackenzie Jorgensen , Arina Shah , Adrian Weller , Umang Bhatt

The integration of artificial intelligence (AI) technologies into judicial decision-making, particularly in pretrial, sentencing, and parole contexts, has generated substantial concerns about transparency, reliability, and accountability.…

Artificial Intelligence · Computer Science 2026-04-15 Arthur Dyevre , Ahmad Shahvaroughi

The increasing integration of AI-powered tools into expert workflows, such as medicine, law, and finance, raises a critical question: how does AI involvement influence a user's trust in the human expert, the AI system, and their…

Human-Computer Interaction · Computer Science 2026-02-13 Dennis Kim , Roya Daneshi , Bruce Draper , Sarath Sreedharan

With the rapid development of AI-based decision aids, different forms of AI assistance have been increasingly integrated into the human decision making processes. To best support humans in decision making, it is essential to quantitatively…

Human-Computer Interaction · Computer Science 2024-01-12 Zhuoyan Li , Zhuoran Lu , Ming Yin

Given a (machine learning) classifier and a collection of unlabeled data, how can we efficiently identify misclassification patterns presented in this dataset? To address this problem, we propose a human-machine collaborative framework that…

Machine Learning · Computer Science 2023-12-20 Bao Nguyen , Viet Anh Nguyen

Human computer interaction is shifting from screen-based systems to multimodal interfaces where artificial intelligence powered systems increasingly interpret user intent through speech, gesture, and gaze. Yet users rarely understand how…

Human-Computer Interaction · Computer Science 2026-05-05 Ankur Bhatt , Sven Mayer

Information systems increasingly leverage artificial intelligence (AI) and machine learning (ML) to generate value from vast amounts of data. However, ML models are imperfect and can generate incorrect classifications. Hence,…

Machine Learning · Computer Science 2023-07-10 Johannes Jakubik , Daniel Weber , Patrick Hemmer , Michael Vössing , Gerhard Satzger

Artificial intelligence (AI) systems are increasingly used for providing advice to facilitate human decision making in a wide range of domains, such as healthcare, criminal justice, and finance. Motivated by limitations of the current…

Artificial Intelligence · Computer Science 2023-07-04 Gali Noti , Yiling Chen

Process mining offers techniques to exploit event data by providing insights and recommendations to improve business processes. The growing amount of algorithms for process discovery has raised the question of which algorithms perform best…

Software Engineering · Computer Science 2018-06-20 Toon Jouck , Alfredo Bolt , Benoît Depaire , Massimiliano de Leoni , Wil M. P. van der Aalst

With the rise of AI systems in real-world applications comes the need for reliable and trustworthy AI. An essential aspect of this are explainable AI systems. However, there is no agreed standard on how explainable AI systems should be…

Artificial Intelligence · Computer Science 2022-07-04 Sascha Saralajew , Ammar Shaker , Zhao Xu , Kiril Gashteovski , Bhushan Kotnis , Wiem Ben Rim , Jürgen Quittek , Carolin Lawrence

The integration of Artificial Intelligence in the development of computer systems presents a new challenge: make intelligent systems explainable to humans. This is especially vital in the field of health and well-being, where transparency…

Algorithmic processes are increasingly employed to perform managerial decision making, especially after the tremendous success in Artificial Intelligence (AI). This paradigm shift is occurring because these sophisticated AI techniques are…

Computers and Society · Computer Science 2021-09-30 Jianlong Zhou , Sunny Verma , Mudit Mittal , Fang Chen

As algorithms are increasingly used to make important decisions that affect human lives, ranging from social benefit assignment to predicting risk of criminal recidivism, concerns have been raised about the fairness of algorithmic decision…

Machine Learning · Statistics 2018-02-28 Nina Grgić-Hlača , Elissa M. Redmiles , Krishna P. Gummadi , Adrian Weller

Machine Learning (ML) has recently been demonstrated to rival expert-level human accuracy in prediction and detection tasks in a variety of domains, including medicine. Despite these impressive findings, however, a key barrier to the full…

Artificial Intelligence · Computer Science 2021-07-01 D. Fompeyrine , E. S. Vorm , N. Ricka , F. Rose , G. Pellegrin

Human-machine complementarity is important when neither the algorithm nor the human yield dominant performance across all instances in a given domain. Most research on algorithmic decision-making solely centers on the algorithm's…

Human-Computer Interaction · Computer Science 2021-12-14 Ruijiang Gao , Maytal Saar-Tsechansky , Maria De-Arteaga , Ligong Han , Min Kyung Lee , Matthew Lease

This paper introduces A2C, a multi-stage collaborative decision framework designed to enable robust decision-making within human-AI teams. Drawing inspiration from concepts such as rejection learning and learning to defer, A2C incorporates…

Human-Computer Interaction · Computer Science 2024-01-29 Shahroz Tariq , Mohan Baruwal Chhetri , Surya Nepal , Cecile Paris

Inferring from inconsistency and making decisions are two problems which have always been treated separately by researchers in Artificial Intelligence. Consequently, different models have been proposed for each category. Different…

Artificial Intelligence · Computer Science 2012-07-09 Leila Amgoud

Workers spend a significant amount of time learning how to make good decisions. Evaluating the efficacy of a given decision, however, can be complicated -- e.g., decision outcomes are often long-term and relate to the original decision in…

Machine Learning · Computer Science 2024-03-20 Hamsa Bastani , Osbert Bastani , Wichinpong Park Sinchaisri

Machine learning (ML) models have been quite successful in predicting outcomes in many applications. However, in some cases, domain experts might have a judgment about the expected outcome that might conflict with the prediction of ML…

Machine Learning · Computer Science 2023-05-02 Hogun Park , Aly Megahed , Peifeng Yin , Yuya Ong , Pravar Mahajan , Pei Guo