English
Related papers

Related papers: Assessing Human Error Against a Benchmark of Perfe…

200 papers

The research area of algorithms with predictions has seen recent success showing how to incorporate machine learning into algorithm design to improve performance when the predictions are correct, while retaining worst-case guarantees when…

Machine Learning · Computer Science 2022-12-06 Michael Dinitz , Sungjin Im , Thomas Lavastida , Benjamin Moseley , Sergei Vassilvitskii

We propose a new method to analyze the impact of errors in algorithms for multi-instance pose estimation and a principled benchmark that can be used to compare them. We define and characterize three classes of errors - localization,…

Computer Vision and Pattern Recognition · Computer Science 2017-08-08 Matteo Ruggero Ronchi , Pietro Perona

Human decision-making belongs to the foundation of our society and civilization, but we are on the verge of a future where much of it will be delegated to artificial intelligence. The arrival of Large Language Models (LLMs) has transformed…

Artificial Intelligence · Computer Science 2025-06-23 Hao Li , Gengrui Zhang , Petter Holme , Shuyue Hu , Zhen Wang

. It is typically assumed that for the successful use of machine learning algorithms, these algorithms should have a higher accuracy than a human expert. Moreover, if the average accuracy of ML algorithms is lower than that of a human…

Human-Computer Interaction · Computer Science 2024-11-19 Saveli Goldberg , Lev Salnikov , Noor Kaiser , Tushar Srivastava , Eugene Pinsky

Machine learning (ML) models can make decisions based on large amounts of data, but they can be missing personal knowledge available to human users about whom predictions are made. For example, a model trained to predict psychiatric…

Machine Learning · Computer Science 2024-06-14 Isaac Lage , Sonali Parbhoo , Finale Doshi-Velez

Human pose estimation aims at localizing human anatomical keypoints or body parts in the input data (e.g., images, videos, or signals). It forms a crucial component in enabling machines to have an insightful understanding of the behaviors…

Computer Vision and Pattern Recognition · Computer Science 2022-04-18 Haoming Chen , Runyang Feng , Sifan Wu , Hao Xu , Fengcheng Zhou , Zhenguang Liu

Black box systems for automated decision making, often based on machine learning over (big) data, map a user's features into a class or a score without exposing the reasons why. This is problematic not only for lack of transparency, but…

Artificial Intelligence · Computer Science 2018-06-27 Dino Pedreschi , Fosca Giannotti , Riccardo Guidotti , Anna Monreale , Luca Pappalardo , Salvatore Ruggieri , Franco Turini

Recent advancements in deep reinforcement learning have brought forth an impressive display of highly skilled artificial agents capable of complex intelligent behavior. In video games, these artificial agents are increasingly deployed as…

Machine Learning · Statistics 2022-03-14 Ian Colbert , Mehdi Saeedi

Cricket is unarguably one of the most popular sports in the world. Predicting the outcome of a cricket match has become a fundamental problem as we are advancing in the field of machine learning. Multiple researchers have tried to predict…

Artificial Intelligence · Computer Science 2021-08-24 Harsh Mittal , Deepak Rikhari , Jitendra Kumar , Ashutosh Kumar Singh

In this paper we propose an approach to the design of processes and software that aims at decreasing human and software errors, that so frequently happen, making affected people using and wasting a lot of time for the need of fixing the…

Software Engineering · Computer Science 2022-07-04 Fabrizio d'Amore

The human brain copes with sensory uncertainty in accordance with Bayes' rule. However, it is unknown how the brain makes predictions in the presence of parameter uncertainty. Here, we tested whether and how humans take parameter…

Neurons and Cognition · Quantitative Biology 2020-07-01 Jannes Jegminat , Maya Jastrzebowska , Matt Pachai , Michael Herzog , Jean-Pascal Pfister

Hyperparameters play a critical role in machine learning. Hyperparameter tuning can make the difference between state-of-the-art and poor prediction performance for any algorithm, but it is particularly challenging for structure learning…

Machine Learning · Computer Science 2024-02-21 Damian Machlanski , Spyridon Samothrakis , Paul Clarke

AI explanations are often mentioned as a way to improve human-AI decision-making, but empirical studies have not found consistent evidence of explanations' effectiveness and, on the contrary, suggest that they can increase overreliance when…

Human-Computer Interaction · Computer Science 2023-06-16 Valerie Chen , Q. Vera Liao , Jennifer Wortman Vaughan , Gagan Bansal

Computer modeling of human decision making is of large importance for, e.g., sustainable transport, urban development, and online recommendation systems. In this paper we present a model for predicting the behavior of an individual during a…

Artificial Intelligence · Computer Science 2021-01-18 Chenda Zhang , Hedvig Kjellström

The integration of artificial intelligence (AI) technologies into judicial decision-making, particularly in pretrial, sentencing, and parole contexts, has generated substantial concerns about transparency, reliability, and accountability.…

Artificial Intelligence · Computer Science 2026-04-15 Arthur Dyevre , Ahmad Shahvaroughi

Protecting against adversarial attacks is a common multiagent problem. Attackers in the real world are predominantly human actors, and the protection methods often incorporate opponent models to improve the performance when facing humans.…

Artificial Intelligence · Computer Science 2023-11-29 David Milec , Viliam Lisý , Christopher Kiekintveld

This commentary tests a methodology proposed by Munk et al. (2022) for using failed predictions in machine learning as a method to identify ambiguous and rich cases for qualitative analysis. Using a dataset describing actions performed by…

Machine Learning · Computer Science 2026-05-26 Jill Walker Rettberg

Context: Software development is human-centric and vulnerable to human error. Human errors are errors in the human thought process. To ensure software quality, practitioners must understand how to manage these human errors. Organizations…

Software Engineering · Computer Science 2023-04-07 Sweta Mahaju , Jeffrey C. Carver , Gary L. Bradshaw

People work with AI systems to improve their decision making, but often under- or over-rely on AI predictions and perform worse than they would have unassisted. To help people appropriately rely on AI aids, we propose showing them behavior…

Human-Computer Interaction · Computer Science 2023-01-18 Ángel Alexander Cabrera , Adam Perer , Jason I. Hong

In the algorithm selection research, the discussion surrounding algorithm features has been significantly overshadowed by the emphasis on problem features. Although a few empirical studies have yielded evidence regarding the effectiveness…

Machine Learning · Computer Science 2024-06-04 Xingyu Wu , Yan Zhong , Jibin Wu , Yuxiao Huang , Sheng-hao Wu , Kay Chen Tan