English
Related papers

Related papers: Play MNIST For Me! User Studies on the Effects of …

200 papers

Many Machine Learning algorithms, such as deep neural networks, have long been criticized for being "black-boxes"-a kind of models unable to provide how it arrive at a decision without further efforts to interpret. This problem has raised…

Machine Learning · Statistics 2019-07-04 Yihuang Kang , I-Ling Cheng , Wenjui Mao , Bowen Kuo , Pei-Ju Lee

The performance (accuracy and robustness) of several clustering algorithms is studied for linearly dependent random variables in the presence of noise. It turns out that the error percentage quickly increases when the number of observations…

Applications · Statistics 2009-11-13 Pamela Minicozzi , Fabio Rapallo , Enrico Scalas , Francesco Dondero

As machine learning and algorithmic decision making systems are increasingly being leveraged in high-stakes human-in-the-loop settings, there is a pressing need to understand the rationale of their predictions. Researchers have responded to…

Machine Learning · Computer Science 2020-12-07 Jonathan Dinu , Jeffrey Bigham , J. Zico Kolter

As machine learning black boxes are increasingly being deployed in critical domains such as healthcare and criminal justice, there has been a growing emphasis on developing techniques for explaining these black boxes in a human…

Artificial Intelligence · Computer Science 2019-11-18 Himabindu Lakkaraju , Osbert Bastani

Humans should be able work more effectively with artificial intelligence-based systems when they can predict likely failures and form useful mental models of how the systems work. We conducted a study of human's mental models of artificial…

Human-Computer Interaction · Computer Science 2022-02-01 Kimberly Glasgow , Jonathan Kopecky , John Gersh , Adam Crego

According to the latest trend of artificial intelligence, AI-systems needs to clarify regarding general,specific decisions,services provided by it. Only consumer is satisfied, with explanation , for example, why any classification result is…

Machine Learning · Computer Science 2025-02-06 Rossi Kamal

Decision-based evasion attacks repeatedly query a black-box classifier to generate adversarial examples. Prior work measures the cost of such attacks by the total number of queries made to the classifier. We argue this metric is flawed.…

Cryptography and Security · Computer Science 2024-02-15 Edoardo Debenedetti , Nicholas Carlini , Florian Tramèr

Counterfactual explanations for black-box models aim to pr ovide insight into an algorithmic decision to its recipient. For a binary classification problem an individual counterfactual details which features might be changed for the model…

Machine Learning · Statistics 2025-05-29 James M. Adams , Gesine Reinert , Lukasz Szpruch , Carsten Maple , Andrew Elliott

Selective classifiers improve model reliability by abstaining on inputs the model deems uncertain. However, few practical approaches achieve the gold-standard performance of a perfect-ordering oracle that accepts examples exactly in order…

Machine Learning · Computer Science 2025-10-27 Stephan Rabanser , Nicolas Papernot

Explainable Recommendation has attracted a lot of attention due to a renewed interest in explainable artificial intelligence. In particular, post-hoc approaches have proved to be the most easily applicable ones to increasingly complex…

Information Retrieval · Computer Science 2021-10-11 Vito Walter Anelli , Alejandro Bellogín , Tommaso Di Noia , Francesco Maria Donini , Vincenzo Paparella , Claudio Pomo

We evaluate two different methods for the integration of prediction uncertainty into diagnostic image classifiers to increase patient safety in deep learning. In the first method, Monte Carlo sampling is applied with dropout at test time to…

Image and Video Processing · Electrical Eng. & Systems 2019-08-05 Max-Heinrich Laves , Sontje Ihler , Tobias Ortmaier

A reliable deep learning system should be able to accurately express its confidence with respect to its predictions, a quality known as calibration. One of the most effective ways to produce reliable confidence estimates with a pre-trained…

Machine Learning · Computer Science 2024-10-10 Thomas P. Zollo , Zhun Deng , Jake C. Snell , Toniann Pitassi , Richard Zemel

We demonstrate that users may be prone to place an inordinate amount of trust in black box algorithms that are framed as intelligent. We deploy an algorithm that purportedly assesses the positivity and negativity of a users' writing…

Human-Computer Interaction · Computer Science 2018-12-11 Aaron Springer , Victoria Hollis , Steve Whittaker

We investigate whether post-hoc model explanations are effective for diagnosing model errors--model debugging. In response to the challenge of explaining a model's prediction, a vast array of explanation methods have been proposed. Despite…

Computer Vision and Pattern Recognition · Computer Science 2020-11-12 Julius Adebayo , Michael Muelly , Ilaria Liccardi , Been Kim

Bounding boxes are often used to communicate automatic object detection results to humans, aiding humans in a multitude of tasks. We investigate the relationship between bounding box localization errors and human task performance. We use…

Computer Vision and Pattern Recognition · Computer Science 2024-02-01 Sven de Witte , Ombretta Strafforello , Jan van Gemert

Nowadays, deep neural networks are widely used in a variety of fields that have a direct impact on society. Although those models typically show outstanding performance, they have been used for a long time as black boxes. To address this,…

Machine Learning · Computer Science 2022-10-11 Huawei Sun , Lorenzo Servadei , Hao Feng , Michael Stephan , Robert Wille , Avik Santra

The explainability of black-box machine learning algorithms, commonly known as Explainable Artificial Intelligence (XAI), has become crucial for financial and other regulated industrial applications due to regulatory requirements and the…

Machine Learning · Computer Science 2024-08-14 Gregory Yampolsky , Dhruv Desai , Mingshu Li , Stefano Pasquali , Dhagash Mehta

The increasing difficulty to distinguish language-model-generated from human-written text has led to the development of detectors of machine-generated text (MGT). However, in many contexts, a black-box prediction is not sufficient, it is…

Machine Learning · Computer Science 2026-01-21 Loris Schoenegger , Yuxi Xia , Benjamin Roth

Survival analysis often relies on Cox models, assuming both linearity and proportional hazards (PH). This study evaluates machine and deep learning methods that relax these constraints, comparing their performance with penalized Cox models…

Machine Learning · Computer Science 2025-10-21 Ivan Rossi , Flavio Sartori , Cesare Rollo , Giovanni Birolo , Piero Fariselli , Tiziana Sanavia

Neural Networks have high accuracy in solving problems where it is difficult to detect patterns or create a logical model. However, these algorithms sometimes return wrong solutions, which become problematic in high-risk domains like…

Machine Learning · Computer Science 2025-06-26 Miguel N. Font , José L. Jorro-Aragoneses , Carlos M. Alaíz