English
Related papers

Related papers: Why Does My Model Fail? Contrastive Local Explanat…

200 papers

This paper reports two experiments (N=349) on the impact of post hoc explanations by example and error rates on peoples perceptions of a black box classifier. Both experiments show that when people are given case based explanations, from an…

Machine Learning · Computer Science 2020-09-15 Courtney Ford , Eoin M. Kenny , Mark T. Keane

In recent years, neural networks have demonstrated their remarkable ability to discern intricate patterns and relationships from raw data. However, understanding the inner workings of these black box models remains challenging, yet crucial…

Machine Learning · Statistics 2024-04-18 Niklas Koenen , Marvin N. Wright

Estimating the log-likelihood gradient with respect to the parameters of a Restricted Boltzmann Machine (RBM) typically requires sampling using Markov Chain Monte Carlo (MCMC) techniques. To save computation time, the Markov chains are only…

Machine Learning · Computer Science 2017-06-29 Oswin Krause , Asja Fischer , Christian Igel

Large Language Models (LLMs) are becoming vital tools that help us solve and understand complex problems by acting as digital assistants. LLMs can generate convincing explanations, even when only given the inputs and outputs of these…

Computation and Language · Computer Science 2024-10-14 Rohan Ajwani , Shashidhar Reddy Javaji , Frank Rudzicz , Zining Zhu

Predictions obtained by, e.g., artificial neural networks have a high accuracy but humans often perceive the models as black boxes. Insights about the decision making are mostly opaque for humans. Particularly understanding the decision…

Machine Learning · Computer Science 2021-01-21 Nadia Burkart , Marco F. Huber

The recent years have witnessed the rise of accurate but obscure decision systems which hide the logic of their internal decision processes to the users. The lack of explanations for the decisions of black box systems is a key ethical…

Artificial Intelligence · Computer Science 2018-05-29 Riccardo Guidotti , Anna Monreale , Salvatore Ruggieri , Dino Pedreschi , Franco Turini , Fosca Giannotti

As machine learning (ML) models are increasingly being employed to assist human decision makers, it becomes critical to provide these decision makers with relevant inputs which can help them decide if and how to incorporate model…

Machine Learning · Computer Science 2023-06-14 Sean McGrath , Parth Mehta , Alexandra Zytek , Isaac Lage , Himabindu Lakkaraju

As artificial intelligence (AI) systems, particularly large language models (LLMs), become increasingly integrated into decision-making processes, the ability to trust their outputs is crucial. To earn human trust, LLMs must be well…

Machine Learning · Computer Science 2025-02-14 Mark Steyvers , Heliodoro Tejeda , Aakriti Kumar , Catarina Belem , Sheer Karny , Xinyue Hu , Lukas Mayer , Padhraic Smyth

Millions of users turn to AI models for their information needs. It is conceivable that a large number of user queries contain assumptions that may be factually inaccurate. Prior work notes that large language models (LLMs) often fail to…

Computation and Language · Computer Science 2026-05-06 Rose Sathyanathan , Kinshuk Vasisht , Danish Pruthi

Machine learning algorithms can now outperform classic economic models in predicting quantities ranging from bargaining outcomes, to choice under uncertainty, to an individual's future jobs and wages. Yet this predictive accuracy comes at a…

Theoretical Economics · Economics 2025-08-27 Annie Liang

The rapid development of artificial intelligence methods contributes to their wide applications for forecasting various financial risks in recent years. This study introduces a novel explainable case-based reasoning (CBR) approach without a…

Computational Finance · Quantitative Finance 2021-07-20 Wei Li , Florentina Paraschiv , Georgios Sermpinis

Machine learning (ML) models play an increasingly prevalent role in many software engineering tasks. However, because most models are now powered by opaque deep neural networks, it can be difficult for developers to understand why the model…

Software Engineering · Computer Science 2021-11-11 Jürgen Cito , Isil Dillig , Vijayaraghavan Murali , Satish Chandra

This paper provides empirical concerns about post-hoc explanations of black-box ML models, one of the major trends in AI explainability (XAI), by showing its lack of interpretability and societal consequences. Using a representative…

Human-Computer Interaction · Computer Science 2021-10-01 Jean-Marie John-Mathews

Machine learning (ML) is transforming healthcare, but safe clinical decisions demand reliable uncertainty estimates that standard ML models fail to provide. Conformal prediction (CP) is a popular tool that allows users to turn heuristic…

Machine Learning · Computer Science 2025-12-18 Klaus-Rudolf Kladny , Bernhard Schölkopf , Lisa Koch , Christian F. Baumgartner , Michael Muehlebach

Interpretability has become incredibly important as machine learning is increasingly used to inform consequential decisions. We propose to construct global explanations of complex, blackbox models in the form of a decision tree…

Machine Learning · Computer Science 2019-01-28 Osbert Bastani , Carolyn Kim , Hamsa Bastani

In the design of efficient simulation algorithms, one is often beset with a poor choice of proposal distributions. Although the performance of a given simulation kernel can clarify a posteriori how adequate this kernel is for the problem at…

Statistics Theory · Mathematics 2010-10-11 R. Douc , A. Guillin , J. -M. Marin , C. P. Robert

Typically, machine learning models are trained and evaluated without making any distinction between users (e.g, using traditional hold-out and cross-validation). However, this produces inaccurate performance metrics estimates in multi-user…

Machine Learning · Computer Science 2023-12-11 Enrique Garcia-Ceja , Luciano Garcia-Banuelos , Nicolas Jourdan

Explainable machine learning (XML) has emerged as a major challenge in artificial intelligence (AI). Although black-box models such as Deep Neural Networks and Gradient Boosting often exhibit exceptional predictive accuracy, their lack of…

Methodology · Statistics 2024-06-18 Evgenii Kuriabov , Jia Li

In many high-risk machine learning applications it is essential for a model to indicate when it is uncertain about a prediction. While large language models (LLMs) can reach and even surpass human-level accuracy on a variety of benchmarks,…

Computation and Language · Computer Science 2024-06-06 Evan Becker , Stefano Soatto

The financial industry faces a significant challenge modeling and risk portfolios: balancing the predictability of advanced machine learning models, neural network models, and explainability required by regulatory entities (such as Office…

Machine Learning · Computer Science 2025-11-10 Rongbin Ye , Jiaqi Chen