English
Related papers

Related papers: Evaluating Local Explanations using White-box Mode…

200 papers

In recent years, neural networks have demonstrated their remarkable ability to discern intricate patterns and relationships from raw data. However, understanding the inner workings of these black box models remains challenging, yet crucial…

Machine Learning · Statistics 2024-04-18 Niklas Koenen , Marvin N. Wright

Machine learning (ML) has seen significant growth in both popularity and importance. The high prediction accuracy of ML models is often achieved through complex black-box architectures that are difficult to interpret. This interpretability…

Machine Learning · Statistics 2024-07-29 David Köhler , David Rügamer , Matthias Schmid

EXplainable AI has received significant attention in recent years. Machine learning models often operate as black boxes, lacking explainability and transparency while supporting decision-making processes. Local post-hoc explainability…

Artificial Intelligence · Computer Science 2024-05-24 Gianvincenzo Alfano , Sergio Greco , Domenico Mandaglio , Francesco Parisi , Reza Shahbazian , Irina Trubitsyna

We evaluated whether model explanations could efficiently detect bias in image classification by highlighting discriminating features, thereby removing the reliance on sensitive attributes for fairness calculations. To this end, we…

Computer Vision and Pattern Recognition · Computer Science 2020-12-11 Schrasing Tong , Lalana Kagal

We study fairness in Machine Learning (FairML) through the lens of attribute-based explanations generated for machine learning models. Our hypothesis is: Biased Models have Biased Explanations. To establish that, we first translate existing…

Machine Learning · Computer Science 2020-12-22 Aditya Jain , Manish Ravula , Joydeep Ghosh

Models in the supervised learning framework may capture rich and complex representations over the features that are hard for humans to interpret. Existing methods to explain such models are often specific to architectures and data where the…

Machine Learning · Computer Science 2021-02-25 Akshay Sood , Mark Craven

With the increasing deployment of machine learning systems in practice, transparency and explainability have become serious issues. Contrastive explanations are considered to be useful and intuitive, in particular when it comes to…

Machine Learning · Computer Science 2021-01-05 André Artelt , Barbara Hammer

Providing natural language explanations for recommendations is particularly useful from the perspective of a non-expert user. Although several methods for providing such explanations have recently been proposed, we argue that an important…

Computation and Language · Computer Science 2025-03-19 Jakub Raczyński , Mateusz Lango , Jerzy Stefanowski

When investigators seek to estimate causal effects, they often assume that selection into treatment is based only on observed covariates. Under this identification strategy, analysts must adjust for observed confounders. While basic…

Applications · Statistics 2019-01-09 Luke Keele , Dylan Small

A predictive model makes outcome predictions based on some given features, i.e., it estimates the conditional probability of the outcome given a feature vector. In general, a predictive model cannot estimate the causal effect of a feature…

Machine Learning · Computer Science 2023-04-11 Jiuyong Li , Lin Liu , Ziqi Xu , Ha Xuan Tran , Thuc Duy Le , Jixue Liu

We develop a method for generating causal post-hoc explanations of black-box classifiers based on a learned low-dimensional representation of the data. The explanation is causal in the sense that changing learned latent factors produces a…

Machine Learning · Computer Science 2020-10-23 Matthew O'Shaughnessy , Gregory Canal , Marissa Connor , Mark Davenport , Christopher Rozell

We propose a large language model explainability technique for obtaining faithful natural language explanations by grounding the explanations in a reasoning process. When converted to a sequence of tokens, the outputs of the reasoning…

Machine Learning · Computer Science 2026-03-17 Vojtech Cahlik , Rodrigo Alves , Pavel Kordik

There has been a recent push in making machine learning models more interpretable so that their performance can be trusted. Although successful, these methods have mostly focused on the deep learning methods while the fundamental…

Machine Learning · Computer Science 2022-06-16 David Steinmann , Matej Zečević , Devendra Singh Dhami , Kristian Kersting

As machine learning models evolve, maintaining transparency demands more human-centric explainable AI techniques. Counterfactual explanations, with roots in human reasoning, identify the minimal input changes needed to obtain a given output…

Artificial Intelligence · Computer Science 2025-04-23 Marharyta Domnich , Julius Välja , Rasmus Moorits Veski , Giacomo Magnifico , Kadi Tulver , Eduard Barbu , Raul Vicente

As the use of deep learning techniques has grown across various fields over the past decade, complaints about the opaqueness of the black-box models have increased, resulting in an increased focus on transparency in deep learning models.…

Computation and Language · Computer Science 2024-03-19 Siwen Luo , Hamish Ivison , Caren Han , Josiah Poon

Recent research on model interpretability in natural language processing extensively uses feature scoring methods for identifying which parts of the input are the most important for a model to make a prediction (i.e. explanation or…

Computation and Language · Computer Science 2021-12-07 George Chrysostomou , Nikolaos Aletras

In machine learning algorithm design, there exists a trade-off between the interpretability and performance of the algorithm. In general, algorithms which are simpler and easier for humans to comprehend tend to show worse performance than…

Machine Learning · Computer Science 2024-07-15 Eric M. Vernon , Naoki Masuyama , Yusuke Nojima

In recent years, a number of artificial intelligent services have been developed such as defect detection system or diagnosis system for customer services. Unfortunately, the core in these services is a black-box in which human cannot…

Artificial Intelligence · Computer Science 2017-09-20 Jaedeok Kim , Jingoo Seo

As input data distributions evolve, the predictive performance of machine learning models tends to deteriorate. In the past, predictive performance was considered the key indicator to monitor. However, explanation aspects have come to…

Machine Learning · Computer Science 2022-10-25 Carlos Mougan , Klaus Broelemann , Gjergji Kasneci , Thanassis Tiropanis , Steffen Staab

Large language models (LLMs) are prone to generating factually incorrect outputs. Recent work has applied conformal prediction to provide uncertainty estimates and statistical guarantees for the factuality of LLM generations. However,…

Computation and Language · Computer Science 2026-04-16 Aleksandr Rubashevskii , Dzianis Piatrashyn , Preslav Nakov , Maxim Panov