English
Related papers

Related papers: Understanding Disparities in Post Hoc Machine Lear…

200 papers

Recently, there has been a lot of interest in ensuring algorithmic fairness in machine learning where the central question is how to prevent sensitive information (e.g. knowledge about the ethnic group of an individual) from adding "unfair"…

Machine Learning · Computer Science 2020-05-19 Aarsh Patel , Rahul Gupta , Mukund Harakere , Satyapriya Krishna , Aman Alok , Peng Liu

In real data, missing values occur frequently, which affects the interpretation with interpretable machine learning (IML) methods. Recent work considers bias and shows that model explanations may differ between imputation methods, while…

Machine Learning · Statistics 2025-12-22 Pegah Golchian , Marvin N. Wright

In spite of several claims stating that some models are more interpretable than others -- e.g., "linear models are more interpretable than deep neural networks" -- we still lack a principled notion of interpretability to formally compare…

Artificial Intelligence · Computer Science 2020-11-16 Pablo Barceló , Mikaël Monet , Jorge Pérez , Bernardo Subercaseaux

Explanations in interactive machine-learning systems facilitate debugging and improving prediction models. However, the effectiveness of various global model-centric and data-centric explanations in aiding domain experts to detect and…

Artificial Intelligence · Computer Science 2024-02-02 Aditya Bhattacharya , Simone Stumpf , Lucija Gosak , Gregor Stiglic , Katrien Verbert

Growing use of machine learning in policy and social impact settings have raised concerns for fairness implications, especially for racial minorities. These concerns have generated considerable interest among machine learning and artificial…

Machine Learning · Computer Science 2021-10-15 Kit T. Rodolfa , Hemank Lamba , Rayid Ghani

Machine learning models that incorporate concept learning as an intermediate step in their decision making process can match the performance of black-box predictive models while retaining the ability to explain outcomes in human…

Machine Learning · Computer Science 2021-06-28 Anita Mahinpei , Justin Clark , Isaac Lage , Finale Doshi-Velez , Weiwei Pan

Humans use abstract concepts for understanding instead of hard features. Recent interpretability research has focused on human-centered concept explanations of neural networks. Concept Activation Vectors (CAVs) estimate a model's…

Machine Learning · Computer Science 2023-11-28 Avani Gupta , Saurabh Saini , P J Narayanan

Predicting default is essential for banks to ensure profitability and financial stability. While modern machine learning methods often outperform traditional regression techniques, their lack of transparency limits their use in regulated…

Machine Learning · Computer Science 2025-09-16 Sagi Schwartz , Qinling Wang , Fang Fang

Explainability of AI models is an important topic that can have a significant impact in all domains and applications from autonomous driving to healthcare. The existing approaches to explainable AI (XAI) are mainly limited to simple machine…

Machine Learning · Computer Science 2023-05-24 Poushali Sengupta , Yan Zhang , Sabita Maharjan , Frank Eliassen

An important limitation to the development of AI-based solutions for In Vitro Fertilization (IVF) is the black-box nature of most state-of-the-art models, due to the complexity of deep learning architectures, which raises potential bias and…

Computer Vision and Pattern Recognition · Computer Science 2022-05-16 Tristan Gomez , Thomas Fréour , Harold Mouchère

Deploying machine learning models in safety-related do-mains (e.g. autonomous driving, medical diagnosis) demands for approaches that are explainable, robust against adversarial attacks and aware of the model uncertainty. Recent deep…

Computer Vision and Pattern Recognition · Computer Science 2020-12-14 Jan Kronenberger , Anselm Haselhoff

Interpretable machine learning offers insights into what factors drive a certain prediction of a black-box system. A large number of interpreting methods focus on identifying explanatory input features, which generally fall into two main…

Machine Learning · Computer Science 2023-06-02 Vy Vo , Van Nguyen , Trung Le , Quan Hung Tran , Gholamreza Haffari , Seyit Camtepe , Dinh Phung

There have been several research works proposing new Explainable AI (XAI) methods designed to generate model explanations having specific properties, or desiderata, such as fidelity, robustness, or human-interpretability. However,…

Artificial Intelligence · Computer Science 2021-01-25 Sérgio Jesus , Catarina Belém , Vladimir Balayan , João Bento , Pedro Saleiro , Pedro Bizarro , João Gama

Prior work on generating explanations in a planning and decision-making context has focused on providing the rationale behind an AI agent's decision making. While these methods provide the right explanations from the explainer's…

Artificial Intelligence · Computer Science 2020-10-20 Mehrdad Zakershahrak , Shashank Rao Marpally , Akshay Sharma , Ze Gong , Yu Zhang

Since the early days of the Explainable AI movement, post-hoc explanations have been praised for their potential to improve user understanding, promote trust, and reduce patient safety risks in black box medical AI systems. Recently,…

Human-Computer Interaction · Computer Science 2026-02-06 Joshua Hatherley , Lauritz Munch , Jens Christian Bjerring

Explainable Recommendation has attracted a lot of attention due to a renewed interest in explainable artificial intelligence. In particular, post-hoc approaches have proved to be the most easily applicable ones to increasingly complex…

Information Retrieval · Computer Science 2021-10-11 Vito Walter Anelli , Alejandro Bellogín , Tommaso Di Noia , Francesco Maria Donini , Vincenzo Paparella , Claudio Pomo

Feature attribution methods are widely used for explaining image-based predictions, as they provide feature-level insights that can be intuitively visualized. However, such explanations often vary in their robustness and may fail to…

Computer Vision and Pattern Recognition · Computer Science 2025-09-26 Amr Alkhatib , Stephanie Lowry

With the availability of large databases and recent improvements in deep learning methodology, the performance of AI systems is reaching or even exceeding the human level on an increasing number of complex tasks. Impressive examples of this…

Artificial Intelligence · Computer Science 2017-08-29 Wojciech Samek , Thomas Wiegand , Klaus-Robert Müller

Interpreting the inner workings of deep learning models is crucial for establishing trust and ensuring model safety. Concept-based explanations have emerged as a superior approach that is more interpretable than feature attribution…

Machine Learning · Computer Science 2023-07-17 Mara Graziani , Laura O' Mahony , An-Phi Nguyen , Henning Müller , Vincent Andrearczyk

As machine learning models become more accurate, they typically become more complex and uninterpretable by humans. The black-box character of these models holds back its acceptance in practice, especially in high-risk domains where the…

Artificial Intelligence · Computer Science 2019-08-19 Ajaya Adhikari , D. M. J Tax , Riccardo Satta , Matthias Fath