English
Related papers

Related papers: Streamlining models with explanations in the learn…

200 papers

As the decisions made or influenced by machine learning models increasingly impact our lives, it is crucial to detect, understand, and mitigate unfairness. But even simply determining what "unfairness" should mean in a given context is…

Machine Learning · Computer Science 2020-10-16 Tom Begley , Tobias Schwedes , Christopher Frye , Ilya Feige

Pre-trained language models have been successful on text classification tasks, but are prone to learning spurious correlations from biased datasets, and are thus vulnerable when making inferences in a new domain. Prior work reveals such…

Computation and Language · Computer Science 2022-01-03 Huihan Yao , Ying Chen , Qinyuan Ye , Xisen Jin , Xiang Ren

Black-box Artificial Intelligence (AI) methods, e.g. deep neural networks, have been widely utilized to build predictive models that can extract complex relationships in a dataset and make predictions for new unseen data records. However,…

Artificial Intelligence · Computer Science 2020-09-22 Milad Moradi , Matthias Samwald

Causal approaches to post-hoc explainability for black-box prediction models (e.g., deep neural networks trained on image pixel data) have become increasingly popular. However, existing approaches have two important shortcomings: (i) the…

Machine Learning · Computer Science 2025-08-12 Numair Sani , Daniel Malinsky , Ilya Shpitser

Explainable Artificial Intelligence (XAI) is an emerging research field bringing transparency to highly complex and opaque machine learning (ML) models. Despite the development of a multitude of methods to explain the decisions of black-box…

Machine Learning · Computer Science 2022-03-16 Leander Weber , Sebastian Lapuschkin , Alexander Binder , Wojciech Samek

We consider the problem of explaining the predictions of an arbitrary blackbox model $f$: given query access to $f$ and an instance $x$, output a small set of $x$'s features that in conjunction essentially determines $f(x)$. We design an…

Machine Learning · Computer Science 2021-11-03 Guy Blanc , Jane Lange , Li-Yang Tan

Artificial Intelligence (AI) is often an integral part of modern decision support systems. The best-performing predictive models used in AI-based decision support systems lack transparency. Explainable Artificial Intelligence (XAI) aims to…

Machine Learning · Computer Science 2025-02-25 Tuwe Löfström , Helena Löfström , Ulf Johansson , Cecilia Sönströd , Rudy Matela

As machine learning models become more accurate, they typically become more complex and uninterpretable by humans. The black-box character of these models holds back its acceptance in practice, especially in high-risk domains where the…

Artificial Intelligence · Computer Science 2019-08-19 Ajaya Adhikari , D. M. J Tax , Riccardo Satta , Matthias Fath

Deep learning algorithms have recently shown to be a successful tool in estimating parameters of statistical models for which simulation is easy, but likelihood computation is challenging. But the success of these approaches depends on…

Machine Learning · Statistics 2024-02-20 Amanda Lenzi , Haavard Rue

Explanations have gained an increasing level of interest in the AI and Machine Learning (ML) communities in order to improve model transparency and allow users to form a mental model of a trained ML model. However, explanations can go…

Machine Learning · Computer Science 2022-10-11 Stefano Teso , Öznur Alkan , Wolfang Stammer , Elizabeth Daly

Explainability of neural network prediction is essential to understand feature importance and gain interpretable insight into neural network performance. However, explanations of neural network outcomes are mostly limited to visualization,…

Machine Learning · Computer Science 2023-07-13 Arnab Neelim Mazumder , Niall Lyons , Ashutosh Pandey , Avik Santra , Tinoosh Mohsenin

Explainable AI is an evolving area that deals with understanding the decision making of machine learning models so that these models are more transparent, accountable, and understandable for humans. In particular, post-hoc model-agnostic…

Machine Learning · Computer Science 2023-07-04 Praharsh Nanavati , Ranjitha Prasad

Interpretable machine learning seeks to understand the reasoning process of complex black-box systems that are long notorious for lack of explainability. One flourishing approach is through counterfactual explanations, which provide…

Artificial Intelligence · Computer Science 2023-06-02 Vy Vo , Trung Le , Van Nguyen , He Zhao , Edwin Bonilla , Gholamreza Haffari , Dinh Phung

This paper presents a comprehensive theoretical investigation into the parameterized complexity of explanation problems in various machine learning (ML) models. Contrary to the prevalent black-box perception, our study focuses on models…

Artificial Intelligence · Computer Science 2025-11-06 Sebastian Ordyniak , Giacomo Paesani , Mateusz Rychlicki , Stefan Szeider

Counterfactual Explanations are becoming a de-facto standard in post-hoc interpretable machine learning. For a given classifier and an instance classified in an undesired class, its counterfactual explanation corresponds to small…

Machine Learning · Computer Science 2024-01-17 Veronica Piccialli , Dolores Romero Morales , Cecilia Salvatore

Neural networks are ubiquitous in applied machine learning for education. Their pervasive success in predictive performance comes alongside a severe weakness, the lack of explainability of their decisions, especially relevant in…

Machine Learning · Computer Science 2022-07-04 Vinitra Swamy , Bahar Radmehr , Natasa Krco , Mirko Marras , Tanja Käser

The development of machine learning applications has increased significantly in recent years, motivated by the remarkable ability of learning-powered systems to discover and generalize intricate patterns hidden in massive datasets. Modern…

Machine Learning · Computer Science 2025-04-25 Evandro S. Ortigossa , Fábio F. Dias , Brian Barr , Claudio T. Silva , Luis Gustavo Nonato

Our goal is to provide a review of deep learning methods which provide insight into structured high-dimensional data. Rather than using shallow additive architectures common to most statistical models, deep learning uses layers of…

Machine Learning · Statistics 2023-10-11 Nick Polson , Vadim Sokolov

Transformer language models are state of the art in a multitude of NLP tasks. Despite these successes, their opaqueness remains problematic. Recent methods aiming to provide interpretability and explainability to black-box models primarily…

Computation and Language · Computer Science 2022-03-14 Felix Friedrich , Patrick Schramowski , Christopher Tauchmann , Kristian Kersting

As machine learning black boxes are increasingly being deployed in domains such as healthcare and criminal justice, there is growing emphasis on building tools and techniques for explaining these black boxes in an interpretable manner. Such…

Machine Learning · Computer Science 2020-02-04 Dylan Slack , Sophie Hilgard , Emily Jia , Sameer Singh , Himabindu Lakkaraju