English
Related papers

Related papers: Evaluating Input Feature Explanations through a Un…

200 papers

Multi-label classification is a type of classification task, it is used when there are two or more classes, and the data point we want to predict may belong to none of the classes or all of them at the same time. In the real world, many…

Machine Learning · Computer Science 2021-04-26 Shikun Chen

Unpacking and comprehending how black-box machine learning algorithms make decisions has been a persistent challenge for researchers and end-users. Explaining time-series predictive models is useful for clinical applications with high…

Machine Learning · Computer Science 2023-05-09 Amin Nayebi , Sindhu Tipirneni , Chandan K Reddy , Brandon Foreman , Vignesh Subbian

We study instancewise feature importance scoring as a method for model interpretation. Any such method yields, for each predicted instance, a vector of importance scores associated with the feature vector. Methods based on the Shapley score…

Machine Learning · Computer Science 2018-08-09 Jianbo Chen , Le Song , Martin J. Wainwright , Michael I. Jordan

Many applications of data-driven models demand transparency of decisions, especially in health care, criminal justice, and other high-stakes environments. Modern trends in machine learning research have led to algorithms that are…

Machine Learning · Computer Science 2022-05-09 Zachariah Carmichael , Walter J. Scheirer

Layer-wise Relevance Propagation (LRP) and saliency maps have been recently used to explain the predictions of Deep Learning models, specifically in the domain of text classification. Given different attribution-based explanations to…

Information Retrieval · Computer Science 2018-12-04 Wenting Xiong , Iftitahu Ni'mah , Juan M. G. Huesca , Werner van Ipenburg , Jan Veldsink , Mykola Pechenizkiy

A fundamental research goal for Explainable AI (XAI) is to build models that are capable of reasoning through the generation of natural language explanations. However, the methodologies to design and evaluate explanation-based inference…

Artificial Intelligence · Computer Science 2022-05-06 Marco Valentino , André Freitas

This study presents insights gathered from surveys and discussions with specialists in three domains, aiming to find essential elements for a universal explanation framework that could be applied to these and other similar use cases. The…

Machine Learning · Computer Science 2025-04-22 Eduard Barbu , Marharyta Domnich , Raul Vicente , Nikos Sakkas , André Morim

This paper introduces an explanation framework designed to enhance the quality of rules in knowledge-based reasoning systems based on dataset-driven insights. The traditional method for rule induction from data typically requires…

Artificial Intelligence · Computer Science 2025-02-04 Oshani Seneviratne , Brendan Capuzzo , William Van Woensel

As Natural Language Processing (NLP) models continue to evolve and become integral to high-stakes applications, ensuring their interpretability remains a critical challenge. Given the growing variety of explainability methods and diverse…

Computation and Language · Computer Science 2025-05-05 Mahdi Dhaini , Kafaite Zahra Hussain , Efstratios Zaradoukas , Gjergji Kasneci

Feature attributions based on the Shapley value are popular for explaining machine learning models; however, their estimation is complex from both a theoretical and computational standpoint. We disentangle this complexity into two factors:…

Machine Learning · Computer Science 2022-07-18 Hugh Chen , Ian C. Covert , Scott M. Lundberg , Su-In Lee

Explanations of model behavior are commonly evaluated via proxy properties weakly tied to the purposes explanations serve in practice. We contribute a decision theoretic framework that treats explanations as information signals valued by…

Artificial Intelligence · Computer Science 2026-02-24 Ziyang Guo , Berk Ustun , Jessica Hullman

Context utilisation, the ability of Language Models (LMs) to incorporate relevant information from the provided context when generating responses, remains largely opaque to users, who cannot determine whether models draw from parametric…

Computation and Language · Computer Science 2026-04-28 Jingyi Sun , Pepa Atanasova , Sagnik Ray Choudhury , Sekh Mainul Islam , Isabelle Augenstein

The evolution of Explainable Artificial Intelligence (XAI) has emphasised the significance of meeting diverse user needs. The approaches to identifying and addressing these needs must also advance, recognising that explanation experiences…

Human-Computer Interaction · Computer Science 2024-05-20 Anjana Wijekoon , David Corsar , Nirmalie Wiratunga , Kyle Martin , Pedram Salimi

Artificial Intelligence (AI) is often an integral part of modern decision support systems. The best-performing predictive models used in AI-based decision support systems lack transparency. Explainable Artificial Intelligence (XAI) aims to…

Machine Learning · Computer Science 2025-02-25 Tuwe Löfström , Helena Löfström , Ulf Johansson , Cecilia Sönströd , Rudy Matela

Modern AI systems frequently rely on opaque black-box models, most notably Deep Neural Networks, whose performance stems from complex architectures with millions of learned parameters. While powerful, their complexity poses a major…

Machine Learning · Computer Science 2026-02-23 David Dembinsky , Adriano Lucieri , Stanislav Frolov , Hiba Najjar , Ko Watanabe , Andreas Dengel

Interpretable machine learning has been focusing on explaining final models that optimize performance. The current state-of-the-art is the Shapley additive explanations (SHAP) that locally explains variable impact on individual predictions,…

Algorithmic approaches to interpreting machine learning models have proliferated in recent years. We carry out human subject tests that are the first of their kind to isolate the effect of algorithmic explanations on a key aspect of model…

Computation and Language · Computer Science 2020-05-06 Peter Hase , Mohit Bansal

Recent advancements in machine learning have spurred growing interests in automated interpreting quality assessment. Nevertheless, existing research suffers from insufficient examination of language use quality, unsatisfactory modeling…

Computation and Language · Computer Science 2025-08-15 Zhaokun Jiang , Ziyin Zhang

In-context learning (ICL) is an important paradigm for adapting large language models (LLMs) to new tasks, but the generalization behavior of ICL remains poorly understood. We investigate the inductive biases of ICL from the perspective of…

Computation and Language · Computer Science 2023-05-23 Chenglei Si , Dan Friedman , Nitish Joshi , Shi Feng , Danqi Chen , He He

Feature construction can contribute to comprehensibility and performance of machine learning models. Unfortunately, it usually requires exhaustive search in the attribute space or time-consuming human involvement to generate meaningful…

Machine Learning · Computer Science 2023-01-24 Boštjan Vouk , Matej Guid , Marko Robnik-Šikonja