English
Related papers

Related papers: SHAP-Guided Regularization in Machine Learning Mod…

200 papers

Shapley values are ubiquitous in interpretable Machine Learning due to their strong theoretical background and efficient implementation in the SHAP library. Computing these values previously induced an exponential cost with respect to the…

Machine Learning · Computer Science 2022-12-06 Gabriel Laberge , Yann Pequignot

Nowadays, the interpretation of why a machine learning (ML) model makes certain inferences is as crucial as the accuracy of such inferences. Some ML models like the decision tree possess inherent interpretability that can be directly…

Machine Learning · Computer Science 2023-04-11 Han Yuan , Mingxuan Liu , Lican Kang , Chenkui Miao , Ying Wu

Machine learning is the dominant approach to artificial intelligence, through which computers learn from data and experience. In the framework of supervised learning, a necessity for a computer to learn from data accurately and efficiently…

Machine Learning · Statistics 2023-01-25 Amir R. Asadi

Existing training criteria in automatic speech recognition(ASR) permit the model to freely explore more than one time alignments between the feature and label sequences. In this paper, we use entropy to measure a model's uncertainty, i.e.…

Computation and Language · Computer Science 2022-12-26 Ehsan Variani , Ke Wu , David Rybach , Cyril Allauzen , Michael Riley

Ensuring fairness in machine learning models is critical, particularly in high-stakes domains where biased decisions can lead to serious societal consequences. Existing preprocessing approaches generally lack transparent mechanisms for…

Machine Learning · Computer Science 2026-02-24 Lin Zhu , Yijun Bian , Lei You

The ability to understand and trust the fairness of model predictions, particularly when considering the outcomes of unprivileged groups, is critical to the deployment and adoption of machine learning systems. SHAP values provide a unified…

Machine Learning · Computer Science 2020-06-29 James M. Hickey , Pietro G. Di Stefano , Vlasios Vasileiou

Shapley value is a widely used tool in explainable artificial intelligence (XAI), as it provides a principled way to attribute contributions of input features to model outputs. However, estimation of Shapley value requires capturing…

Machine Learning · Computer Science 2025-11-05 Cheng Lu , Jiusun Zeng , Yu Xia , Jinhui Cai , Shihua Luo

Originally introduced in cooperative game theory, Shapley values have become a very popular tool to explain machine learning predictions. Based on Shapley's fairness axioms, every input (feature component) gets a credit how it contributes…

Machine Learning · Statistics 2025-08-19 Michael Mayer , Mario V. Wüthrich

In high-dimensional linear models, sparsity is often exploited to reduce variability and achieve parsimony. Equi-sparsity, where one assumes that predictors can be aggregated into groups sharing the same effects, is an alternative…

Methodology · Statistics 2025-10-02 Jinwen Fu , Aaron J. Molstad , Hui Zou

Feature selection identifies subsets of informative features and reduces dimensions in the original feature space, helping provide insights into data generation or a variety of domain problems. Existing methods mainly depend on feature…

Machine Learning · Computer Science 2021-06-07 Xinxing Wu , Qiang Cheng

Unsupervised and self-supervised learning approaches have become a crucial tool to learn representations for downstream prediction tasks. While these approaches are widely used in practice and achieve impressive empirical gains, their…

Machine Learning · Computer Science 2020-10-23 Siddhant Garg , Yingyu Liang

While there are many studies on weight regularization, the study on structure regularization is rare. Many existing systems on structured prediction focus on increasing the level of structural dependencies within the model. However, this…

Machine Learning · Computer Science 2015-02-02 Xu Sun

Regularization is a big issue for training deep neural networks. In this paper, we propose a new information-theory-based regularization scheme named SHADE for SHAnnon DEcay. The originality of the approach is to define a prior based on…

Machine Learning · Statistics 2018-05-16 Michael Blot , Thomas Robert , Nicolas Thome , Matthieu Cord

Many existing interpretation methods are based on Partial Dependence (PD) functions that, for a pre-trained machine learning model, capture how a subset of the features affects the predictions by averaging over the remaining features.…

Machine Learning · Computer Science 2025-06-05 Jinyang Liu , Tessa Steensgaard , Marvin N. Wright , Niklas Pfister , Munir Hiabu

Regularization is a big issue for training deep neural networks. In this paper, we propose a new information-theory-based regularization scheme named SHADE for SHAnnon DEcay. The originality of the approach is to define a prior based on…

Machine Learning · Statistics 2018-05-23 Michael Blot , Thomas Robert , Nicolas Thome , Matthieu Cord

Local feature attribution methods are increasingly used to explain complex machine learning models. However, current methods are limited because they are extremely expensive to compute or are not capable of explaining a distributed series…

Machine Learning · Computer Science 2022-10-12 Hugh Chen , Scott M. Lundberg , Su-In Lee

In recent years, two parallel research trends have emerged in machine learning, yet their intersections remain largely unexplored. On one hand, there has been a significant increase in literature focused on Individual Treatment Effect (ITE)…

This paper introduces the shapr R package, a versatile tool for generating Shapley value-based prediction explanations for machine learning and statistical regression models. Moreover, the shaprpy Python library brings the core capabilities…

Machine Learning · Computer Science 2026-02-03 Martin Jullum , Lars Henry Berge Olsen , Jon Lachmann , Annabelle Redelmeier

In spite of increased attention on explainable machine learning models, explaining multi-output predictions has not yet been extensively addressed. Methods that use Shapley values to attribute feature contributions to the decision making…

Machine Learning · Computer Science 2023-03-31 Célia Wafa Ayad , Thomas Bonnier , Benjamin Bosch , Jesse Read

A number of techniques have been proposed to explain a machine learning model's prediction by attributing it to the corresponding input features. Popular among these are techniques that apply the Shapley value method from cooperative game…

Machine Learning · Computer Science 2020-06-29 Luke Merrick , Ankur Taly