English
Related papers

Related papers: Data-driven advice for interpreting local and glob…

200 papers

A central goal of eXplainable Artificial Intelligence (XAI) is to assign relative importance to the features of a Machine Learning (ML) model given some prediction. The importance of this task of explainability by feature attribution is…

Artificial Intelligence · Computer Science 2024-05-21 Olivier Letoffe , Xuanxiang Huang , Nicholas Asher , Joao Marques-Silva

Many of the traditional recommendation algorithms are designed based on the fundamental idea of mining or learning correlative patterns from data to estimate the user-item correlative preference. However, pure correlative learning may lead…

Information Retrieval · Computer Science 2023-08-15 Shuyuan Xu , Yingqiang Ge , Yunqi Li , Zuohui Fu , Xu Chen , Yongfeng Zhang

A new approach called NAF (the Neural Attention Forest) for solving regression and classification tasks under tabular training data is proposed. The main idea behind the proposed NAF model is to introduce the attention mechanism into the…

Machine Learning · Computer Science 2023-04-13 Andrei V. Konstantinov , Lev V. Utkin , Alexey A. Lukashin , Vladimir A. Muliukha

Understanding predictions made by Machine Learning models is critical in many applications. In this work, we investigate the performance of two methods for explaining tree-based models- Tree Interpreter (TI) and SHapley Additive…

Artificial Intelligence · Computer Science 2020-10-15 Pulkit Sharma , Shezan Rohinton Mirzan , Apurva Bhandari , Anish Pimpley , Abhiram Eswaran , Soundar Srinivasan , Liqun Shao

High-cardinality categorical variables are variables for which the number of different levels is large relative to the sample size of a data set, or in other words, there are few data points per level. Machine learning methods can have…

Machine Learning · Computer Science 2023-07-06 Fabio Sigrist

In recent years, two parallel research trends have emerged in machine learning, yet their intersections remain largely unexplored. On one hand, there has been a significant increase in literature focused on Individual Treatment Effect (ITE)…

Shapley value is a widely used tool in explainable artificial intelligence (XAI), as it provides a principled way to attribute contributions of input features to model outputs. However, estimation of Shapley value requires capturing…

Machine Learning · Computer Science 2025-11-05 Cheng Lu , Jiusun Zeng , Yu Xia , Jinhui Cai , Shihua Luo

Algorithms for binary classification based on adaptive tree partitioning are formulated and analyzed for both their risk performance and their friendliness to numerical implementation. The algorithms can be viewed as generating a set…

Statistics Theory · Mathematics 2014-11-05 Peter Binev , Albert Cohen , Wolfgang Dahmen , Ronald DeVore

Explainable Artificial Intelligence (XAI) techniques, such as SHapley Additive exPlanations (SHAP), have become essential tools for interpreting complex ensemble tree-based models, especially in high-stakes domains such as healthcare…

Artificial Intelligence · Computer Science 2026-02-25 Akshat Dubey , Aleksandar Anžel , Bahar İlgen , Georges Hattab

A key challenge in estimating causal effects from observational data is handling confounding and is commonly achieved through weighting methods that balance distribution of covariates between treatment and control groups. Weighting…

Methodology · Statistics 2025-12-23 Simion De , Jared D. Huling

In this paper, we propose the use of causal inference techniques for survival function estimation and prediction for subgroups of the data, upto individual units. Tree ensemble methods, specifically random forests were modified for this…

Econometrics · Economics 2018-03-23 Vikas Ramachandra

As Artificial Intelligence (AI) is used in more applications, the need to consider and mitigate biases from the learned models has followed. Most works in developing fair learning algorithms focus on the offline setting. However, in many…

Machine Learning · Computer Science 2021-08-24 Wenbin Zhang , Albert Bifet , Xiangliang Zhang , Jeremy C. Weiss , Wolfgang Nejdl

Estimation of heterogeneous treatment effects (HTE) is of prime importance in many disciplines, ranging from personalized medicine to economics among many others. Random forests have been shown to be a flexible and powerful approach to HTE…

Methodology · Statistics 2025-10-07 Susanne Dandl , Torsten Hothorn , Heidi Seibold , Erik Sverdrup , Stefan Wager , Achim Zeileis

Ensemble-based modifications of the well-known SHapley Additive exPlanations (SHAP) method for the local explanation of a black-box model are proposed. The modifications aim to simplify SHAP which is computationally expensive when there is…

Machine Learning · Computer Science 2021-03-08 Lev V. Utkin , Andrei V. Konstantinov

The present work provides an application of Global Sensitivity Analysis to supervised machine learning methods such as Random Forests. These methods act as black boxes, selecting features in high--dimensional data sets as to provide…

Machine Learning · Statistics 2024-07-22 Giulia Vannucci , Roberta Siciliano , Andrea Saltelli

The recent increase in the deployment of machine learning models in critical domains such as healthcare, criminal justice, and finance has highlighted the need for trustworthy methods that can explain these models to stakeholders. Feature…

Machine Learning · Computer Science 2021-10-04 Angeline Yasodhara , Azin Asgarian , Diego Huang , Parinaz Sobhani

We propose a topological learning algorithm for the estimation of the conditional dependency structure of large sets of random variables from sparse and noisy data. The algorithm, named Maximally Filtered Clique Forest (MFCF), produces a…

Machine Learning · Statistics 2021-05-18 Guido Previde Massara , Tomaso Aste

Decision-making plays a pivotal role in shaping outcomes in various disciplines, such as medicine, economics, and business. This paper provides guidance to practitioners on how to implement a decision tree designed to address treatment…

Econometrics · Economics 2024-06-05 Hugo Bodory , Federica Mascolo , Michael Lechner

Minimising a spectral risk objective, defined as a convex combination of expected cost and Conditional Value-at-Risk (CVaR), is challenging when the uncertainty distribution is decision-dependent, making both surrogate modelling and…

Machine Learning · Computer Science 2026-03-16 Marcell T. Kurbucz

Feature and Interaction Importance (FII) methods are essential in supervised learning for assessing the relevance of input variables and their interactions in complex prediction models. In many domains, such as personalized medicine, local…

Machine Learning · Statistics 2025-12-15 Kata Vuk , Nicolas Alexander Ihlo , Merle Behr