English
Related papers

Related papers: Making Tree Ensembles Interpretable

200 papers

Data-driven pricing strategies are becoming increasingly common, where customers are offered a personalized price based on features that are predictive of their valuation of a product. It is desirable for this pricing policy to be simple…

Machine Learning · Statistics 2021-06-11 Max Biggs , Wei Sun , Markus Ettl

We tackle the problem of building explainable recommendation systems that are based on a per-user decision tree, with decision rules that are based on single attribute values. We build the trees by applying learned regression functions to…

Machine Learning · Computer Science 2019-12-20 Eyal Shulman , Lior Wolf

Improving the explainability of the results from machine learning methods has become an important research goal. Here, we study the problem of making clusters more interpretable by extending a recent approach of [Davidson et al., NeurIPS…

Data Structures and Algorithms · Computer Science 2020-02-10 Prathyush Sambaturu , Aparna Gupta , Ian Davidson , S. S. Ravi , Anil Vullikanti , Andrew Warren

Random forests and, more generally, (decision\nobreakdash-)tree ensembles are widely used methods for classification and regression. Recent algorithmic advances allow to compute decision trees that are optimal for various measures such as…

Machine Learning · Computer Science 2024-09-25 Christian Komusiewicz , Pascal Kunz , Frank Sommer , Manuel Sorge

Trustworthy Artificial Intelligence solutions are essential in today's data-driven applications, prioritizing principles such as robustness, safety, transparency, explainability, and privacy among others. This has led to the emergence of…

Machine Learning · Computer Science 2024-04-04 Alberto Argente-Garrido , Cristina Zuheros , M. Victoria Luzón , Francisco Herrera

A salient approach to interpretable machine learning is to restrict modeling to simple models. In the Bayesian framework, this can be pursued by restricting the model structure and prior to favor interpretable models. Fundamentally,…

Machine Learning · Computer Science 2020-09-08 Homayun Afrabandpey , Tomi Peltola , Juho Piironen , Aki Vehtari , Samuel Kaski

Missing data imputation is a critical challenge in various domains, such as healthcare and finance, where data completeness is vital for accurate analysis. Large language models (LLMs), trained on vast corpora, have shown strong potential…

Machine Learning · Computer Science 2025-08-26 Xinrui He , Yikun Ban , Jiaru Zou , Tianxin Wei , Curtiss B. Cook , Jingrui He

Tree ensembles are one of the most widely used model classes. However, these models are susceptible to adversarial examples, i.e., slightly perturbed examples that elicit a misprediction. There has been significant research on designing…

Machine Learning · Computer Science 2024-02-14 Lorenzo Cascioli , Laurens Devos , Ondřej Kuželka , Jesse Davis

In critical situations involving discrimination, gender inequality, economic damage, and even the possibility of casualties, machine learning models must be able to provide clear interpretations for their decisions. Otherwise, their obscure…

Machine Learning · Computer Science 2021-04-14 Ioannis Mollas , Nick Bassiliades , Grigorios Tsoumakas

Supervised Machine Learning (SML) algorithms such as Gradient Boosting, Random Forest, and Neural Networks have become popular in recent years due to their increased predictive performance over traditional statistical methods. This is…

Machine Learning · Statistics 2018-06-05 Linwei Hu , Jie Chen , Vijayan N. Nair , Agus Sudjianto

Neural networks and tree ensembles are state-of-the-art learners, each with its unique statistical and computational advantages. We aim to combine these advantages by introducing a new layer for neural networks, composed of an ensemble of…

Machine Learning · Computer Science 2020-07-14 Hussein Hazimeh , Natalia Ponomareva , Petros Mol , Zhenyu Tan , Rahul Mazumder

Experts advising decision-makers are likely to display expertise which varies as a function of the problem instance. In practice, this may lead to sub-optimal or discriminatory decisions against minority cases. In this work we model such…

Artificial Intelligence · Computer Science 2023-10-27 Axel Abels , Tom Lenaerts , Vito Trianni , Ann Nowé

There is a growing concern about typically opaque decision-making with high-performance machine learning algorithms. Providing an explanation of the reasoning process in domain-specific terms can be crucial for adoption in risk-sensitive…

Computer Vision and Pattern Recognition · Computer Science 2022-11-28 Aditya Chattopadhyay , Stewart Slocum , Benjamin D. Haeffele , Rene Vidal , Donald Geman

One of the most promising approaches for complex technical systems analysis employs ensemble methods of classification. Ensemble methods enable to build a reliable decision rules for feature space classification in the presence of many…

Artificial Intelligence · Computer Science 2016-01-11 Alexei Zhukov , Victor Kurbatsky , Nikita Tomin , Denis Sidorov , Daniil Panasetsky , Aoife Foley

We address unsupervised discontinuous constituency parsing, where we observe a high variance in the performance of the only previous model in the literature. We propose to build an ensemble of different runs of the existing discontinuous…

Computation and Language · Computer Science 2024-11-07 Behzad Shayegh , Yuqiao Wen , Lili Mou

Random Forests (RF) are among the state-of-the-art in many machine learning applications. With the ongoing integration of ML models into everyday life, the deployment and continuous application of models becomes more and more an important…

Machine Learning · Computer Science 2021-10-20 Sebastian Buschjäger , Katharina Morik

Designers of statistical machine translation (SMT) systems have begun to employ tree-structured translation models. Systems involving tree-structured translation models tend to be complex. This article aims to reduce the conceptual…

Computation and Language · Computer Science 2007-05-23 I. Dan Melamed , Wei Wang

Randomized experiments have been critical tools of decision making for decades. However, subjects can show significant heterogeneity in response to treatments in many important applications. Therefore it is not enough to simply know which…

Machine Learning · Computer Science 2017-09-13 Yan Zhao , Xiao Fang , David Simchi-Levi

Graph clustering groups entities -- the vertices of a graph -- based on their similarity, typically using a complex distance function over a large number of features. Successful integration of clustering approaches in automated…

Machine Learning · Statistics 2020-02-03 Sandhya Saisubramanian , Sainyam Galhotra , Shlomo Zilberstein

In this review, we examine the problem of designing interpretable and explainable machine learning models. Interpretability and explainability lie at the core of many machine learning and statistical applications in medicine, economics,…

Machine Learning · Computer Science 2023-03-02 Ričards Marcinkevičs , Julia E. Vogt