English
Related papers

Related papers: On Explaining Decision Trees

200 papers

Tree ensembles, such as random forests and boosted trees, are renowned for their high prediction performance. However, their interpretability is critically limited due to the enormous complexity. In this study, we present a method to make a…

Machine Learning · Statistics 2017-03-01 Satoshi Hara , Kohei Hayashi

A classifier is considered interpretable if each of its decisions has an explanation which is small enough to be easily understood by a human user. A DNF formula can be seen as a binary classifier $\kappa$ over boolean domains. The size of…

Artificial Intelligence · Computer Science 2025-05-28 Martin C. Cooper , Imane Bousdira , Clément Carbonnel

A wide variety of model explanation approaches have been proposed in recent years, all guided by very different rationales and heuristics. In this paper, we take a new route and cast interpretability as a statistical inference problem. We…

Machine Learning · Computer Science 2024-01-01 Hugo Henri Joseph Senetaire , Damien Garreau , Jes Frellsen , Pierre-Alexandre Mattei

Constructing useful representations across a large number of tasks is a key requirement for sample-efficient intelligent systems. A traditional idea in multitask learning (MTL) is building a shared representation across tasks which can then…

Machine Learning · Computer Science 2023-03-09 Yingcong Li , Samet Oymak

The Rashomon set of decision trees (DTs) finds importance uses. Recent work showed that DTs computing the same classification function, i.e. predictive equivalent DTs, can represent a significant fraction of the Rashomon set. Such…

Artificial Intelligence · Computer Science 2025-10-17 Joao Marques-Silva , Alexey Ignatiev

Tree ensemble models like random forests and gradient boosting machines are widely used in machine learning due to their excellent predictive performance. However, a high-performance ensemble consisting of a large number of decision trees…

Machine Learning · Statistics 2024-10-28 Zebin Yang , Agus Sudjianto , Xiaoming Li , Aijun Zhang

Explainability is motivated by the lack of transparency of black-box Machine Learning approaches, which do not foster trust and acceptance of Machine Learning algorithms. This also happens in the Predictive Process Monitoring field, where…

Artificial Intelligence · Computer Science 2025-07-25 Williams Rizzi , Marco Comuzzi , Chiara Di Francescomarino , Chiara Ghidini , Suhwan Lee , Fabrizio Maria Maggi , Alexander Nolte

On the one hand, artificial neural networks (ANNs) are commonly labelled as black-boxes, lacking interpretability; an issue that hinders human understanding of ANNs' behaviors. A need exists to generate a meaningful sequential logic of the…

Machine Learning · Computer Science 2021-11-19 Duy T. Nguyen , Kathryn E. Kasmarik , Hussein A. Abbass

Recent work proposed $\delta$-relevant inputs (or sets) as a probabilistic explanation for the predictions made by a classifier on a given input. $\delta$-relevant sets are significant because they serve to relate (model-agnostic) Anchors…

Machine Learning · Computer Science 2021-06-02 Yacine Izza , Alexey Ignatiev , Nina Narodytska , Martin C. Cooper , Joao Marques-Silva

This paper introduces a novel tree-based model, Learning Hyperplane Tree (LHT), which outperforms state-of-the-art (SOTA) tree models for classification tasks on several public datasets. The structure of LHT is simple and efficient: it…

Machine Learning · Computer Science 2025-01-16 Hongyi Li , Jun Xu , William Ward Armstrong

Decision tree models, including random forests and gradient-boosted decision trees, are widely used in machine learning due to their high predictive performance. However, their complex structures often make them difficult to interpret,…

Artificial Intelligence · Computer Science 2026-01-08 Akihiro Takemura , Masayuki Otani , Katsumi Inoue

Users in many domains use machine learning (ML) predictions to help them make decisions. Effective ML-based decision-making often requires explanations of ML models and their predictions. While there are many algorithms that explain models,…

Machine Learning · Computer Science 2023-12-21 Alexandra Zytek , Wei-En Wang , Dongyu Liu , Laure Berti-Equille , Kalyan Veeramachaneni

Tree ensembles are very popular machine learning models, known for their effectiveness in supervised classification and regression tasks. Their performance derives from aggregating predictions of multiple decision trees, which are renowned…

Optimization and Control · Mathematics 2025-01-14 Lorenzo Bonasera , Emilio Carrizosa

Neural networks (NNs) achieve outstanding performance in many domains; however, their decision processes are often opaque and their inference can be computationally expensive in resource-constrained environments. We recently proposed…

Machine Learning · Computer Science 2025-05-30 Chang Yue , Niraj K. Jha

The local and global interpretability of various ML models has been studied extensively in recent years. However, despite significant progress in the field, many known results remain informal or lack sufficient mathematical rigor. We…

Machine Learning · Computer Science 2024-06-10 Shahaf Bassan , Guy Amir , Guy Katz

Decision trees and their ensembles are popular in machine learning as easy-to-understand models. Several techniques have been proposed in the literature for learning tree-based classifiers, with different techniques working well for data…

Machine Learning · Computer Science 2025-05-20 Maria-Florina Balcan , Dravyansh Sharma

In this paper we introduce a novel family of decision lists consisting of highly interpretable models which can be learned efficiently in a greedy manner. The defining property is that all rules are oriented in the same direction.…

Machine Learning · Statistics 2016-01-12 Marc Goessling , Shan Kang

Modern data analytics underpinned by machine learning techniques has become a key enabler to the automation of data-led decision making. As an important branch of state-of-the-art data analytics, business process predictions are also faced…

Artificial Intelligence · Computer Science 2021-07-22 Chun Ouyang , Renuka Sindhgatta , Catarina Moreira

Decision tree learning is a popular classification technique most commonly used in machine learning applications. Recent work has shown that decision trees can be used to represent provably-correct controllers concisely. Compared to…

Machine Learning · Computer Science 2021-02-02 Pranav Ashok , Mathias Jackermeier , Pushpak Jagtap , Jan Křetínský , Maximilian Weininger , Majid Zamani

One of the key challenges when developing a predictive model is the capability to describe the domain knowledge and the cause-effect relationships in a simple way. Decision rules are a useful and important methodology in this context,…

Machine Learning · Computer Science 2021-10-19 Francisco Valente , Jorge Henriques , Simão Paredes , Teresa Rocha , Paulo de Carvalho , João Morais
‹ Prev 1 3 4 5 6 7 10 Next ›