English
Related papers

Related papers: A-PETE: Adaptive Prototype Explanations of Tree En…

200 papers

Ensembles of decision trees perform well on many problems, but are not interpretable. In contrast to existing approaches in interpretability that focus on explaining relationships between features and predictions, we propose an alternative…

Machine Learning · Statistics 2020-08-26 Sarah Tan , Matvey Soloviev , Giles Hooker , Martin T. Wells

Tree ensembles, such as random forests and boosted trees, are renowned for their high prediction performance. However, their interpretability is critically limited due to the enormous complexity. In this study, we present a method to make a…

Machine Learning · Statistics 2017-03-01 Satoshi Hara , Kohei Hayashi

Ensemble models (bagging and gradient-boosting) of relational decision trees have proved to be one of the most effective learning methods in the area of probabilistic logic models (PLMs). While effective, they lose one of the most important…

Machine Learning · Computer Science 2022-06-17 Siwen Yan , Sriraam Natarajan , Saket Joshi , Roni Khardon , Prasad Tadepalli

Decision trees and random forest remain highly competitive for classification on medium-sized, standard datasets due to their robustness, minimal preprocessing requirements, and interpretability. However, a single tree suffers from high…

Machine Learning · Statistics 2025-12-02 Cencheng Shen , Yuexiao Dong , Carey E. Priebe

Tree ensembles (TEs) find a multitude of practical applications. They represent one of the most general and accurate classes of machine learning methods. While they are typically quite concise in representation, their operation remains…

Artificial Intelligence · Computer Science 2026-04-01 Yacine Izza , Alexey Ignatiev , Xuanxiang Huang , Peter J. Stuckey , Joao Marques-Silva

Ensemble methods such as random forests have transformed the landscape of supervised learning, offering highly accurate prediction through the aggregation of multiple weak learners. However, despite their effectiveness, these methods often…

Machine Learning · Computer Science 2026-05-29 Massimo Aria , Agostino Gnasso , Carmela Iorio , Marjolein Fokkema

Tree ensembles, such as random forest and boosted trees, are renowned for their high prediction performance, whereas their interpretability is critically limited. In this paper, we propose a post processing method that improves the model…

Machine Learning · Statistics 2016-06-20 Satoshi Hara , Kohei Hayashi

Ensemble trees are a popular machine learning model which often yields high prediction performance when analysing structured data. Although individual small decision trees are deemed explainable by nature, an ensemble of large trees is…

Logic in Computer Science · Computer Science 2021-03-04 Gelin Zhang , Zhe Hou , Yanhong Huang , Jianqi Shi , Hadrien Bride , Jin Song Dong , Yongsheng Gao

Tree ensembles are non-parametric methods widely recognized for their accuracy and ability to capture complex interactions. While these models excel at prediction, they are difficult to interpret and may fail to uncover useful relationships…

Machine Learning · Statistics 2026-04-01 Brian Liu , Rahul Mazumder , Peter Radchenko

We propose a procedure to build a decision tree which approximates the performance of complex machine learning models. This single approximation tree can be used to interpret and simplify the predicting pattern of random forests (RFs) and…

Methodology · Statistics 2016-10-31 Yichen Zhou , Giles Hooker

Tree ensembles such as random forests and boosted trees are accurate but difficult to understand, debug and deploy. In this work, we provide the inTrees (interpretable trees) framework that extracts, measures, prunes and selects rules from…

Machine Learning · Computer Science 2014-08-26 Houtao Deng

Tree-ensemble algorithms, such as random forest, are effective machine learning methods popular for their flexibility, high performance, and robustness to overfitting. However, since multiple learners are combined, they are not as…

Machine Learning · Computer Science 2023-01-09 Klest Dedja , Felipe Kenji Nakano , Konstantinos Pliakos , Celine Vens

Tree ensemble models like random forests and gradient boosting machines are widely used in machine learning due to their excellent predictive performance. However, a high-performance ensemble consisting of a large number of decision trees…

Machine Learning · Statistics 2024-10-28 Zebin Yang , Agus Sudjianto , Xiaoming Li , Aijun Zhang

Towards a future where machine learning systems will integrate into every aspect of people's lives, researching methods to interpret such systems is necessary, instead of focusing exclusively on enhancing their performance. Enriching the…

Machine Learning · Computer Science 2021-12-21 Ioannis Mollas , Nick Bassiliades , Ioannis Vlahavas , Grigorios Tsoumakas

Random Forests and related tree-based methods are popular for supervised learning from table based data. Apart from their ease of parallelization, their classification performance is also superior. However, this performance, especially…

Machine Learning · Computer Science 2023-07-25 Tom Hanika , Johannes Hirth

Tree ensembles are very popular machine learning models, known for their effectiveness in supervised classification and regression tasks. Their performance derives from aggregating predictions of multiple decision trees, which are renowned…

Optimization and Control · Mathematics 2025-01-14 Lorenzo Bonasera , Emilio Carrizosa

Prototype-based methods use interpretable representations to address the black-box nature of deep learning models, in contrast to post-hoc explanation methods that only approximate such models. We propose the Neural Prototype Tree…

Computer Vision and Pattern Recognition · Computer Science 2021-04-16 Meike Nauta , Ron van Bree , Christin Seifert

The use of machine learning algorithms in finance, medicine, and criminal justice can deeply impact human lives. As a consequence, research into interpretable machine learning has rapidly grown in an attempt to better control and fix…

Machine Learning · Computer Science 2021-02-02 Thibaut Vidal , Toni Pacheco , Maximilian Schiffer

Decision tree models, including random forests and gradient-boosted decision trees, are widely used in machine learning due to their high predictive performance. However, their complex structures often make them difficult to interpret,…

Artificial Intelligence · Computer Science 2026-01-08 Akihiro Takemura , Masayuki Otani , Katsumi Inoue

Despite outstanding contribution to the significant progress of Artificial Intelligence (AI), deep learning models remain mostly black boxes, which are extremely weak in explainability of the reasoning process and prediction results.…

Machine Learning · Computer Science 2020-02-11 Sheng Shi , Xinfeng Zhang , Wei Fan
‹ Prev 1 2 3 10 Next ›