English
Related papers

Related papers: Unboxing Tree Ensembles for interpretability: a hi…

200 papers

Interpretability is a pressing issue for machine learning. Common approaches to interpretable machine learning constrain interactions between features of the input, rendering the effects of those features on a model's output comprehensible…

Machine Learning · Computer Science 2023-05-11 Kieran A. Murphy , Dani S. Bassett

Given thousands of equally accurate machine learning (ML) models, how can users choose among them? A recent ML technique enables domain experts and data scientists to generate a complete Rashomon set for sparse decision trees--a huge set of…

Human-Computer Interaction · Computer Science 2023-03-02 Zijie J. Wang , Chudi Zhong , Rui Xin , Takuya Takagi , Zhi Chen , Duen Horng Chau , Cynthia Rudin , Margo Seltzer

Ensemble models (bagging and gradient-boosting) of relational decision trees have proved to be one of the most effective learning methods in the area of probabilistic logic models (PLMs). While effective, they lose one of the most important…

Machine Learning · Computer Science 2022-06-17 Siwen Yan , Sriraam Natarajan , Saket Joshi , Roni Khardon , Prasad Tadepalli

It is becoming increasingly important for machine learning methods to make predictions that are interpretable as well as accurate. In many practical applications, it is of interest which features and feature interactions are relevant to the…

Machine Learning · Statistics 2016-02-09 Viktoriya Krakovna , Jiong Du , Jun S. Liu

Model trees provide an appealing way to perform interpretable machine learning for both classification and regression problems. In contrast to ``classic'' decision trees with constant values in their leaves, model trees can use linear…

Machine Learning · Computer Science 2026-03-11 Sabino Francesco Roselli , Eibe Frank

Data-driven models are central to scientific discovery. In efforts to achieve state-of-the-art model accuracy, researchers are employing increasingly complex machine learning algorithms that often outperform simple regressions in…

Materials Science · Physics 2022-12-21 Eric S. Muckley , James E. Saal , Bryce Meredig , Christopher S. Roper , John H. Martin

Energy systems optimization problems are complex due to strongly non-linear system behavior and multiple competing objectives, e.g. economic gain vs. environmental impact. Moreover, a large number of input variables and different variable…

In transmission networks, power flows and network topology are deeply intertwined due to power flow physics. Recent literature shows that a specific more hierarchical network structure can effectively inhibit the propagation of line…

Optimization and Control · Mathematics 2025-02-06 Leon Lan , Alessandro Zocca

Many Machine Learning algorithms, such as deep neural networks, have long been criticized for being "black-boxes"-a kind of models unable to provide how it arrive at a decision without further efforts to interpret. This problem has raised…

Machine Learning · Statistics 2019-07-04 Yihuang Kang , I-Ling Cheng , Wenjui Mao , Bowen Kuo , Pei-Ju Lee

Machine-learned models are often described as "black boxes". In many real-world applications however, models may have to sacrifice predictive power in favour of human-interpretability. When this is the case, feature engineering becomes a…

Machine Learning · Statistics 2017-06-22 Gabriele Tolomei , Fabrizio Silvestri , Andrew Haines , Mounia Lalmas

An important factor in the practical implementation of optimization models is the acceptance by the intended users. This is influenced among other factors by the interpretability of the solution process. Decision rules that meet this…

Machine Learning · Computer Science 2024-12-03 Marc Goerigk , Michael Hartisch , Sebastian Merten

Supervised Machine Learning (SML) algorithms such as Gradient Boosting, Random Forest, and Neural Networks have become popular in recent years due to their increased predictive performance over traditional statistical methods. This is…

Machine Learning · Statistics 2018-06-05 Linwei Hu , Jie Chen , Vijayan N. Nair , Agus Sudjianto

Tree-based machine learning models such as random forests, decision trees, and gradient boosted trees are the most popular non-linear predictive models used in practice today, yet comparatively little attention has been paid to explaining…

Machine learning algorithms often assume that training samples are independent. When data points are connected by a network, the induced dependency between samples is both a challenge, reducing effective sample size, and an opportunity to…

Machine Learning · Statistics 2025-09-22 Tiffany M. Tang , Elizaveta Levina , Ji Zhu

We propose to use boosted regression trees as a way to compute human-interpretable solutions to reinforcement learning problems. Boosting combines several regression trees to improve their accuracy without significantly reducing their…

Machine Learning · Computer Science 2018-09-20 Alexander Brown , Marek Petrik

Interpretable surrogates of black-box predictors trained on high-dimensional tabular datasets can struggle to generate comprehensible explanations in the presence of correlated variables. We propose a model-agnostic interpretable surrogate…

Machine Learning · Statistics 2019-06-05 Xavier Renard , Nicolas Woloszko , Jonathan Aigrain , Marcin Detyniecki

Over the past decades, classification models have proven to be essential machine learning tools given their potential and applicability in various domains. In these years, the north of the majority of the researchers had been to improve…

Machine Learning · Computer Science 2020-12-11 Mário Popolin Neto , Fernando V. Paulovich

Interpretable machine learning has become a strong competitor for traditional black-box models. However, the possible loss of the predictive performance for gaining interpretability is often inevitable, putting practitioners in a dilemma of…

Machine Learning · Computer Science 2019-05-13 Tong Wang , Qihang Lin

To address the issues of stability and fidelity in interpretable learning, a novel interpretable methodology, ensemble interpretation, is presented in this paper which integrates multi-perspective explanation of various interpretation…

Machine Learning · Computer Science 2023-12-12 Chao Min , Guoyong Liao , Guoquan Wen , Yingjun Li , Xing Guo

Tree ensembles (TEs) find a multitude of practical applications. They represent one of the most general and accurate classes of machine learning methods. While they are typically quite concise in representation, their operation remains…

Artificial Intelligence · Computer Science 2026-04-01 Yacine Izza , Alexey Ignatiev , Xuanxiang Huang , Peter J. Stuckey , Joao Marques-Silva