English
Related papers

Related papers: Unboxing Tree Ensembles for interpretability: a hi…

200 papers

In this paper, we present a new explainability formalism designed to shed light on how each input variable of a test set impacts the predictions of machine learning models. Hence, we propose a group explainability formalism for trained…

Machine Learning · Statistics 2022-08-12 François Bachoc , Fabrice Gamboa , Max Halford , Jean-Michel Loubes , Laurent Risser

Machine learning in high-stakes domains, such as healthcare, faces two critical challenges: (1) generalizing to diverse data distributions given limited training data while (2) maintaining interpretability. To address these challenges, we…

Machine Learning · Computer Science 2023-07-11 Keyan Nasseri , Chandan Singh , James Duncan , Aaron Kornblith , Bin Yu

Tree ensembles are widely recognized for their effectiveness in classification tasks, achieving state-of-the-art performance across diverse domains, including bioinformatics, finance, and medical diagnosis. With increasing emphasis on data…

Machine Learning · Computer Science 2025-09-01 Ziheng Chen , Jin Huang , Jiali Cheng , Yuchan Guo , Mengjie Wang , Lalitesh Morishetti , Kaushiki Nag , Hadi Amiri

Finding optimal join orders is among the most crucial steps to be performed by query optimisers. Though extensively studied in data management research, the problem remains far from solved: While query optimisers rely on exhaustive search…

Databases · Computer Science 2025-10-24 Manuel Schönberger , Immanuel Trummer , Wolfgang Mauerer

Tree ensembles are powerful models that achieve excellent predictive performances, but can grow to unwieldy sizes. These ensembles are often post-processed (pruned) to reduce memory footprint and improve interpretability. We present…

Machine Learning · Statistics 2023-05-26 Brian Liu , Rahul Mazumder

A new ensemble framework for interpretable model called Linear Iterative Feature Embedding (LIFE) has been developed to achieve high prediction accuracy, easy interpretation and efficient computation simultaneously. The LIFE algorithm is…

Machine Learning · Statistics 2021-03-19 Agus Sudjianto , Jinwen Qiu , Miaoqi Li , Jie Chen

Interpretable reinforcement learning policies are essential for high-stakes decision-making, yet optimizing decision tree policies in Markov Decision Processes (MDPs) remains challenging. We propose SPOT, a novel method for computing…

Machine Learning · Computer Science 2025-10-23 Xuyuan Xiong , Pedro Chumpitaz-Flores , Kaixun Hua , Cheng Hua

Ensemble methods are among the state-of-the-art predictive modeling approaches. Applied to modern big data, these methods often require a large number of sub-learners, where the complexity of each learner typically grows with the size of…

Machine Learning · Computer Science 2018-10-29 Amichai Painsky , Saharon Rosset

Application of interpretable machine learning techniques on medical datasets facilitate early and fast diagnoses, along with getting deeper insight into the data. Furthermore, the transparency of these models increase trust among…

Machine Learning · Computer Science 2025-06-05 Sreejita Ghosh , Elizabeth S. Baranowski , Michael Biehl , Wiebke Arlt , Peter Tino , Kerstin Bunte

Prediction Rule Ensembles (PREs) are robust and interpretable statistical learning techniques with potential for predictive analytics, yet their efficacy in the presence of missing data is untested. This study uses multiple imputation to…

Applications · Statistics 2024-10-22 Vincent Schroeder , Jakob Schwerter , Marjolein Fokkema , Philipp Doebler

Multiple-instance learning (MIL) is a paradigm of machine learning that aims to classify a set (bag) of objects (instances), assigning labels only to the bags. This problem is often addressed by selecting an instance to represent each bag,…

Human-Computer Interaction · Computer Science 2021-12-22 Sonia Castelo , Moacir Ponti , Rosane Minghim

Mixed-integer optimization is at the core of many online decision-making systems that demand frequent updates of decisions in real time. However, due to their combinatorial nature, mixed-integer linear programs (MILPs) can be difficult to…

Optimization and Control · Mathematics 2026-04-21 Shivi Dixit , Rishabh Gupta , Qi Zhang

Machine learning methods for estimating treatment effect heterogeneity promise greater flexibility than existing methods that test a few pre-specified hypotheses. However, one problem these methods can have is that it can be challenging to…

Econometrics · Economics 2024-08-05 Patrick Rehill

To reduce the heavy computational burden of reactive power optimization of distribution networks, machine learning models are receiving increasing attention. However, most machine learning models (e.g., neural networks) are usually…

Systems and Control · Electrical Eng. & Systems 2023-11-08 Wenlong Liao , Benjamin Schäfer , Dalin Qin , Gonghao Zhang , Zhixian Wang , Zhe Yang

There has been a large number of studies in interpretable and explainable ML for cybersecurity, in particular, for intrusion detection. Many of these studies have significant amount of overlapping and repeated evaluations and analysis. At…

Cryptography and Security · Computer Science 2024-07-08 Omer Subasi , Johnathan Cree , Joseph Manzano , Elena Peterson

Time series forecasting enables early warning and has driven asset performance management from traditional planned maintenance to predictive maintenance. However, the lack of interpretability in forecasting methods undermines users' trust…

Machine Learning · Computer Science 2026-03-04 Bo Liu , Shao-Bo Lin , Changmiao Wang , Xiaotong Liu

A new extremely simple ensemble-based model with the uniformly generated axis-parallel hyper-rectangles as base models (HRBM) is proposed. Two types of HRBMs are studied: closed rectangles and corners. The main idea behind HRBM is to…

Machine Learning · Computer Science 2023-03-16 Andrei V. Konstantinov , Lev V. Utkin

This paper explores interpretability techniques for two of the most successful learning algorithms in medical decision-making literature: deep neural networks and random forests. We applied these algorithms in a real-world medical dataset…

Machine Learning · Computer Science 2020-02-24 Catarina Moreira , Renuka Sindhgatta , Chun Ouyang , Peter Bruza , Andreas Wichert

Large language models achieve strong reasoning performance, yet existing decoding strategies either explore blindly (random sampling) or redundantly (independent multi-sampling). We propose Entropy-Tree, a tree-based decoding method that…

Computation and Language · Computer Science 2026-01-23 Longxuan Wei , Yubo Zhang , Zijiao Zhang , Zhihu Wang , Shiwan Zhao , Tianyu Huang , Huiting Zhao , Chenfei Liu , Shenao Zhang , Junchi Yan

Real-world multi-view data often exhibit highly inconsistent missing patterns, posing significant challenges for incomplete multi-view clustering (IMVC). Although existing IMVC methods have made progress from both imputation-based and…

Machine Learning · Computer Science 2026-04-21 Jie Xu , Wenyuan Yang , Yazhou Ren , Lifang He , Philip S. Yu , Xiaofeng Zhu