English
Related papers

Related papers: Deep Trees for (Un)structured Data: Tractability, …

200 papers

Tree-based models are widely recognized for their interpretability and have proven effective in various application domains, particularly in high-stakes domains. However, learning decision trees (DTs) poses a significant challenge due to…

Machine Learning · Computer Science 2026-03-13 Sascha Marton

Deep Reinforcement Learning (DRL) has recently achieved significant advances in various domains. However, explaining the policy of RL agents still remains an open problem due to several factors, one being the complexity of explaining neural…

Machine Learning · Computer Science 2021-03-31 Zihan Ding , Pablo Hernandez-Leal , Gavin Weiguang Ding , Changjian Li , Ruitong Huang

Trustworthy Artificial Intelligence solutions are essential in today's data-driven applications, prioritizing principles such as robustness, safety, transparency, explainability, and privacy among others. This has led to the emergence of…

Machine Learning · Computer Science 2024-04-04 Alberto Argente-Garrido , Cristina Zuheros , M. Victoria Luzón , Francisco Herrera

As a modern ensemble technique, Deep Forest (DF) employs a cascading structure to construct deep models, providing stronger representational power compared to traditional decision forests. However, its greedy multi-layer learning procedure…

Machine Learning · Computer Science 2023-09-19 Hongyu Zhu , Sichu Liang , Wentao Hu , Fang-Qi Li , Yali yuan , Shi-Lin Wang , Guang Cheng

Decision trees are renowned for their ability to achieve high predictive performance while remaining interpretable, especially on tabular data. Traditionally, they are constructed through recursive algorithms, where they partition the data…

Machine Learning · Computer Science 2024-08-27 Yufan Zhuang , Liyuan Liu , Chandan Singh , Jingbo Shang , Jianfeng Gao

Deep learning techniques have been successfully deployed for automating plant stress identification and quantification. In recent years, there is a growing push towards training models that are interpretable -i.e. that justify their…

Computer Vision and Pattern Recognition · Computer Science 2020-07-14 Koushik Nagasubramanian , Asheesh K. Singh , Arti Singh , Soumik Sarkar , Baskar Ganapathysubramanian

Decision tree ensembles are widely used and competitive learning models. Despite their success, popular toolkits for learning tree ensembles have limited modeling capabilities. For instance, these toolkits support a limited number of loss…

Machine Learning · Computer Science 2022-05-20 Shibal Ibrahim , Hussein Hazimeh , Rahul Mazumder

Machine learning algorithms often assume that training samples are independent. When data points are connected by a network, the induced dependency between samples is both a challenge, reducing effective sample size, and an opportunity to…

Machine Learning · Statistics 2025-09-22 Tiffany M. Tang , Elizaveta Levina , Ji Zhu

Decision Trees (DTs) are commonly used for many machine learning tasks due to their high degree of interpretability. However, learning a DT from data is a difficult optimization problem, as it is non-convex and non-differentiable.…

Machine Learning · Computer Science 2024-08-20 Sascha Marton , Stefan Lüdtke , Christian Bartelt , Heiner Stuckenschmidt

Clustering serves as a vital tool for uncovering latent data structures, and achieving both high accuracy and interpretability is essential. To this end, existing methods typically construct binary decision trees by solving mixed-integer…

Machine Learning · Computer Science 2026-02-17 Hayato Suzuki , Shunnosuke Ikeda , Yuichi Takano

Model interpretability is a requirement in many applications in which crucial decisions are made by users relying on a model's outputs. The recent movement for "algorithmic fairness" also stipulates explainability, and therefore…

Machine Learning · Computer Science 2018-08-21 Xuan Liu , Xiaoguang Wang , Stan Matwin

Functional survival models are key tools for analyzing time-to-event data with complex predictors, such as functional or high-dimensional inputs. Despite their predictive strength, these models often lack interpretability, which limits…

Machine Learning · Statistics 2025-04-28 Giuseppe Loffredo , Elvira Romano , Fabrizio MAturo

Decision Trees and Random Forests are among the most widely used machine learning models, and often achieve state-of-the-art performance in tabular, domain-agnostic datasets. Nonetheless, being primarily discriminative models they lack…

Machine Learning · Statistics 2020-07-14 Alvaro H. C. Correia , Robert Peharz , Cassio de Campos

Decision trees (DTs) epitomize what have become to be known as interpretable machine learning (ML) models. This is informally motivated by paths in DTs being often much smaller than the total number of features. This paper shows that in…

Machine Learning · Computer Science 2020-10-22 Yacine Izza , Alexey Ignatiev , Joao Marques-Silva

In this paper, we address an issue of finding explainable clusters of class-uniform data in labelled datasets. The issue falls into the domain of interpretable supervised clustering. Unlike traditional clustering, supervised clustering aims…

Machine Learning · Computer Science 2023-07-18 Natallia Kokash , Leonid Makhnist

Multivariate time series classification is of great importance in practical applications and is a challenging task. However, deep neural network models such as Transformers exhibit high accuracy in multivariate time series classification…

Machine Learning · Computer Science 2024-11-19 Mingsen Du , Yanxuan Wei , Yingxia Tang , Xiangwei Zheng , Shoushui Wei , Cun Ji

Tree-based machine learning models such as random forests, decision trees, and gradient boosted trees are the most popular non-linear predictive models used in practice today, yet comparatively little attention has been paid to explaining…

How to obtain a model with good interpretability and performance has always been an important research topic. In this paper, we propose rectified decision trees (ReDT), a knowledge distillation based decision trees rectification with high…

Machine Learning · Computer Science 2020-08-25 Jiawang Bai , Yiming Li , Jiawei Li , Yong Jiang , Shutao Xia

We seek to provide an interpretable framework for segmenting users in a population for personalized decision-making. We propose a general methodology, Market Segmentation Trees (MSTs), for learning market segmentations explicitly driven by…

Applications · Statistics 2023-01-16 Ali Aouad , Adam N. Elmachtoub , Kris J. Ferreira , Ryan McNellis

Decision tree optimization is fundamental to interpretable machine learning. The most popular approach is to greedily search for the best feature at every decision point, which is fast but provably suboptimal. Recent approaches find the…

Machine Learning · Computer Science 2025-11-19 Varun Babbar , Hayden McTavish , Cynthia Rudin , Margo Seltzer