English
Related papers

Related papers: Distilling interpretable causal trees from causal …

200 papers

In an attempt to gather a deeper understanding of how convolutional neural networks (CNNs) reason about human-understandable concepts, we present a method to infer labeled concept data from hidden layer activations and interpret the…

Machine Learning · Computer Science 2019-06-18 Conner Chyung , Michael Tsang , Yan Liu

The advancement of robots, particularly those functioning in complex human-centric environments, relies on control solutions that are driven by machine learning. Understanding how learning-based controllers make decisions is crucial since…

Machine Learning · Computer Science 2023-11-14 Tsun-Hsuan Wang , Wei Xiao , Tim Seyde , Ramin Hasani , Daniela Rus

The carbon footprint of natural language processing research has been increasing in recent years due to its reliance on large and inefficient neural network implementations. Distillation is a network compression technique which attempts to…

Computation and Language · Computer Science 2020-06-02 Mark Anderson , Carlos Gómez-Rodríguez

Although regression trees were originally designed for large datasets, they can profitably be used on small datasets as well, including those from replicated or unreplicated complete factorial experiments. We show that in the latter…

Statistics Theory · Mathematics 2007-06-13 Wei-Yin Loh

In the context of structure-to-structure transformation tasks, learning sequences of discrete symbolic operations poses significant challenges due to their non-differentiability. To facilitate the learning of these symbolic sequences, we…

Computation and Language · Computer Science 2023-06-02 Paul Soulos , Edward Hu , Kate McCurdy , Yunmo Chen , Roland Fernandez , Paul Smolensky , Jianfeng Gao

The interpretability of models has become a crucial issue in Machine Learning because of algorithmic decisions' growing impact on real-world applications. Tree ensemble methods, such as Random Forests or XgBoost, are powerful learning tools…

Optimization and Control · Mathematics 2024-01-19 Giulia Di Teodoro , Marta Monaci , Laura Palagi

Yield and quality improvement is of paramount importance to any manufacturing company. One of the ways of improving yield is through discovery of the root causal factors affecting yield. We propose the use of data-driven interpretable…

Machine Learning · Computer Science 2016-06-15 Katerina Marazopoulou , Rumi Ghosh , Prasanth Lade , David Jensen

We study the problem of deriving policies, or rules, that when enacted on a complex system, cause a desired outcome. Absent the ability to perform controlled experiments, such rules have to be inferred from past observations of the system's…

Machine Learning · Computer Science 2020-09-09 Kailash Budhathoki , Mario Boley , Jilles Vreeken

Gradient boosted decision trees are some of the most popular algorithms in applied machine learning. They are a flexible and powerful tool that can robustly fit to any tabular dataset in a scalable and computationally efficient way. One of…

Machine Learning · Computer Science 2023-01-26 Daniel de Marchi , Matthew Welch , Michael Kosorok

This paper explores interpretability techniques for two of the most successful learning algorithms in medical decision-making literature: deep neural networks and random forests. We applied these algorithms in a real-world medical dataset…

Machine Learning · Computer Science 2020-02-24 Catarina Moreira , Renuka Sindhgatta , Chun Ouyang , Peter Bruza , Andreas Wichert

Recent studies in Learning to Rank have shown the possibility to effectively distill a neural network from an ensemble of regression trees. This result leads neural networks to become a natural competitor of tree-based ensembles on the…

Machine Learning · Computer Science 2024-10-28 F. M. Nardini , C. Rulli , S. Trani , R. Venturini

Causal effect estimation aims at estimating the Average Treatment Effect as well as the Conditional Average Treatment Effect of a treatment to an outcome from the available data. This knowledge is important in many safety-critical domains,…

Machine Learning · Statistics 2024-04-02 Niki Kiriakidou , Ioannis E. Livieris , Christos Diou

Interpretability plays a crucial role in the application of statistical learning to estimate heterogeneous treatment effects (HTE) in complex diseases. In this study, we leverage a rule-based workflow, namely causal rule learning (CRL), to…

Machine Learning · Computer Science 2025-11-24 Ying Wu , Hanzhong Liu , Kai Ren , Shujie Ma , Xiangyu Chang

Despite the major advances taken in causal modeling, causality is still an unfamiliar topic for many statisticians. In this paper, it is demonstrated from the beginning to the end how causal effects can be estimated from observational data…

Methodology · Statistics 2014-07-03 Juha Karvanen

The pursuit of interpretable artificial intelligence has led to significant advancements in the development of methods that aim to explain the decision-making processes of complex models, such as deep learning systems. Among these methods,…

Machine Learning · Computer Science 2024-10-29 Yihao Zhang

This work introduces a novel interpretable machine learning method called Mixture of Decision Trees (MoDT). It constitutes a special case of the Mixture of Experts ensemble architecture, which utilizes a linear model as gating function and…

Machine Learning · Computer Science 2022-11-29 Simeon Brüggenjürgen , Nina Schaaf , Pascal Kerschke , Marco F. Huber

Causal representation learning (CRL) has garnered increasing interest from the causal inference and artificial intelligence communities due to its potential to disentangle complex data-generating mechanism into causally interpretable latent…

Machine Learning · Statistics 2026-05-28 Hao Chen , Lin Liu , Yu Guang Wang

Many modern causal questions ask how treatments affect complex outcomes that are measured using wearable devices and sensors. Current analysis approaches require summarizing these data into scalar statistics (e.g., the mean), but these…

Machine Learning · Computer Science 2024-03-22 Srikar Katta , Harsh Parikh , Cynthia Rudin , Alexander Volfovsky

Multi-target regression is useful in a plethora of applications. Although random forest models perform well in these tasks, they are often difficult to interpret. Interpretability is crucial in machine learning, especially when it can…

Machine Learning · Computer Science 2023-03-30 Avraam Bardos , Nikolaos Mylonas , Ioannis Mollas , Grigorios Tsoumakas

We consider the problem of estimating a large causal polytree from a relatively small i.i.d. sample. This is motivated by the problem of determining causal structure when the number of variables is very large compared to the sample size,…

Methodology · Statistics 2024-08-20 Sourav Chatterjee , Mathukumalli Vidyasagar