English
Related papers

Related papers: Learning Optimal Prescriptive Trees from Observati…

200 papers

Interpretable and explainable machine learning has seen a recent surge of interest. We focus on safety as a key motivation behind the surge and make the relationship between interpretability and safety more quantitative. Toward assessing…

Machine Learning · Computer Science 2022-11-04 Dennis Wei , Rahul Nair , Amit Dhurandhar , Kush R. Varshney , Elizabeth M. Daly , Moninder Singh

This dissertation focuses on modern causal inference under uncertainty and data restrictions, with applications to neoadjuvant clinical trials, distributed data networks, and robust individualized decision making. In the first project, we…

Methodology · Statistics 2023-01-24 Xiaoqing Tan

Computing an optimal classification tree that provably maximizes training performance within a given size limit, is NP-hard, and in practice, most state-of-the-art methods do not scale beyond computing optimal trees of depth three.…

Machine Learning · Computer Science 2025-01-15 Catalin E. Brita , Jacobus G. M. van der Linden , Emir Demirović

A new random forest based model for solving the Multiple Instance Learning (MIL) problem under small tabular data, called Soft Tree Ensemble MIL (STE-MIL), is proposed. A new type of soft decision trees is considered, which is similar to…

Machine Learning · Computer Science 2023-02-14 Andrei V. Konstantinov , Lev V. Utkin

The current work is motivated by the need for robust statistical methods for precision medicine; as such, we address the need for statistical methods that provide actionable inference for a single unit at any point in time. We aim to learn…

Statistics Theory · Mathematics 2021-07-02 Ivana Malenica , Aurelien Bibaut , Mark J. van der Laan

Pattern discovery in data plays a crucial role across diverse domains, including healthcare, risk assessment, and machinery maintenance. In contrast to black-box deep learning models, symbolic rule discovery emerges as a key data mining…

Machine Learning · Computer Science 2026-05-15 Young-Chae Hong , Yangho Chen

In this paper, we introduce a framework for solving finite-horizon multistage optimization problems under uncertainty in the presence of auxiliary data. We assume the joint distribution of the uncertain quantities is unknown, but noisy…

Machine Learning · Statistics 2019-04-29 Dimitris Bertsimas , Christopher McCord

The empirical risk minimization approach to data-driven decision making requires access to training data drawn under the same conditions as those that will be faced when the decision rule is deployed. However, in a number of settings, we…

Methodology · Statistics 2025-09-17 Roshni Sahoo , Lihua Lei , Stefan Wager

Preferential Bayesian Optimization (PBO) aims to find a decision-maker's most preferred solution in as few pairwise comparisons as possible. Existing approaches rely on Gaussian Process (GP) surrogates, which provide strong performance but…

Machine Learning · Computer Science 2026-05-11 Nick Leenders , Thomas Quadt , Boris Cule , Roy Lindelauf , Herman Monsuur , Joost van Oijen , Mark Voskuijl

Decision diagrams for classification have some notable advantages over decision trees, as their internal connections can be determined at training time and their width is not bound to grow exponentially with their depth. Accordingly,…

Machine Learning · Computer Science 2022-05-31 Alexandre M. Florio , Pedro Martins , Maximilian Schiffer , Thiago Serra , Thibaut Vidal

Practitioners often use data from a randomized controlled trial to learn a treatment assignment policy that can be deployed on a target population. A recurring concern in doing so is that, even if the randomized trial was well-executed…

Econometrics · Economics 2023-04-25 Lihua Lei , Roshni Sahoo , Stefan Wager

This paper explores interpretability techniques for two of the most successful learning algorithms in medical decision-making literature: deep neural networks and random forests. We applied these algorithms in a real-world medical dataset…

Machine Learning · Computer Science 2020-02-24 Catarina Moreira , Renuka Sindhgatta , Chun Ouyang , Peter Bruza , Andreas Wichert

High-dimensional policies, such as those represented by neural networks, cannot be reasonably interpreted by humans. This lack of interpretability reduces the trust users have in policy behavior, limiting their use to low-impact tasks such…

Machine Learning · Computer Science 2021-09-20 John Mern , Sidhart Krishnan , Anil Yildiz , Kyle Hatch , Mykel J. Kochenderfer

Dynamic regression trees are an attractive option for automatic regression and classification with complicated response surfaces in on-line application settings. We create a sequential tree model whose state changes in time with the…

Methodology · Statistics 2010-11-23 Matthew A. Taddy , Robert B. Gramacy , Nicholas G. Polson

In this work, we propose a simple but effective method to interpret black-box machine learning models globally. That is, we use a compact binary tree, the interpretation tree, to explicitly represent the most important decision rules that…

Machine Learning · Computer Science 2018-05-24 Chengliang Yang , Anand Rangarajan , Sanjay Ranka

In this paper we propose a novel methodology to construct Optimal Classification Trees that takes into account that noisy labels may occur in the training sample. Our approach rests on two main elements: (1) the splitting rules for the…

Machine Learning · Computer Science 2020-12-17 Víctor Blanco , Alberto Japón , Justo Puerto

Conditional density estimation (CDE) goes beyond regression by modeling the full conditional distribution, providing a richer understanding of the data than just the conditional mean in regression. This makes CDE particularly useful in…

Machine Learning · Computer Science 2024-10-16 Lincen Yang , Matthijs van Leeuwen

Integrated interpretability without sacrificing the prediction accuracy of decision making algorithms has the potential of greatly improving their value to the user. Instead of assigning a label to an image directly, we propose to learn…

Machine Learning · Computer Science 2021-04-13 Stephan Alaniz , Diego Marcos , Bernt Schiele , Zeynep Akata

Decision trees are renowned for their ability to achieve high predictive performance while remaining interpretable, especially on tabular data. Traditionally, they are constructed through recursive algorithms, where they partition the data…

Machine Learning · Computer Science 2024-08-27 Yufan Zhuang , Liyuan Liu , Chandan Singh , Jingbo Shang , Jianfeng Gao

Given the increasing interest in interpretable machine learning, classification trees have again attracted the attention of the scientific community because of their glass-box structure. These models are usually built using greedy…

Machine Learning · Computer Science 2023-05-16 Tommaso Aldinucci