English
Related papers

Related papers: Policy Trees for Prediction: Interpretable and Ada…

200 papers

Data-driven models are central to scientific discovery. In efforts to achieve state-of-the-art model accuracy, researchers are employing increasingly complex machine learning algorithms that often outperform simple regressions in…

Materials Science · Physics 2022-12-21 Eric S. Muckley , James E. Saal , Bryce Meredig , Christopher S. Roper , John H. Martin

Tree ensembles such as random forests and boosted trees are accurate but difficult to understand, debug and deploy. In this work, we provide the inTrees (interpretable trees) framework that extracts, measures, prunes and selects rules from…

Machine Learning · Computer Science 2014-08-26 Houtao Deng

Constructing decision trees online is a classical machine learning problem. Existing works often assume that features are readily available for each incoming data point. However, in many real world applications, both feature values and the…

Machine Learning · Computer Science 2025-06-18 Arman Rahbar , Ziyu Ye , Yuxin Chen , Morteza Haghir Chehreghani

Rule-based models, e.g., decision trees, are widely used in scenarios demanding high model interpretability for their transparent inner structures and good model expressivity. However, rule-based models are hard to optimize, especially on…

Machine Learning · Computer Science 2024-01-31 Zhuo Wang , Wei Zhang , Ning Liu , Jianyong Wang

With the rise of the digital economy and an explosion of available information about consumers, effective personalization of goods and services has become a core business focus for companies to improve revenues and maintain a competitive…

Machine Learning · Computer Science 2022-11-04 Zhaonan Qu , Isabella Qian , Zhengyuan Zhou

Decision tree learning is a popular classification technique most commonly used in machine learning applications. Recent work has shown that decision trees can be used to represent provably-correct controllers concisely. Compared to…

Machine Learning · Computer Science 2021-02-02 Pranav Ashok , Mathias Jackermeier , Pushpak Jagtap , Jan Křetínský , Maximilian Weininger , Majid Zamani

Behavior Trees constitute a widespread AI tool which has been successfully spun out in robotics. Their advantages include simplicity, modularity, and reusability of code. However, Behavior Trees remain a high-level decision making engine;…

Robotics · Computer Science 2020-09-01 Pilar de la Cruz , Justus Piater , Matteo Saveriano

Decision tree algorithms have been among the most popular algorithms for interpretable (transparent) machine learning since the early 1980's. The problem that has plagued decision tree algorithms since their inception is their lack of…

Machine Learning · Computer Science 2023-09-28 Xiyang Hu , Cynthia Rudin , Margo Seltzer

The global optimization literature places large emphasis on reducing intractable optimization problems into more tractable structured optimization forms. In order to achieve this goal, many existing methods are restricted to optimization…

Optimization and Control · Mathematics 2025-04-28 Dimitris Bertsimas , Berk Öztürk

Decision-making plays a pivotal role in shaping outcomes in various disciplines, such as medicine, economics, and business. This paper provides guidance to practitioners on how to implement a decision tree designed to address treatment…

Econometrics · Economics 2024-06-05 Hugo Bodory , Federica Mascolo , Michael Lechner

Rationing of healthcare resources is a challenging decision that policy makers and providers may be forced to make during a pandemic, natural disaster, or mass casualty event. Well-defined guidelines to triage scarce life-saving resources…

Machine Learning · Computer Science 2024-11-12 Julien Grand-Clément , You Hui Goh , Carri Chan , Vineet Goyal , Elizabeth Chuang

In the literature, two series of models have been proposed to address prediction problems including classification and regression. Simple models, such as generalized linear models, have ordinary performance but strong interpretability on a…

Machine Learning · Computer Science 2016-11-01 Jingbo Shang , Meng Jiang , Wenzhu Tong , Jinfeng Xiao , Jian Peng , Jiawei Han

Decision-making in complex systems often relies on machine learning models, yet highly accurate models such as XGBoost and neural networks can obscure the reasoning behind their predictions. In operations research applications,…

Machine Learning · Computer Science 2025-02-28 Gaurav Arwade , Sigurdur Olafsson

We present an algorithm, called the Offset Tree, for learning to make decisions in situations where the payoff of only one choice is observed, rather than all choices. The algorithm reduces this setting to binary classification, allowing…

Machine Learning · Computer Science 2016-04-05 Alina Beygelzimer , John Langford

Decision trees and their ensembles are very popular models of supervised machine learning. In this paper we merge the ideas underlying decision trees, their ensembles and FCA by proposing a new supervised machine learning model which can be…

Machine Learning · Computer Science 2021-06-02 Egor Dudyrev , Sergei O. Kuznetsov

The wide-spread adoption of representation learning technologies in clinical decision making strongly emphasizes the need for characterizing model reliability and enabling rigorous introspection of model behavior. While the former need is…

Machine Learning · Computer Science 2020-05-01 Jayaraman J. Thiagarajan , Prasanna Sattigeri , Deepta Rajan , Bindya Venkatesh

Modern data analytics underpinned by machine learning techniques has become a key enabler to the automation of data-led decision making. As an important branch of state-of-the-art data analytics, business process predictions are also faced…

Artificial Intelligence · Computer Science 2021-07-22 Chun Ouyang , Renuka Sindhgatta , Catarina Moreira

Multi-target regression is useful in a plethora of applications. Although random forest models perform well in these tasks, they are often difficult to interpret. Interpretability is crucial in machine learning, especially when it can…

Machine Learning · Computer Science 2023-03-30 Avraam Bardos , Nikolaos Mylonas , Ioannis Mollas , Grigorios Tsoumakas

Interpretable policy representations like Behavior Trees (BTs) and Dynamic Motion Primitives (DMPs) enable robot skill transfer from human demonstrations, but each faces limitations: BTs require expert-crafted low-level actions, while DMPs…

Robotics · Computer Science 2025-05-14 David Cáceres Domínguez , Erik Schaffernicht , Todor Stoyanov

We investigate a long-debated question, which is how to create predictive models of recidivism that are sufficiently accurate, transparent, and interpretable to use for decision-making. This question is complicated as these models are used…

Machine Learning · Statistics 2020-10-20 Jiaming Zeng , Berk Ustun , Cynthia Rudin