English
Related papers

Related papers: Explaining Random Forests using Bipolar Argumentat…

200 papers

Knowledge representation and reasoning in law are essential to facilitate the automation of legal analysis and decision-making tasks. In this paper, we propose a new approach based on legal science, specifically legal taxonomy, for…

Computation and Language · Computer Science 2022-12-19 Ha-Thanh Nguyen , Vu Tran , Ngoc-Cam Le , Thi-Thuy Le , Quang-Huy Nguyen , Le-Minh Nguyen , Ken Satoh

Certain families of combinatorial objects admit recursive descriptions in terms of generating trees: each node of the tree corresponds to an object, and the branch leading to the node encodes the choices made in the construction of the…

Random forests are an ensemble method relevant for many problems, such as regression or classification. They are popular due to their good predictive performance (compared to, e.g., decision trees) requiring only minimal tuning of…

Methodology · Statistics 2022-10-20 Nikolaus Umlauf , Nadja Klein

Although neural networks are a powerful tool, their widespread use is hindered by the opacity of their decisions and their black-box nature, which result in a lack of trustworthiness. To alleviate this problem, methods in the field of…

Machine Learning · Computer Science 2025-11-13 Helena Monke , Benjamin Fresz , Marco Bernreuther , Yilin Chen , Marco F. Huber

Existing ordinal trees and random forests typically use scores that are assigned to the ordered categories, which implies that a higher scale level is used. Versions of ordinal trees are proposed that take the scale level seriously and…

Methodology · Statistics 2021-02-02 Gerhard Tutz

We introduce an algorithm for generating a random sequence of fragmentation trees, which we call the ancestral branching algorithm. This algorithm builds on the recursive partitioning structure of a tree and gives rise to an associated…

Probability · Mathematics 2011-11-02 Harry Crane

One can often make inferences about a growing network from its current state alone. For example, it is generally possible to determine how a network changed over time or pick among plausible mechanisms explaining its growth. In practice,…

Social and Information Networks · Computer Science 2021-01-27 George T. Cantwell , Guillaume St-Onge , Jean-Gabriel Young

This paper describes experiments, on two domains, to investigate the effect of averaging over predictions of multiple decision trees, instead of using a single tree. Other authors have pointed out theoretical and commonsense reasons for…

Machine Learning · Computer Science 2013-04-10 Suk Wah Kwok , Chris Carter

We derive ensembles of decision trees through a nonparametric Bayesian model, allowing us to view random forests as samples from a posterior distribution. This insight provides large gains in interpretability, and motivates a class of…

Applications · Statistics 2015-05-19 Matt Taddy , Chun-Sheng Chen , Jun Yu , Mitch Wyle

Variable selection for high-dimensional linear models has received a lot of attention lately, mostly in the context of l1-regularization. Part of the attraction is the variable selection effect: parsimonious models are obtained, which are…

Machine Learning · Statistics 2009-06-22 Nicolai Meinshausen

In this paper we investigate the use of staged tree models for discrete longitudinal data. Staged trees are a type of probabilistic graphical model for finite sample space processes. They are a natural fit for longitudinal data because a…

Methodology · Statistics 2024-01-10 Jack Storror Carter , Manuele Leonelli , Eva Riccomagno , Alessandro Ugolini

The automatic generation of decision trees based on off-line reasoning on models of a domain is a reasonable compromise between the advantages of using a model-based approach in technical domains and the constraints imposed by embedded…

Artificial Intelligence · Computer Science 2011-06-28 L. Console , C. Picardi , D. Theseider Duprè

Decision trees are a popular family of models due to their attractive properties such as interpretability and ability to handle heterogeneous data. Concurrently, missing data is a prevalent occurrence that hinders performance of machine…

Machine Learning · Computer Science 2020-07-01 Pasha Khosravi , Antonio Vergari , YooJung Choi , Yitao Liang , Guy Van den Broeck

High-dimensional policies, such as those represented by neural networks, cannot be reasonably interpreted by humans. This lack of interpretability reduces the trust users have in policy behavior, limiting their use to low-impact tasks such…

Machine Learning · Computer Science 2021-09-20 John Mern , Sidhart Krishnan , Anil Yildiz , Kyle Hatch , Mykel J. Kochenderfer

We introduce random spatial forests, a method of bagging regression trees allowing for spatial correlation. Our main contribution is the development of a computationally efficient tree building algorithm which selects each split of the tree…

Methodology · Statistics 2020-07-24 Travis Hee Wai , Michael T. Young , Adam A. Szpiro

We propose an approach for learning optimal tree-based prescription policies directly from data, combining methods for counterfactual estimation from the causal inference literature with recent advances in training globally-optimal decision…

Machine Learning · Computer Science 2020-12-07 Maxime Amram , Jack Dunn , Ying Daisy Zhuo

Tree ensembles are very popular machine learning models, known for their effectiveness in supervised classification and regression tasks. Their performance derives from aggregating predictions of multiple decision trees, which are renowned…

Optimization and Control · Mathematics 2025-01-14 Lorenzo Bonasera , Emilio Carrizosa

A common approach to aggregate classification estimates in an ensemble of decision trees is to either use voting or to average the probabilities for each class. The latter takes uncertainty into account, but not the reliability of the…

Machine Learning · Computer Science 2022-08-17 Florian Busch , Moritz Kulessa , Eneldo Loza Mencía , Hendrik Blockeel

Assume we are given a set of items from a general metric space, but we neither have access to the representation of the data nor to the distances between data points. Instead, suppose that we can actively choose a triplet of items (A,B,C)…

Machine Learning · Statistics 2018-06-19 Siavash Haghiri , Damien Garreau , Ulrike von Luxburg

Boosted trees is a dominant ML model, exhibiting high accuracy. However, boosted trees are hardly intelligible, and this is a problem whenever they are used in safety-critical applications. Indeed, in such a context, rigorous explanations…

Artificial Intelligence · Computer Science 2022-09-19 Gilles Audemard , Jean-Marie Lagniez , Pierre Marquis , Nicolas Szczepanski