English
Related papers

Related papers: Computational Aspects of Optional P\'{o}lya Tree

200 papers

The optimization and machine learning toolkit (OMLT) is an open-source software package incorporating neural network and gradient-boosted tree surrogate models, which have been trained using machine learning, into larger optimization…

This paper introduces a novel tree-based model, Learning Hyperplane Tree (LHT), which outperforms state-of-the-art (SOTA) tree models for classification tasks on several public datasets. The structure of LHT is simple and efficient: it…

Machine Learning · Computer Science 2025-01-16 Hongyi Li , Jun Xu , William Ward Armstrong

Object Oriented Data Analysis is a new area in statistics that studies populations of general data objects. In this article we consider populations of tree-structured objects as our focus of interest. We develop improved analysis tools for…

Methodology · Statistics 2012-02-14 Burcu Aydın , Gábor Pataki , Haonan Wang , Alim Ladha , Elizabeth Bullitt , J. S. Marron

P\'olya trees are rooted, unlabeled trees on $n$ vertices. This paper gives an efficient, new way to generate P\'olya trees. This allows comparing typical unlabeled and labeled tree statistics and comparing asymptotic theorems with…

Combinatorics · Mathematics 2024-11-27 Laurent Bartholdi , Persi Diaconis

This paper presents a detailed comparison of a recently proposed algorithm for optimizing decision trees, tree alternating optimization (TAO), with other popular, established algorithms. We compare their performance on a number of…

Machine Learning · Computer Science 2020-03-23 Arman Zharmagambetov , Suryabhan Singh Hada , Miguel Á. Carreira-Perpiñán , Magzhan Gabidolla

Bayesian hierarchical models are used to share information between related samples and obtain more accurate estimates of sample-level parameters, common structure, and variation between samples. When the parameter of interest is the…

Methodology · Statistics 2019-06-18 Jonathan Christensen , Li Ma

This paper proposes a novel framework for delay-tolerant particle filtering that is computationally efficient and has limited memory requirements. Within this framework the informativeness of a delayed (out-of-sequence) measurement (OOSM)…

Applications · Statistics 2015-05-20 Boris N. Oreshkin , Xuan Liu , Mark J. Coates

We propose a new algorithm called PLUTO for building logistic regression trees to binary response data. PLUTO can capture the nonlinear and interaction patterns in messy data by recursively partitioning the sample space. It fits a simple or…

Machine Learning · Statistics 2014-11-26 Wenwen Zhang , Wei-Yin Loh

Linear model trees are regression trees that incorporate linear models in the leaf nodes. This preserves the intuitive interpretation of decision trees and at the same time enables them to better capture linear relationships, which is hard…

Machine Learning · Statistics 2024-07-10 Jakob Raymaekers , Peter J. Rousseeuw , Tim Verdonck , Ruicong Yao

In this paper we propose a dynamic data structure that supports efficient algorithms for updating and querying singly connected Bayesian networks (causal trees and polytrees). In the conventional algorithms, new evidence in absorbed in time…

Artificial Intelligence · Computer Science 2014-08-08 Arthur L. Delcher , Adam J. Grove , Simon Kasif , Judea Pearl

Decision tree algorithms have been among the most popular algorithms for interpretable (transparent) machine learning since the early 1980's. The problem that has plagued decision tree algorithms since their inception is their lack of…

Machine Learning · Computer Science 2023-09-28 Xiyang Hu , Cynthia Rudin , Margo Seltzer

We introduce a hierarchical nonparametric model for probability measures based on a multi-resolution transformation of probability distributions. The model allows a varying amount of shrinkage to be applied to data features of different…

Methodology · Statistics 2015-03-31 Li Ma

In this paper, we propose a novel formalism called Probabilistic Obstruction Temporal Logic (POTL), which extends Obstruction Logic (OL) by incorporating probabilistic elements. POTL provides a robust framework for reasoning about the…

Logic in Computer Science · Computer Science 2024-11-04 Jean Leneutre , Vadim Malvone , James Ortiz

We propose a simple recursive data-based partitioning scheme which produces piecewise-constant or piecewise-linear density estimates on intervals, and show how this scheme can determine the optimal $L_1$ minimax rate for some discrete…

Statistics Theory · Mathematics 2019-07-01 Luc Devroye , Tommy Reddad

Decision trees are popular Classification and Regression tools and, when small-sized, easy to interpret. Traditionally, a greedy approach has been used to build the trees, yielding a very fast training process; however, controlling sparsity…

Optimization and Control · Mathematics 2020-02-24 Rafael Blanquero , Emilio Carrizosa , Cristina Molero-Río , Dolores Romero Morales

Techniques to reduce the energy burden of an industrial ecosystem often require solving a multiobjective optimization problem. However, collecting experimental data can often be either expensive or time-consuming. In such cases, statistical…

Machine Learning · Computer Science 2021-09-07 Akira Horiguchi , Thomas J. Santner , Ying Sun , Matthew T. Pratola

Decision trees and randomized forests are widely used in computer vision and machine learning. Standard algorithms for decision tree induction optimize the split functions one node at a time according to some splitting criteria. This greedy…

Machine Learning · Computer Science 2015-11-13 Mohammad Norouzi , Maxwell D. Collins , Matthew Johnson , David J. Fleet , Pushmeet Kohli

Decision Tree (DT) Learning is a fundamental problem in Interpretable Machine Learning, yet it poses a formidable optimisation challenge. Practical algorithms have recently emerged, primarily leveraging Dynamic Programming and Branch &…

Machine Learning · Computer Science 2025-05-13 Ayman Chaouki , Jesse Read , Albert Bifet

Formal XAI (explainable AI) is a growing area that focuses on computing explanations with mathematical guarantees for the decisions made by ML models. Inside formal XAI, one of the most studied cases is that of explaining the choices taken…

Machine Learning · Computer Science 2022-07-26 Marcelo Arenas , Pablo Barceló , Miguel Romero , Bernardo Subercaseaux

Open Answer Set Programming (OASP) is an attractive framework for integrating ontologies and rules. In general OASP is undecidable. In previous work we provided a tableau-based algorithm for satisfiability checking w.r.t. forest logic…

Logic in Computer Science · Computer Science 2010-11-30 Cristina Feier , Stijn Heymans