English
Related papers

Related papers: Classification trees in a box extent lattice

200 papers

In classification and forecasting with tabular data, one often utilizes tree-based models. Those can be competitive with deep neural networks on tabular data and, under some conditions, explainable. The explainability depends on the depth…

Machine Learning · Computer Science 2024-06-05 Jiri Nemecek , Tomas Pevny , Jakub Marecek

Large language models (LLMs) are in need of sufficient contexts to handle many critical applications, such as retrieval augmented generation and few-shot learning. However, due to the constrained window size, the LLMs can only access to the…

Computation and Language · Computer Science 2024-01-17 Ninglu Shao , Shitao Xiao , Zheng Liu , Peitian Zhang

Tree ensembles, such as random forests and boosted trees, are renowned for their high prediction performance. However, their interpretability is critically limited due to the enormous complexity. In this study, we present a method to make a…

Machine Learning · Statistics 2017-03-01 Satoshi Hara , Kohei Hayashi

Many real-world problems require making sequences of decisions where the outcomes of each decision are probabilistic and uncertain, and the availability of different actions is constrained by the outcomes of previous actions. There is a…

Optimization and Control · Mathematics 2025-04-28 Berk Ozturk , She'ifa Punla-Green , Les Servi

Revealing the syntactic structure of sentences in Chinese poses significant challenges for word-level parsers due to the absence of clear word boundaries. To facilitate a transition from word-level to character-level Chinese dependency…

Computation and Language · Computer Science 2024-06-07 Yang Hou , Zhenghua Li

A new tree model is introduced based on ordered trees, by distinguishing exactly one child of each node that \emph{has} children. The basic enumeration leads to a cubic equation of the generating function. The extraction of its coefficients…

Combinatorics · Mathematics 2026-02-27 Helmut Prodinger

The main contribution of this paper is the development of a new decision tree algorithm. The proposed approach allows users to guide the algorithm through the data partitioning process. We believe this feature has many applications but in…

Machine Learning · Statistics 2020-10-27 Cédric Beaulac , Jeffrey S. Rosenthal

An evolutionary tree is a rooted tree where each internal vertex has at least two children and where the leaves are labeled with distinct symbols representing species. Evolutionary trees are useful for modeling the evolutionary history of…

Computational Engineering, Finance, and Science · Computer Science 2007-05-23 Ming-Yang Kao

Decision trees are a popular technique in statistical data classification. They recursively partition the feature space into disjoint sub-regions until each sub-region becomes homogeneous with respect to a particular class. The basic…

Machine Learning · Statistics 2015-04-15 D. C. Wickramarachchi , B. L. Robertson , M. Reale , C. J. Price , J. Brown

We describe Information Forests, an approach to classification that generalizes Random Forests by replacing the splitting criterion of non-leaf nodes from a discriminative one -- based on the entropy of the label distribution -- to a…

Machine Learning · Computer Science 2015-03-20 Zhao Yi , Stefano Soatto , Maneesh Dewan , Yiqiang Zhan

Box folding represents a crucial challenge for automated packaging systems. This work bridges the gap between existing methods for folding sequence extraction and approaches focused on the adaptability of automated systems to specific box…

Both neural networks and decision trees are popular machine learning methods and are widely used to solve problems from diverse domains. These two classifiers are commonly used base classifiers in an ensemble framework. In this paper, we…

Machine Learning · Computer Science 2018-02-06 Rakesh Katuwal , P. N. Suganthan

We give an algorithm to enumerate the results on trees of monadic second-order (MSO) queries represented by nondeterministic tree automata. After linear time preprocessing (in the input tree), we can enumerate answers with linear delay (in…

Databases · Computer Science 2019-08-28 Antoine Amarilli , Pierre Bourhis , Stefan Mengel , Matthias Niewerth

Decision forest algorithms typically model data by learning a binary tree structure recursively where every node splits the feature space into two sub-regions, sending examples into the left or right branch as a result. In axis-aligned…

Machine Learning · Computer Science 2021-02-08 Mathieu Guillame-Bert , Sebastian Bruch , Petr Mitrichev , Petr Mikheev , Jan Pfeifer

This work presents a new classifier that is specifically designed to be fully interpretable. This technique determines the probability of a class outcome, based directly on probability assignments measured from the training data. The…

Machine Learning · Statistics 2017-10-31 Sapan Agarwal , Corey M. Hudson

State-of-the-art clustering algorithms use heuristics to partition the feature space and provide little insight into the rationale for cluster membership, limiting their interpretability. In healthcare applications, the latter poses a…

Machine Learning · Statistics 2018-12-04 Dimitris Bertsimas , Agni Orfanoudaki , Holly Wiberg

Random forests and, more generally, (decision\nobreakdash-)tree ensembles are widely used methods for classification and regression. Recent algorithmic advances allow to compute decision trees that are optimal for various measures such as…

Machine Learning · Computer Science 2024-09-25 Christian Komusiewicz , Pascal Kunz , Frank Sommer , Manuel Sorge

Multiple (simple) context-free tree grammars are investigated, where "simple" means "linear and nondeleting". Every multiple context-free tree grammar that is finitely ambiguous can be lexicalized; i.e., it can be transformed into an…

Formal Languages and Automata Theory · Computer Science 2017-07-13 Joost Engelfriet , Andreas Maletti , Sebastian Maneth

The paper proposes a new variant of a decision tree, called an Extreme Learning Tree. It consists of an extremely random tree with non-linear data transformation, and a linear observer that provides predictions based on the leaf index where…

Machine Learning · Computer Science 2019-12-20 Anton Akusok , Emil Eirola , Kaj-Mikael Björk , Amaury Lendasse

The Fenwick tree is a classical implicit data structure that stores an array in such a way that modifying an element, accessing an element, computing a prefix sum and performing a predecessor search on prefix sums all take logarithmic time.…

Data Structures and Algorithms · Computer Science 2019-10-15 Stefano Marchini , Sebastiano Vigna