English
Related papers

Related papers: Data, Trees, and Forests -- Decision Tree Learning…

200 papers

Neural networks and tree ensembles are state-of-the-art learners, each with its unique statistical and computational advantages. We aim to combine these advantages by introducing a new layer for neural networks, composed of an ensemble of…

Machine Learning · Computer Science 2020-07-14 Hussein Hazimeh , Natalia Ponomareva , Petros Mol , Zhenyu Tan , Rahul Mazumder

Interpretability of AI models allows for user safety checks to build trust in such AIs. In particular, Decision Trees (DTs) provide a global look at the learned model and transparently reveal which features of the input are critical for…

Machine Learning · Computer Science 2024-01-23 Hector Kohler , Riad Akrour , Philippe Preux

A decision tree recursively splits a feature space $\mathbb{R}^{d}$ and then assigns class labels based on the resulting partition. Decision trees have been part of the basic machine-learning toolkit for decades. A large body of work treats…

Understanding learners' understanding is a key requirement for an efficient design of teaching situations and learning environments, be they digital or not. This keynote outlines the modeling framework cK\cent (conception, knowing, concept)…

History and Overview · Mathematics 2013-08-27 Nicolas Balacheff

The growth of Educational Technology (EdTech) has enabled highly personalized learning experiences through Artificial Intelligence (AI)-based recommendation systems tailored to each student needs. However, these systems can unintentionally…

Artificial Intelligence · Computer Science 2025-02-28 Nazarii Drushchak , Vladyslava Tyshchenko , Nataliya Polyakovska

We introduce Hyper-Trees as a novel framework for modeling time series data using gradient boosted trees. Unlike conventional tree-based approaches that forecast time series directly, Hyper-Trees learn the parameters of a target time series…

Machine Learning · Computer Science 2026-02-09 Alexander März , Kashif Rasul

Decision tree induction systems are being used for knowledge acquisition in noisy domains. This paper develops a subjective Bayesian interpretation of the task tackled by these systems and the heuristic methods they use. It is argued that…

Artificial Intelligence · Computer Science 2013-04-11 Wray L. Buntine

Ensemble methods such as random forests have transformed the landscape of supervised learning, offering highly accurate prediction through the aggregation of multiple weak learners. However, despite their effectiveness, these methods often…

Machine Learning · Computer Science 2026-05-29 Massimo Aria , Agostino Gnasso , Carmela Iorio , Marjolein Fokkema

One-class Classification (OCC) is an area of machine learning which addresses prediction based on unbalanced datasets. Basically, OCC algorithms achieve training by means of a single class sample, with potentially some additional…

Machine Learning · Statistics 2020-03-27 Sarah Itani , Fabian Lecron , Philippe Fortemps

We present convincing empirical evidence for an effective and general strategy for building accurate small models. Such models are attractive for interpretability and also find use in resource-constrained environments. The strategy is to…

Machine Learning · Computer Science 2024-04-30 Abhishek Ghose

Despite outperforming the human in many tasks, deep neural network models are also criticized for the lack of transparency and interpretability in decision making. The opaqueness results in uncertainty and low confidence when deploying such…

Machine Learning · Computer Science 2017-09-14 Huijun Wu , Chen Wang , Jie Yin , Kai Lu , Liming Zhu

Random forests on the one hand, and neural networks on the other hand, have met great success in the machine learning community for their predictive performance. Combinations of both have been proposed in the literature, notably leading to…

Machine Learning · Computer Science 2021-10-15 Ludovic Arnould , Claire Boyer , Erwan Scornet , Sorbonne Lpsm

The use of Artificial Intelligence (AI) has gained momentum in education. However, the use of AI in K-12 education is still in its nascent stages, and further research and development is needed to realize its potential. Moreover, the…

Computers and Society · Computer Science 2024-12-05 Zhen-Qun Yang , Jiannong Cao , Xiaoyin Li , Kaile Wang , Xinzhe Zheng , Kai Cheung Franky Poon , Daniel Lai

Decision trees are a commonly used class of machine learning models valued for their interpretability and versatility, capable of both classification and regression. We propose ZTree, a novel decision tree learning framework that replaces…

Machine Learning · Computer Science 2025-09-17 Eric Cheng , Jie Cheng

Besides serving as prediction models, classification trees are useful for finding important predictor variables and identifying interesting subgroups in the data. These functions can be compromised by weak split selection algorithms that…

Applications · Statistics 2010-11-03 Wei-Yin Loh

This thesis tackles the problem of learning efficient representations of complex, structured data with a natural application to web page and element classification. We hypothesise that the context around the element inside the web page is…

Machine Learning · Computer Science 2021-11-09 Cedric Cook

In recent years, robots are used in an increasing variety of tasks, especially by small- and medium- sized enterprises. These tasks are usually fast-changing, they have a collaborative scenario and happen in unpredictable environments with…

Robotics · Computer Science 2022-03-11 Matteo Iovino , Fethiye Irmak Doğan , Iolanda Leite , Christian Smith

The aim of this study is to show the importance of two classification techniques, viz. decision tree and clustering, in prediction of learning disabilities (LD) of school-age children. LDs affect about 10 percent of all children enrolled in…

Artificial Intelligence · Computer Science 2010-11-03 Julie M. David And Kannan Balakrishnan

Decision trees are interpretable models that are well-suited to non-linear learning problems. Much work has been done on extending decision tree learning algorithms with differential privacy, a system that guarantees the privacy of samples…

Machine Learning · Computer Science 2023-10-13 Daniël Vos , Jelle Vos , Tianyu Li , Zekeriya Erkin , Sicco Verwer

As complex autonomous robotic systems become more widespread, the need for transparent and reusable Artificial Intelligence (AI) designs becomes more apparent. In this paper we analyse how the principles behind Behavior Trees (BTs), an…

Artificial Intelligence · Computer Science 2021-05-26 Oliver Biggar , Mohammad Zamani , Iman Shames