English
Related papers

Related papers: BEST : A decision tree algorithm that handles miss…

200 papers

Solving a decision theory problem usually involves finding the actions, among a set of possible ones, which optimize the expected reward, possibly accounting for the uncertainty of the environment. In this paper, we introduce the…

Artificial Intelligence · Computer Science 2025-02-19 Damiano Azzolini , Elena Bellodi , Rafael Kiesel , Fabrizio Riguzzi

Classifying states as entangled or separable is a fundamental, but expensive task. This paper presents a method, the forest algorithm, to improve the amount of resources needed to detect entanglement. Starting from 'optimized' methods for…

Quantum Physics · Physics 2024-05-24 Bingjie Wang

Recently proposed budding tree is a decision tree algorithm in which every node is part internal node and part leaf. This allows representing every decision tree in a continuous parameter space, and therefore a budding tree can be jointly…

Machine Learning · Computer Science 2014-12-22 Ozan İrsoy , Ethem Alpaydın

Missing data is a crucial issue when applying machine learning algorithms to real-world datasets. Starting from the simple assumption that two batches extracted randomly from the same dataset should share the same distribution, we leverage…

Machine Learning · Statistics 2020-07-02 Boris Muzellec , Julie Josse , Claire Boyer , Marco Cuturi

Many real-world problems require making sequences of decisions where the outcomes of each decision are probabilistic and uncertain, and the availability of different actions is constrained by the outcomes of previous actions. There is a…

Optimization and Control · Mathematics 2025-04-28 Berk Ozturk , She'ifa Punla-Green , Les Servi

In tabular prediction tasks, tree-based models combined with automated feature engineering methods often outperform deep learning approaches that rely on learned representations. While these feature engineering techniques are effective,…

Machine Learning · Computer Science 2024-11-19 Jaehyun Nam , Kyuyoung Kim , Seunghyuk Oh , Jihoon Tack , Jaehyung Kim , Jinwoo Shin

This paper presents a brand new nonparametric density estimation strategy named the best-scored random forest density estimation whose effectiveness is supported by both solid theoretical analysis and significant experimental performance.…

Machine Learning · Statistics 2019-05-10 Hanyuan Hang , Hongwei Wen

We learn sensor trees from training data to minimize sensor acquisition costs during test time. Our system adaptively selects sensors at each stage if necessary to make a confident classification. We pose the problem as empirical risk…

Machine Learning · Statistics 2015-09-11 Joseph Wang , Kirill Trapeznikov , Venkatesh Saligrama

Data mining and machine learning techniques such as classification and regression trees (CART) represent a promising alternative to conventional logistic regression for propensity score estimation. Whereas incomplete data preclude the…

Machine Learning · Statistics 2018-07-26 Bas B. L. Penning de Vries , Maarten van Smeden , Rolf H. H. Groenwold

For effective decision support in scenarios with conflicting objectives, sets of potentially optimal solutions can be presented to the decision maker. We explore both what policies these sets should contain and how such sets can be computed…

Artificial Intelligence · Computer Science 2023-07-19 Willem Röpke , Conor F. Hayes , Patrick Mannion , Enda Howley , Ann Nowé , Diederik M. Roijers

Learning algorithms produce software models for realising critical classification tasks. Decision trees models are simpler than other models such as neural network and they are used in various critical domains such as the medical and the…

Machine Learning · Computer Science 2020-10-27 Tianqi Xiao , Omer Nguena Timo , Florent Avellaneda , Yasir Malik , Stefan Bruda

Tree ensembles are non-parametric methods widely recognized for their accuracy and ability to capture complex interactions. While these models excel at prediction, they are difficult to interpret and may fail to uncover useful relationships…

Machine Learning · Statistics 2026-04-01 Brian Liu , Rahul Mazumder , Peter Radchenko

Causal inference is essential for data-driven decision-making, as it aims to uncover causal relationships from observational data. However, identifying causality remains challenging due to the potential for confounding and the distinction…

Machine Learning · Statistics 2026-05-08 Tianyu Yang , Md. Noor-E-Alam

Decision tree is an effective classification approach in data mining and machine learning. In applications, test costs and misclassification costs should be considered while inducing decision trees. Recently, some cost-sensitive learning…

Artificial Intelligence · Computer Science 2012-11-20 Zilong Xu , Fan Min , William Zhu

This paper proposes FREEtree, a tree-based method for high dimensional longitudinal data with correlated features. Popular machine learning approaches, like Random Forests, commonly used for variable selection do not perform well when there…

Machine Learning · Statistics 2020-06-18 Yuancheng Xu , Athanasse Zafirov , R. Michael Alvarez , Dan Kojis , Min Tan , Christina M. Ramirez

A novel correction algorithm is proposed for multi-class classification problems with corrupted training data. The algorithm is non-intrusive, in the sense that it post-processes a trained classification model by adding a correction…

Machine Learning · Computer Science 2020-02-13 Jun Hou , Tong Qin , Kailiang Wu , Dongbin Xiu

Data-driven algorithm design is a paradigm that uses statistical and machine learning techniques to select from a class of algorithms for a computational problem an algorithm that has the best expected performance with respect to some…

Machine Learning · Computer Science 2024-06-05 Hongyu Cheng , Sammy Khalife , Barbara Fiedorowicz , Amitabh Basu

Bringing high-level machine learning models to efficient and well-suited machine implementations often invokes a bunch of tools, e.g.~code generators, compilers, and optimizers. Along such tool chains, abstractions have to be applied. This…

Machine Learning · Computer Science 2024-04-11 Daniel Biebert , Christian Hakert , Kuan-Hsun Chen , Jian-Jia Chen

In this paper we present a new algorithm for learning oblique decision trees. Most of the current decision tree algorithms rely on impurity measures to assess the goodness of hyperplanes at each node while learning a decision tree in a…

Machine Learning · Computer Science 2012-10-16 Naresh Manwani , P. S. Sastry

Classifying samples in incomplete datasets is a common aim for machine learning practitioners, but is non-trivial. Missing data is found in most real-world datasets and these missing values are typically imputed using established methods,…