English
Related papers

Related papers: Learning Decision Trees and Forests with Algorithm…

200 papers

Algorithmic recourse suggests actions to individuals who have been adversely affected by automated decision-making, helping them to achieve the desired outcome. Knowing the recourse, however, does not guarantee that users can implement it…

Machine Learning · Computer Science 2025-08-18 Yueqing Xuan , Kacper Sokol , Mark Sanderson , Jeffrey Chan

We present an algorithm for learning decision trees using stochastic gradient information as the source of supervision. In contrast to previous approaches to gradient-based tree learning, our method operates in the incremental learning…

Machine Learning · Statistics 2019-09-25 Henry Gouk , Bernhard Pfahringer , Eibe Frank

Decision trees and decision rule systems play important roles as classifiers, knowledge representation tools, and algorithms. They are easily interpretable models for data analysis, making them widely used and studied in computer science.…

Artificial Intelligence · Computer Science 2024-01-17 Kerven Durdymyradov , Mikhail Moshkov

Recent work has discussed the limitations of counterfactual explanations to recommend actions for algorithmic recourse, and argued for the need of taking causal relationships between features into consideration. Unfortunately, in practice,…

Machine Learning · Computer Science 2020-10-26 Amir-Hossein Karimi , Julius von Kügelgen , Bernhard Schölkopf , Isabel Valera

Most decision tree induction algorithms are based on a greedy top-down recursive partitioning strategy for tree growth. In this paper, we propose several methods for induction of decision trees and their ensembles based on evolutionary…

Neural and Evolutionary Computing · Computer Science 2020-02-04 Evgeny Dolotov , Nikolai Zolotykh

We investigate active learning by pairwise similarity over the leaves of trees originating from hierarchical clustering procedures. In the realizable setting, we provide a full characterization of the number of queries needed to achieve…

Machine Learning · Computer Science 2019-10-15 Fabio Vitale , Anand Rajagopalan , Claudio Gentile

Within machine learning, the supervised learning field aims at modeling the input-output relationship of a system, from past observations of its behavior. Decision trees characterize the input-output relationship through a series of nested…

Machine Learning · Statistics 2019-05-20 Arnaud Joly

Sentence embedding is an effective feature representation for most deep learning-based NLP tasks. One prevailing line of methods is using recursive latent tree-structured networks to embed sentences with task-specific structures. However,…

Computation and Language · Computer Science 2018-11-16 Jiaxin Shi , Lei Hou , Juanzi Li , Zhiyuan Liu , Hanwang Zhang

Algorithmic recourse recommendations, such as Karimi et al.'s (2021) causal recourse (CR), inform stakeholders of how to act to revert unfavourable decisions. However, some actions lead to acceptance (i.e., revert the model's decision) but…

Machine Learning · Statistics 2025-05-30 Gunnar König , Timo Freiesleben , Moritz Grosse-Wentrup

Decision trees are ubiquitous in machine learning for their ease of use and interpretability. Yet, these models are not typically employed in reinforcement learning as they cannot be updated online via stochastic gradient descent. We…

Machine Learning · Computer Science 2020-06-29 Andrew Silva , Taylor Killian , Ivan Dario Jimenez Rodriguez , Sung-Hyun Son , Matthew Gombolay

Reverse search is a convenient method for enumerating structured objects, that can be used both to address theoretical issues and to solve data mining problems. This method has already been successfully developed to handle unordered trees.…

Discrete Mathematics · Computer Science 2022-05-13 Florian Ingels , Romain Azaïs

Although adversarial examples and model robustness have been extensively studied in the context of linear models and neural networks, research on this issue in tree-based models and how to make tree-based models robust against adversarial…

Machine Learning · Computer Science 2019-06-12 Hongge Chen , Huan Zhang , Duane Boning , Cho-Jui Hsieh

Machine learning is increasingly used to inform decision-making in sensitive situations where decisions have consequential effects on individuals' lives. In these settings, in addition to requiring models to be accurate and robust, socially…

Machine Learning · Computer Science 2021-03-02 Amir-Hossein Karimi , Gilles Barthe , Bernhard Schölkopf , Isabel Valera

Optimal motion planning involves obstacles avoidance where path planning is the key to success in optimal motion planning. Due to the computational demands, most of the path planning algorithms can not be employed for real-time based…

Robotics · Computer Science 2022-02-15 Geesara Kulathunga

Decision trees remain one of the most popular machine learning models today, largely due to their out-of-the-box performance and interpretability. In this work, we present a Bayesian approach to decision tree induction via maximum a…

Machine Learning · Computer Science 2023-12-21 Colin Sullivan , Mo Tiwari , Sebastian Thrun

Random forest (RF) methodology is one of the most popular machine learning techniques for prediction problems. In this article, we discuss some cases where random forests may suffer and propose a novel generalized RF method, namely…

Machine Learning · Statistics 2019-04-24 Haozhe Zhang , Dan Nettleton , Zhengyuan Zhu

We explore an active learning approach for dynamic fair resource allocation problems. Unlike previous work that assumes full feedback from all agents on their allocations, we consider feedback from a select subset of agents at each epoch of…

Machine Learning · Computer Science 2024-06-24 Riddhiman Bhattacharya , Thanh Nguyen , Will Wei Sun , Mohit Tawarmalani

Random forests are a learning algorithm proposed by Breiman [Mach. Learn. 45 (2001) 5--32] that combines several randomized decision trees and aggregates their predictions by averaging. Despite its wide usage and outstanding practical…

Statistics Theory · Mathematics 2015-08-11 Erwan Scornet , Gérard Biau , Jean-Philippe Vert

Algorithmic recourse -- providing recommendations to those affected negatively by the outcome of an algorithmic system on how they can take action and change that outcome -- has gained attention as a means of giving persons agency in their…

Machine Learning · Computer Science 2024-01-30 Andrew Bell , Joao Fonseca , Carlo Abrate , Francesco Bonchi , Julia Stoyanovich

Agentic retrieval-augmented generation (RAG) formulates question answering as a multi-step interaction between reasoning and information retrieval, and has recently been advanced by reinforcement learning (RL) with outcome-based…

Computation and Language · Computer Science 2026-01-13 Tianhua Zhang , Kun Li , Junan Li , Yunxiang Li , Hongyin Luo , Xixin Wu , James Glass , Helen Meng