English
Related papers

Related papers: Random Forests as Statistical Procedures: Design, …

200 papers

Decision trees are commonly used predictive models due to their flexibility and interpretability. This paper is directed at quantifying the uncertainty of decision tree predictions by employing a Bayesian inference approach. This is…

Machine Learning · Computer Science 2024-03-28 Jodie A. Cochrane , Adrian Wills , Sarah J. Johnson

Estimating a causal effect from observational data can be biased if we do not control for self-selection. This selection is based on confounding variables that affect the treatment assignment and the outcome. Propensity score methods aim to…

Econometrics · Economics 2021-09-10 Daniel Jacob

Additive tree functionals allow to represent the cost of many divide-and-conquer algorithms. We give an invariance principle for such tree functionals for the Catalan model (random tree uniformly distributed among the full binary ordered…

Combinatorics · Mathematics 2016-09-09 Jean-François Delmas , Jean-Stéphane Dhersin , Marion Sciauveau

We consider the biased random walk on a tree constructed from the set of finite self-avoiding walks on a lattice, and use it to construct probability measures on infinite self-avoiding walks. The limit measure (if it exists) obtained when…

Probability · Mathematics 2019-12-25 Vincent Beffara , Cong Bang Huynh

We propose an innovative statistical method, called Ordinal Mixed-Effect Random Forest (OMERF), that extends the use of random forest to the analysis of hierarchical data and ordinal responses. The model preserves the flexibility and…

Methodology · Statistics 2024-06-06 Giulia Bergonzoli , Lidia Rossi , Chiara Masci

Many classification problems are naturally multi-view in the sense their data are described through multiple heterogeneous descriptions. For such tasks, dissimilarity strategies are effective ways to make the different descriptions…

Machine Learning · Computer Science 2020-07-17 Simon Bernard , Hongliu Cao , Robert Sabourin , Laurent Heutte

Consider a random real tree whose leaf set, or boundary, is endowed with a finite mass measure. Each element of the tree is further given a type, or allele, inherited from the most recent atom of a random point measure…

Probability · Mathematics 2018-09-26 Jean-Jil Duchamps , Amaury Lambert

Random forests remain among the most popular off-the-shelf supervised learning algorithms. Despite their well-documented empirical success, however, until recently, few theoretical results were available to describe their performance and…

Machine Learning · Statistics 2021-11-17 Wei Peng , Tim Coleman , Lucas Mentch

The recursive and hierarchical structure of full rooted trees is applicable to represent statistical models in various areas, such as data compression, image processing, and machine learning. In most of these cases, the full rooted tree is…

Machine Learning · Statistics 2022-03-24 Yuta Nakahara , Shota Saito , Akira Kamatsuka , Toshiyasu Matsushima

We consider growing random recursive trees in random environment, in which at each step a new vertex is attached (by an edge of a random length) to an existing tree vertex according to a probability distribution that assigns the tree…

Probability · Mathematics 2007-05-23 Konstantin Borovkov , Vladimir Vatutin

The issue of data-driven neural network model construction is one of the core problems in the domain of Artificial Intelligence. A standard approach assumes a fixed architecture with trainable weights. A conceptually more advanced…

Machine Learning · Computer Science 2025-07-03 Szymon Świderski , Agnieszka Jastrzębska

The spread of infectious disease in a human community or the proliferation of fake news on social media can be modeled as a randomly growing tree-shaped graph. The history of the random growth process is often unobserved but contains…

Probability · Mathematics 2021-01-15 Harry Crane , Min Xu

The paper attempts to validate the effectiveness of tree classifiers to classify tabla strokes especially the ones which are overlapping in nature. It uses decision tree, ID3 and random forest as classifiers. A custom made data sets of 650…

Sound · Computer Science 2018-01-08 Subodh Deolekar , Siby Abraham

In this paper we study asymptotic properties of random forests within the framework of nonlinear time series modeling. While random forests have been successfully applied in various fields, the theoretical justification has not been…

Machine Learning · Statistics 2020-08-07 Richard A. Davis , Mikkel S. Nielsen

Within machine learning, the supervised learning field aims at modeling the input-output relationship of a system, from past observations of its behavior. Decision trees characterize the input-output relationship through a series of nested…

Machine Learning · Statistics 2019-05-20 Arnaud Joly

Pairwise ordered tree alignment are combinatorial objects that appear in RNA secondary structure comparison. However, the usual representation of tree alignments as supertrees is ambiguous, i.e. two distinct supertrees may induce identical…

Quantitative Methods · Quantitative Biology 2016-03-08 Cedric Chauve , Julien Courtiel , Yann Ponty

Random forests are considered one of the best out-of-the-box classification and regression algorithms due to their high level of predictive performance with relatively little tuning. Pairwise proximities can be computed from a trained…

Machine Learning · Statistics 2023-03-02 Jake S. Rhodes , Adele Cutler , Kevin R. Moon

It is widely recognised that semiparametric efficient estimation can be hard to achieve in practice: estimators that are in theory efficient may require unattainable levels of accuracy for the estimation of complex nuisance functions. As a…

Statistics Theory · Mathematics 2024-12-18 Elliot H. Young , Rajen D. Shah

Random Forest is an ensemble of decision trees based on the bagging and random subspace concepts. As suggested by Breiman, the strength of unstable learners and the diversity among them are the ensemble models' core strength. In this paper,…

Machine Learning · Computer Science 2022-08-11 M. A. Ganaie , M. Tanveer , P. N. Suganthan , V. Snasel

Taking the Fourier integral theorem as our starting point, in this paper we focus on natural Monte Carlo and fully nonparametric estimators of multivariate distributions and conditional distribution functions. We do this without the need…

Methodology · Statistics 2021-06-15 Nhat Ho , Stephen G. Walker