English
Related papers

Related papers: Fr\'echet random forests for metric space valued r…

200 papers

Ensemble methods are among the state-of-the-art predictive modeling approaches. Applied to modern big data, these methods often require a large number of sub-learners, where the complexity of each learner typically grows with the size of…

Machine Learning · Computer Science 2018-10-29 Amichai Painsky , Saharon Rosset

Random forests are a type of ensemble method which makes predictions by combining the results of several independent trees. However, the theory of random forests has long been outpaced by their application. In this paper, we propose a novel…

Machine Learning · Computer Science 2015-07-23 Jianyuan Sun , Guoqiang Zhong , Junyu Dong , Yajuan Cai

Samples of phylogenetic trees arise in a variety of evolutionary and biomedical applications, and the Fr\'echet mean in Billera-Holmes-Vogtmann tree space is a summary tree shown to have advantages over other mean or consensus trees.…

Populations and Evolution · Quantitative Biology 2024-07-08 Lars Lammers , Tom M. W. Nye , Stephan F. Huckemann

There are numerous randomized algorithms to generate spanning trees in a given ambient graph; several target the uniform distribution on trees (UST), while in practice the fastest and most frequently used draw random weights on the edges…

Discrete Mathematics · Computer Science 2026-04-29 Eric Babson , Moon Duchin , Annina Iseli , Pietro Poggi-Corradini , Dylan Thurston , Jamie Tucker-Foltz

We propose Partition Tree, a novel tree-based framework for conditional density estimation over general outcome spaces that supports both continuous and categorical variables within a unified formulation. Our approach models conditional…

Machine Learning · Computer Science 2026-05-13 Felipe Angelim , Alessandro Leite

Classification of functional data where observations are curves or trajectories poses unique challenges, particularly under severe class imbalance. Traditional Random Forest algorithms, while robust for tabular data, often fail to capture…

Machine Learning · Statistics 2025-12-10 Fahad Mostafa , Hafiz Khan

Tree-based methods are powerful nonparametric techniques in statistics and machine learning. However, their effectiveness, particularly in finite-sample settings, is not fully understood. Recent applications have revealed their surprising…

Statistics Theory · Mathematics 2024-10-04 Hengrui Luo , Meng Li

While statistical learning methods have proved powerful tools for predictive modeling, the black-box nature of the models they produce can severely limit their interpretability and the ability to conduct formal inference. However, the…

Machine Learning · Statistics 2016-08-30 Lucas Mentch , Giles Hooker

Random forests are powerful non-parametric regression method but are severely limited in their usage in the presence of randomly censored observations, and naively applied can exhibit poor predictive performance due to the incurred biases.…

Machine Learning · Statistics 2020-01-13 Alexander Hanbo Li , Jelena Bradic

D. Wilson~\cite{[Wi]} in the 1990's described a simple and efficient algorithm based on loop-erased random walks to sample uniform spanning trees and more generally weighted trees or forests spanning a given graph. This algorithm provides a…

Probability · Mathematics 2018-08-29 L. Avena , F. Castell , A. Gaudilliere , C. Melot

Random Forest (RF) is an ensemble supervised machine learning technique that was developed by Breiman over a decade ago. Compared with other ensemble techniques, it has proved its accuracy and superiority. Many researchers, however, believe…

Machine Learning · Computer Science 2015-03-18 Khaled Fawagreh , Mohamad Medhat Gaber , Eyad Elyan

Machine learning (ML) algorithms become increasingly important in the analysis of astronomical data. However, since most ML algorithms are not designed to take data uncertainties into account, ML based studies are mostly restricted to data…

Instrumentation and Methods for Astrophysics · Physics 2018-12-26 Itamar Reis , Dalya Baron , Sahar Shahaf

Quantifying prediction uncertainty when applying object detection models to new, unlabeled datasets is critical in applied machine learning. This study introduces an approach to estimate the performance of deep learning-based object…

Computer Vision and Pattern Recognition · Computer Science 2025-01-16 Ni Li , Ryan Jacobs , Matthew Lynch , Vidit Agrawal , Kevin Field , Dane Morgan

This paper presents a new ensemble learning method for classification problems called projection pursuit random forest (PPF). PPF uses the PPtree algorithm introduced in Lee et al. (2013). In PPF, trees are constructed by splitting on…

Machine Learning · Statistics 2021-05-24 Natalia da Silva , Dianne Cook , Eun-Kyung Lee

Space partitioning methods such as random forests and the Mondrian process are powerful machine learning methods for multi-dimensional and relational data, and are based on recursively cutting a domain. The flexibility of these methods is…

Machine Learning · Statistics 2019-12-03 Shufei Ge , Shijia Wang , Yee Whye Teh , Liangliang Wang , Lloyd T. Elliott

This paper proposes a novel type of random forests called a denoising random forests that are robust against noises contained in test samples. Such noise-corrupted samples cause serious damage to the estimation performances of random…

Computer Vision and Pattern Recognition · Computer Science 2017-10-31 Masaya Hibino , Akisato Kimura , Takayoshi Yamashita , Yuji Yamauchi , Hironobu Fujiyoshi

Decision trees are widely used for classification and regression tasks in a variety of application fields due to their interpretability and good accuracy. During the past decade, growing attention has been devoted to globally optimized…

Machine Learning · Computer Science 2025-01-28 Antonio Consolo , Edoardo Amaldi , Andrea Manno

The infinitesimal jackknife (IJ) has recently been applied to the random forest to estimate its prediction variance. These theorems were verified under a traditional random forest framework which uses classification and regression trees…

Machine Learning · Statistics 2021-08-05 Cole Brokamp , MB Rao , Patrick Ryan , Roman Jandarov

The paper describes an application of the tree classification method Random Forest (RF), as used in the analysis of data from the ground-based gamma telescope MAGIC. In such telescopes, cosmic gamma-rays are observed and have to be…

Astrophysics · Physics 2008-11-26 J. Albert

Regression trees and random forests are popular and effective non-parametric estimators in practical applications. A recent paper by Athey and Wager shows that the random forest estimate at any point is asymptotically Gaussian; in this…

Econometrics · Economics 2021-02-02 Kevin Li