English
Related papers

Related papers: A Unified Framework for Random Forest Prediction E…

200 papers

Predictions of fatalities from violent conflict on the PRIO-GRID-month (pgm) level are characterized by high levels of uncertainty, limiting their usefulness in practical applications. We discuss the two main sources of uncertainty for this…

Applications · Statistics 2026-03-13 Daniel Mittermaier , Tobias Bohne , Martin Hofer , Daniel Racek

Prediction models are used to predict an outcome based on input variables. Missing data in input variables often occurs at model development and at prediction time. The missForestPredict R package proposes an adaptation of the missForest…

Methodology · Statistics 2024-07-08 Elena Albu , Shan Gao , Laure Wynants , Ben Van Calster

This paper presents a general framework for estimating high-dimensional conditional latent factor models via constrained nuclear norm regularization. We establish large sample properties of the estimators and provide efficient algorithms…

Econometrics · Economics 2025-12-09 Qihui Chen

The R package DynForest implements random forests for predicting a continuous, a categorical or a (multiple causes) time-to-event outcome based on time-fixed and time-dependent predictors. The main originality of DynForest is that it…

Machine Learning · Statistics 2024-04-12 Anthony Devaux , Cécile Proust-Lima , Robin Genuer

Random forests have become an established tool for classification and regression, in particular in high-dimensional settings and in the presence of complex predictor-response relationships. For bounded outcome variables restricted to the…

Methodology · Statistics 2019-01-21 Leonie Weinhold , Matthias Schmid , Marvin N. Wright , Moritz Berger

Random forest regression (RF) is an extremely popular tool for the analysis of high-dimensional data. Nonetheless, its benefits may be lessened in sparse settings due to weak predictors, and a pre-estimation dimension reduction (targeting)…

A random forest prediction can be computed by the scalar product of the labels of the training examples and a set of weights that are determined by the leafs of the forest into which the test object falls; each prediction can hence be…

Machine Learning · Computer Science 2023-11-27 Henrik Boström

Random forests are a learning algorithm proposed by Breiman [Mach. Learn. 45 (2001) 5--32] that combines several randomized decision trees and aggregates their predictions by averaging. Despite its wide usage and outstanding practical…

Statistics Theory · Mathematics 2015-08-11 Erwan Scornet , Gérard Biau , Jean-Philippe Vert

Deep learning models are being adopted and applied on various critical decision-making tasks, yet they are trained to provide point predictions without providing degrees of confidence. The trustworthiness of deep learning models can be…

Machine Learning · Computer Science 2024-10-28 Daniel Nolte , Souparno Ghosh , Ranadip Pal

We seek decision rules for prediction-time cost reduction, where complete data is available for training, but during prediction-time, each feature can only be acquired for an additional cost. We propose a novel random forest algorithm to…

Machine Learning · Statistics 2015-02-23 Feng Nan , Joseph Wang , Venkatesh Saligrama

We propose a new optimization framework for aleatoric uncertainty estimation in regression problems. Existing methods can quantify the error in the target estimation, but they tend to underestimate it. To obtain the predictive uncertainty…

Computer Vision and Pattern Recognition · Computer Science 2021-03-12 Takumi Kawashima , Qing Yu , Akari Asai , Daiki Ikami , Kiyoharu Aizawa

We introduce random survival forests, a random forests method for the analysis of right-censored survival data. New survival splitting rules for growing survival trees are introduced, as is a new missing data algorithm for imputing missing…

Applications · Statistics 2008-11-12 Hemant Ishwaran , Udaya B. Kogalur , Eugene H. Blackstone , Michael S. Lauer

Outcomes of data-driven AI models cannot be assumed to be always correct. To estimate the uncertainty in these outcomes, the uncertainty wrapper framework has been proposed, which considers uncertainties related to model fit, input quality,…

Machine Learning · Computer Science 2022-01-11 Pascal Gerber , Lisa Jöckel , Michael Kläs

We develop an empirical likelihood (EL) framework for random forests and related ensemble methods, providing a likelihood-based approach to quantify their statistical uncertainty. Exploiting the incomplete $U$-statistic structure inherent…

Machine Learning · Statistics 2025-11-19 Harold D. Chiang , Yukitoshi Matsushita , Taisuke Otsu

Signal maps are essential for the planning and operation of cellular networks. However, the measurements needed to create such maps are expensive, often biased, not always reflecting the metrics of interest, and posing privacy risks. In…

Machine Learning · Computer Science 2022-02-15 Emmanouil Alimpertis , Athina Markopoulou , Carter T. Butts , Evita Bakopoulou , Konstantinos Psounis

Context: Software engineering has a problem in that when we empirically evaluate competing prediction systems we obtain conflicting results. Objective: To reduce the inconsistency amongst validation study results and provide a more formal…

Software Engineering · Computer Science 2021-01-15 Martin Shepperd , Stephen G. MacDonell

Ensemble forecasts of weather and climate are subject to systematic biases in the ensemble mean and variance, leading to inaccurate estimates of the forecast mean and variance. To address these biases, ensemble forecasts are post-processed…

Applications · Statistics 2016-05-25 Stefan Siegert , Philip G. Sansom , Robin Williams

Random forests is a common non-parametric regression technique which performs well for mixed-type data and irrelevant covariates, while being robust to monotonic variable transformations. Existing random forest implementations target…

Machine Learning · Statistics 2018-05-04 Taylor Pospisil , Ann B. Lee

Performative prediction characterizes environments where predictive models alter the very data distributions they aim to forecast, triggering complex feedback loops. While prior research treats single-agent and multi-agent performativity as…

Machine Learning · Statistics 2026-02-04 Zhixian Zhang , Xiaotian Hou , Linjun Zhang

Due to the dynamic nature of financial markets, maintaining models that produce precise predictions over time is difficult. Often the goal isn't just point prediction but determining uncertainty. Quantifying uncertainty, especially the…

Machine Learning · Statistics 2024-08-06 Mingshu Li , Bhaskarjit Sarmah , Dhruv Desai , Joshua Rosaler , Snigdha Bhagat , Philip Sommer , Dhagash Mehta