中文
相关论文

相关论文: Optimizing Prediction Intervals by Tuning Random F…

200 篇论文

Random Forests have been one of the most popular bagging methods in the past few decades, especially due to their success at handling tabular datasets. They have been extensively studied and compared to boosting models, like XGBoost, which…

机器学习 · 计算机科学 2024-10-28 Dimitris Bertsimas , Vasiliki Stoumpou

This paper introduces a boosted conformal procedure designed to tailor conformalized prediction intervals toward specific desired properties, such as enhanced conditional coverage or reduced interval length. We employ machine learning…

统计方法学 · 统计学 2024-11-12 Ran Xie , Rina Foygel Barber , Emmanuel J. Candès

Random Forest is a machine learning method that offers many advantages, including the ability to easily measure variable importance. Class balancing technique is a well-known solution to deal with class imbalance problem. However, it has…

机器学习 · 统计学 2023-12-19 Yunbi Nam , Sunwoo Han

Random forests are powerful non-parametric regression method but are severely limited in their usage in the presence of randomly censored observations, and naively applied can exhibit poor predictive performance due to the incurred biases.…

机器学习 · 统计学 2019-02-12 Alexander Hanbo Li , Jelena Bradic

Data analysis and machine learning have become an integrative part of the modern scientific methodology, providing automated techniques to predict further information based on observations. One of these classification and regression…

计算机视觉与模式识别 · 计算机科学 2019-01-07 Mario Amrehn , Firas Mualla , Elli Angelopoulou , Stefan Steidl , Andreas Maier

In the context of personalized medicine, machine learning algorithms are growing in popularity. These algorithms require substantial information, which can be acquired effectively through the usage of previously gathered data. Open data and…

机器学习 · 计算机科学 2026-01-13 Niklas Jacobs , Manuel C. Voelkle , Norbert Kathmann , Kevin Hilbert

We demonstrate that adaptively controlling the size of individual regression trees in a random forest can improve predictive performance, contrary to the conventional wisdom that trees should be fully grown. A fast pruning algorithm,…

机器学习 · 统计学 2024-08-15 Nikola Surjanovic , Andrew Henrey , Thomas M. Loughin

The induction of additional randomness in parallel and sequential ensemble methods has proven to be worthwhile in many aspects. In this manuscript, we propose and examine a novel random tree depth injection approach suitable for sequential…

This study presents a machine learning framework for forecasting short-term faults in industrial centrifugal pumps using real-time sensor data. The approach aims to predict {EarlyWarning} conditions 5, 15, and 30 minutes in advance based on…

Randomized artificial neural networks such as extreme learning machines provide an attractive and efficient method for supervised learning under limited computing ressources and green machine learning. This especially applies when equipping…

机器学习 · 统计学 2022-01-02 Ansgar Steland , Bart E. Pieters

We seek decision rules for prediction-time cost reduction, where complete data is available for training, but during prediction-time, each feature can only be acquired for an additional cost. We propose a novel random forest algorithm to…

机器学习 · 统计学 2015-02-23 Feng Nan , Joseph Wang , Venkatesh Saligrama

We introduce a new survival tree method for censored failure time data that incorporates three key advancements over traditional approaches. First, we develop a more computationally efficient splitting procedure that effectively mitigates…

统计方法学 · 统计学 2025-09-24 Ruiwen Zhou , Ke Xie , Lei Liu , Zhichen Xu , Jimin Ding , Xiaogang Su

The aim of this paper is to propose a suitable method for constructing prediction intervals for the output of neural network models. To do this, we adapt the extremely randomized trees method originally developed for random forests to…

机器学习 · 统计学 2021-05-14 Tullio Mancini , Hector Calvo-Pardo , Jose Olmo

Gene selection is an important part of microarray data analysis because it provides information that can lead to a better mechanistic understanding of an investigated phenomenon. At the same time, gene selection is very difficult because of…

机器学习 · 计算机科学 2013-10-21 Miron B. Kursa

Despite their remarkable effectiveness and broad application, the drivers of success underlying ensembles of trees are still not fully understood. In this paper, we highlight how interpreting tree ensembles as adaptive and self-regularizing…

机器学习 · 统计学 2024-02-05 Alicia Curth , Alan Jeffares , Mihaela van der Schaar

Predictive models make mistakes. Hence, there is a need to quantify the uncertainty associated with their predictions. Conformal inference has emerged as a powerful tool to create statistically valid prediction regions around point…

机器学习 · 统计学 2024-02-14 Luben M. C. Cabezas , Mateus P. Otto , Rafael Izbicki , Rafael B. Stern

Machine learning applications often require calibrated predictions, e.g. a 90\% credible interval should contain the true outcome 90\% of the times. However, typical definitions of calibration only require this to hold on average, and offer…

机器学习 · 统计学 2020-09-10 Shengjia Zhao , Tengyu Ma , Stefano Ermon

We study the generation of prediction intervals in regression for uncertainty quantification. This task can be formalized as an empirical constrained optimization problem that minimizes the average interval width while maintaining the…

机器学习 · 统计学 2021-03-01 Haoxian Chen , Ziyi Huang , Henry Lam , Huajie Qian , Haofeng Zhang

Random forests are powerful non-parametric regression method but are severely limited in their usage in the presence of randomly censored observations, and naively applied can exhibit poor predictive performance due to the incurred biases.…

机器学习 · 统计学 2020-01-13 Alexander Hanbo Li , Jelena Bradic

Tree-based ensemble methods, as Random Forests and Gradient Boosted Trees, have been successfully used for regression in many applications and research studies. Furthermore, these methods have been extended in order to deal with uncertainty…

机器学习 · 计算机科学 2018-11-20 Myriam Tami , Marianne Clausel , Emilie Devijver , Adrien Dulac , Eric Gaussier , Stefan Janaqi , Meriam Chebre