English
Related papers

Related papers: Unity Forests: Improving Interaction Modelling and…

200 papers

The random forest algorithm (RF) has several hyperparameters that have to be set by the user, e.g., the number of observations drawn randomly for each tree and whether they are drawn with or without replacement, the number of variables…

Machine Learning · Statistics 2019-02-27 Philipp Probst , Marvin Wright , Anne-Laure Boulesteix

Cooperative path planning is gaining its importance due to the increasing demand on using multiple unmanned aerial vehicles (UAVs) for complex missions. This work addresses the problem by introducing a new algorithm named MultiRRT that…

Robotics · Computer Science 2025-04-17 Thu Hang Khuat , Duy-Nam Bui , Hoa TT. Nguyen , Mien L. Trinh , Minh T. Nguyen , Manh Duong Phung

Random forests is a common non-parametric regression technique which performs well for mixed-type data and irrelevant covariates, while being robust to monotonic variable transformations. Existing random forest implementations target…

Machine Learning · Statistics 2018-05-04 Taylor Pospisil , Ann B. Lee

This work develops formal statistical inference procedures for machine learning ensemble methods. Ensemble methods based on bootstrapping, such as bagging and random forests, have improved the predictive accuracy of individual trees, but…

Machine Learning · Statistics 2015-09-11 Lucas Mentch , Giles Hooker

As a flexible nonparametric learning tool, the random forests algorithm has been widely applied to various real applications with appealing empirical performance, even in the presence of high-dimensional feature space. Unveiling the…

Statistics Theory · Mathematics 2022-09-27 Chien-Ming Chi , Patrick Vossler , Yingying Fan , Jinchi Lv

Random Forests (RF) are at the cutting edge of supervised machine learning in terms of prediction performance, especially in genomics. Iterative Random Forests (iRF) use a tree ensemble from iteratively modified RF to obtain predictive and…

Statistics Theory · Mathematics 2022-07-06 Merle Behr , Yu Wang , Xiao Li , Bin Yu

Functional survival models are key tools for analyzing time-to-event data with complex predictors, such as functional or high-dimensional inputs. Despite their predictive strength, these models often lack interpretability, which limits…

Machine Learning · Statistics 2025-04-28 Giuseppe Loffredo , Elvira Romano , Fabrizio MAturo

This study investigates the application of unmanned aerial vehicles (UAVs) in public management, focusing on optimizing path planning to address challenges such as energy consumption, obstacle avoidance, and airspace constraints. As UAVs…

Robotics · Computer Science 2025-08-21 Zhanxi Xie , Baili Lu , Yanzhao Gu , Zikun Li , Junhao Wei , Ngai Cheong

This paper investigates unmanned aerial vehicle (UAV)-mounted intelligent reflecting surfaces (IRS) to leverage the benefits of this technology for future communication networks, such as 6G. Key advantages include enhanced spectral and…

Signal Processing · Electrical Eng. & Systems 2025-11-04 Mohammad Javad Zakavi , Mahtab Mirmohseni , Farid Ashtiani , Masoumeh Nasiri-Kenari

The broad adoption of Machine Learning (ML) in security-critical fields demands the explainability of the approach. However, the research on understanding ML models, such as Random Forest (RF), is still in its infant stage. In this work, we…

Machine Learning · Computer Science 2022-02-28 Shucen Ma , Jianqi Shi , Yanhong Huang , Shengchao Qin , Zhe Hou

In machine learning, uncertainty quantification helps assess the reliability of model predictions, which is important in high-stakes scenarios. Traditional approaches often emphasize predictive accuracy, but there is a growing focus on…

Machine Learning · Statistics 2025-09-30 Jake S. Rhodes , Scott D. Brown , J. Riley Wilkinson

Decision forests (Forests), in particular random forests and gradient boosting trees, have demonstrated state-of-the-art accuracy compared to other methods in many supervised learning scenarios. In particular, Forests dominate other methods…

Tree-based algorithms such as random forests and gradient boosted trees continue to be among the most popular and powerful machine learning models used across multiple disciplines. The conventional wisdom of estimating the impact of a…

Machine Learning · Statistics 2022-01-03 Markus Loecher , Qi Wu

Understanding and inferencing Heterogeneous Treatment Effects (HTE) and Conditional Average Treatment Effects (CATE) are vital for developing personalized treatment recommendations. Many state-of-the-art approaches achieve inspiring…

Machine Learning · Computer Science 2024-08-28 Chan Hsu , Jun-Ting Wu , Yihuang Kang

Random Forests (RFs) are widely used Machine Learning models in low-power embedded devices, due to their hardware friendly operation and high accuracy on practically relevant tasks. The accuracy of a RF often increases with the number of…

In this paper the Partition of Unity Method (PUM) is efficiently performed using Radial Basis Functions (RBFs) as local approximants. In particular, we present a new space-partitioning data structure extremely useful in applications because…

Numerical Analysis · Mathematics 2015-12-15 Alessandra De Rossi , Roberto Cavoretto , Emma Perracchione

The wealth of data being gathered about humans and their surroundings drives new machine learning applications in various fields. Consequently, more and more often, classifiers are trained using not only numerical data but also complex data…

Machine Learning · Computer Science 2022-04-13 Maciej Piernik , Dariusz Brzezinski , Pawel Zawadzki

Speculative decoding accelerates Large Language Models via draft-then-verify, where verification can be framed as an Optimal Transport (OT) problem. Existing approaches typically handle multi-draft and multi-step aspects in isolation,…

Computation and Language · Computer Science 2026-05-07 Yepeng Weng , Qiao Hu , Takehisa Yairi

We present Collaborative Trees, a novel tree model designed for regression prediction, along with its bagging version, which aims to analyze complex statistical associations between features and uncover potential patterns inherent in the…

Methodology · Statistics 2024-05-21 Chien-Ming Chi

The issue of estimating residual variance in regression models has experienced relatively little attention in the machine learning community. However, the estimate is of primary interest in many practical applications, e.g. as a primary…

Statistics Theory · Mathematics 2018-12-18 Burim Ramosaj , Markus Pauly