English
Related papers

Related papers: A Debiased MDI Feature Importance Measure for Rand…

200 papers

Feature importance (FI) measures are widely used to assess the contributions of predictors to an outcome, but they may target different notions of relevance. When predictors are correlated, traditional statistical FI methods are often…

Machine Learning · Statistics 2026-03-17 Jin-Hong Du , Kathryn Roeder , Larry Wasserman

Feature importance (FI) statistics provide a prominent and valuable method of insight into the decision process of machine learning (ML) models, but their effectiveness has well-known limitations when correlation is present among the…

Machine Learning · Statistics 2025-08-11 Benedikt Fröhlich , Alison Durst , Merle Behr

Ratings of a user to most items in recommender systems are usually missing not at random (MNAR), largely because users are free to choose which items to rate. To achieve unbiased learning of the prediction model under MNAR data, three…

Information Retrieval · Computer Science 2024-06-26 Haoxuan Li , Chunyuan Zheng , Wenjie Wang , Hao Wang , Fuli Feng , Xiao-Hua Zhou

Random forest is a classification algorithm well suited for microarray data: it shows excellent performance even when most predictive variables are noise, can be used when the number of variables is much larger than the number of…

Quantitative Methods · Quantitative Biology 2007-05-23 Ramon Diaz-Uriarte , Sara Alvarez de Andres

Subset selection algorithms are ubiquitous in AI-driven applications, including, online recruiting portals and image search engines, so it is imperative that these tools are not discriminatory on the basis of protected attributes such as…

Computers and Society · Computer Science 2021-02-23 Anay Mehrotra , L. Elisa Celis

This paper introduces and develops a novel variable importance score function in the context of ensemble learning and demonstrates its appeal both theoretically and empirically. Our proposed score function is simple and more straightforward…

Machine Learning · Statistics 2015-01-27 Ernest Fokoué

Random forests are among the most popular classification and regression methods used in industrial applications. To be effective, the parameters of random forests must be carefully tuned. This is usually done by choosing values that…

Machine Learning · Statistics 2018-07-03 C. H. Bryan Liu , Benjamin Paul Chamberlain , Duncan A. Little , Angelo Cardoso

Robust density estimation refers to the consistent estimation of the density function even when the data is contaminated by outliers. We find that existing forest density estimation at a certain point is inherently resistant to the outliers…

Machine Learning · Statistics 2025-01-28 Hongwei Wen , Annika Betken , Tao Huang

We seek decision rules for prediction-time cost reduction, where complete data is available for training, but during prediction-time, each feature can only be acquired for an additional cost. We propose a novel random forest algorithm to…

Machine Learning · Statistics 2015-02-23 Feng Nan , Joseph Wang , Venkatesh Saligrama

The broad adoption of Machine Learning (ML) in security-critical fields demands the explainability of the approach. However, the research on understanding ML models, such as Random Forest (RF), is still in its infant stage. In this work, we…

Machine Learning · Computer Science 2022-02-28 Shucen Ma , Jianqi Shi , Yanhong Huang , Shengchao Qin , Zhe Hou

Random Forest (RF) is a widely used ensemble learning technique known for its robust classification performance across diverse domains. However, it often relies on hundreds of trees and all input features, leading to high inference cost and…

Machine Learning · Computer Science 2025-07-08 Sijan Bhattarai , Saurav Bhandari , Girija Bhusal , Saroj Shakya , Tapendra Pandey

Random Forest has become one of the most popular tools for feature selection. Its ability to deal with high-dimensional data makes this algorithm especially useful for studies in neuroimaging and bioinformatics. Despite its popularity and…

Machine Learning · Computer Science 2014-10-13 Ender Konukoglu , Melanie Ganz

In this paper, we consider a perturbation-based metric of predictive faithfulness of feature rankings (or attributions) that we call PGI squared. When applied to decision tree-based regression models, the metric can be computed accurately…

Machine Learning · Computer Science 2025-02-26 Mateusz Gajewski , Adam Karczmarz , Mateusz Rapicki , Piotr Sankowski

This paper introduces a novel framework for enhancing Random Forest classifiers by integrating probabilistic feature sampling and hyperparameter tuning via Simulated Annealing. The proposed framework exhibits substantial advancements in…

Machine Learning · Computer Science 2025-11-12 Kowshik Balasubramanian , Andre Williams , Ismail Butun

Machine learning (ML) algorithms become increasingly important in the analysis of astronomical data. However, since most ML algorithms are not designed to take data uncertainties into account, ML based studies are mostly restricted to data…

Instrumentation and Methods for Astrophysics · Physics 2018-12-26 Itamar Reis , Dalya Baron , Sahar Shahaf

Feature subsampling is a core component of random forests and other ensemble methods. While recent theory suggests that this randomization acts solely as a variance reduction mechanism analogous to ridge regularization, these results…

Machine Learning · Statistics 2026-01-06 Xin Chen , Jason M. Klusowski , Yan Shuo Tan , Chang Yu

Random forests are a statistical learning technique that use bootstrap aggregation to average high-variance and low-bias trees. Improvements to random forests, such as applying Lasso regression to the tree predictions, have been proposed in…

Machine Learning · Statistics 2025-11-13 Jing Shang , James Bannon , Benjamin Haibe-Kains , Robert Tibshirani

Random Forest (RF) is an ensemble classification technique that was developed by Breiman over a decade ago. Compared with other ensemble techniques, it has proved its accuracy and superiority. Many researchers, however, believe that there…

Machine Learning · Computer Science 2015-03-19 Khaled Fawagreh , Mohamad Medhat Gaber , Eyad Elyan

Random forests are a very effective and commonly used statistical method, but their full theoretical analysis is still an open problem. As a first step, simplified models such as purely random forests have been introduced, in order to shed…

Statistics Theory · Mathematics 2014-07-16 Sylvain Arlot , Robin Genuer

We study the often overlooked phenomenon, first noted in \cite{breiman2001random}, that random forests appear to reduce bias compared to bagging. Motivated by an interesting paper by \cite{mentch2020randomization}, where the authors explain…

Machine Learning · Statistics 2025-07-23 Brian Liu , Rahul Mazumder