English
Related papers

Related papers: Random Forest Regression Feature Importance for Cl…

200 papers

SHapley Additive exPlanations (SHAP) is a key tool for interpreting decision tree ensembles by assigning contribution values to features. It is widely used in finance, advertising, medicine, and other domains. Two main approaches to SHAP…

Machine Learning · Computer Science 2026-04-14 Alexander Nadel , Ron Wettenstein

Classical methods for quantile regression fail in cases where the quantile of interest is extreme and only few or no training data points exceed it. Asymptotic results from extreme value theory can be used to extrapolate beyond the range of…

Methodology · Statistics 2024-01-23 Nicola Gnecco , Edossa Merga Terefe , Sebastian Engelke

The effectiveness of anomaly signal detection can be significantly undermined by the inherent uncertainty of relying on one specified model. Under the framework of model average methods, this paper proposes a novel criterion to select the…

Machine Learning · Statistics 2024-05-30 Gaoxiang Zhao , Lu Wang , Xiaoqiang Wang

Wildfires present intricate challenges for prediction, necessitating the use of sophisticated machine learning techniques for effective modeling\cite{jain2020review}. In our research, we conducted a thorough assessment of various machine…

Machine Learning · Computer Science 2024-04-03 Di Fan , Ayan Biswas , James Paul Ahrens

Traffic prediction is a spatiotemporal predictive task that plays an essential role in intelligent transportation systems. Today, graph convolutional neural networks (GCNNs) have become the prevailing models in the traffic prediction…

Machine Learning · Computer Science 2023-06-01 Ta Jiun Ting , Xiaocan Li , Scott Sanner , Baher Abdulhai

We introduce xplainfi, an R package built on top of the mlr3 ecosystem for global, loss-based feature importance methods for machine learning models. Various feature importance methods exist in R, but significant gaps remain, particularly…

Machine Learning · Computer Science 2026-03-17 Lukas Burk , Fiona Katharina Ewald , Giuseppe Casalicchio , Marvin N. Wright , Bernd Bischl

Additive feature explanations using Shapley values have become popular for providing transparency into the relative importance of each feature to an individual prediction of a machine learning model. While Shapley values provide a unique…

Machine Learning · Computer Science 2021-12-21 Thomas W. Campbell , Heinrich Roder , Robert W. Georgantas , Joanna Roder

Robot person following (RPF) is a core capability in human-robot interaction, enabling robots to assist users in daily activities, collaborative work, and other service scenarios. However, achieving practical RPF remains challenging due to…

Robotics · Computer Science 2025-10-14 Weixi Situ , Hanjing Ye , Jianwei Peng , Yu Zhan , Hong Zhang

We address the problem of finding influential training samples for a particular case of tree ensemble-based models, e.g., Random Forest (RF) or Gradient Boosted Decision Trees (GBDT). A natural way of formalizing this problem is studying…

Machine Learning · Computer Science 2018-03-14 Boris Sharchilev , Yury Ustinovsky , Pavel Serdyukov , Maarten de Rijke

In order to study transport in complex environments, it is extremely important to determine the physical mechanism underlying diffusion, and precisely characterize its nature and parameters. Often, this task is strongly impacted by data…

In Human Activity Recognition (HAR), understanding the intricacy of body movements within high-risk applications is essential. This study uses SHapley Additive exPlanations (SHAP) to explain the decision-making process of Graph Convolution…

Computer Vision and Pattern Recognition · Computer Science 2025-03-24 Felix Tempel , Espen Alexander F. Ihlen , Lars Adde , Inga Strümke

The ability to compare between individuals or organisations fairly is important for the development of robust and meaningful quantitative benchmarks. To make fair comparisons, contextual factors must be taken into account, and comparisons…

Applications · Statistics 2020-11-18 Daniel W. Kennedy , Jessica Cameron , Paul P. -Y. Wu , Kerrie Mengersen

Random forest (Leo Breiman 2001a) (RF) is a non-parametric statistical method requiring no distributional assumptions on covariate relation to the response. RF is a robust, nonlinear technique that optimizes predictive accuracy by fitting…

Computation · Statistics 2016-12-30 John Ehrlinger

An increasing array of biomedical and computer vision applications requires the predictive modeling of complex data, for example images and shapes. The main challenge when predicting such objects lies in the fact that they do not comply to…

Machine Learning · Statistics 2017-02-17 Dimosthenis Tsagkrasoulis , Giovanni Montana

Stock trend forecasting, a challenging problem in the financial domain, involves ex-tensive data and related indicators. Relying solely on empirical analysis often yields unsustainable and ineffective results. Machine learning researchers…

Statistical Finance · Quantitative Finance 2024-10-10 Saber Talazadeh , Dragan Perakovic

This paper presents a novel ensemble learning approach called Residual Likelihood Forests (RLF). Our weak learners produce conditional likelihoods that are sequentially optimized using global loss in the context of previous learners within…

Machine Learning · Statistics 2020-11-05 Yan Zuo , Tom Drummond

Machine learning algorithms are designed to capture complex relationships between features. In this context, the high dimensionality of data often results in poor model performance, with the risk of overfitting. Feature selection, the…

Machine Learning · Computer Science 2023-10-18 Paolo Bonetti , Alberto Maria Metelli , Marcello Restelli

Event attribution in the context of climate change seeks to understand the role of anthropogenic greenhouse gas emissions on extreme weather events, either specific events or classes of events. A common approach to event attribution uses…

Methodology · Statistics 2018-02-06 Christopher J. Paciorek , Dáithí A. Stone , Michael F. Wehner

Reliability-oriented sensitivity analysis aims at combining both reliability and sensitivity analyses by quantifying the influence of each input variable of a numerical model on a quantity of interest related to its failure. In particular,…

Statistics Theory · Mathematics 2022-10-25 Julien Demange-Chryst , François Bachoc , Jérôme Morio

Random forest is a popular prediction approach for handling high dimensional covariates. However, it often becomes infeasible to interpret the obtained high dimensional and non-parametric model. Aiming for obtaining an interpretable…

Methodology · Statistics 2020-05-12 Jasper Velthoen , Juan-Juan Cai , Geurt Jongbloed