English
Related papers

Related papers: A Multi-Head Attention Soft Random Forest for Inte…

200 papers

When drawing causal inferences about the effects of multiple treatments on clustered survival outcomes using observational data, we need to address implications of the multilevel data structure, multiple treatments, censoring and unmeasured…

Methodology · Statistics 2022-02-18 Liangyuan Hu , Jiayi Ji , Ronald D. Ennis , Joseph W. Hogan

Transformer-based scientific foundation models are increasingly deployed in high-stakes settings, but current architectures give deterministic outputs and provide limited support for calibrated predictive uncertainty. We propose Stochastic…

Machine Learning · Computer Science 2026-05-12 Akash Yadav , Taiwo A. Adebiyi , Ruda Zhang

A key challenge in estimating causal effects from observational data is handling confounding and is commonly achieved through weighting methods that balance distribution of covariates between treatment and control groups. Weighting…

Methodology · Statistics 2025-12-23 Simion De , Jared D. Huling

Random forests are an ensemble method relevant for many problems, such as regression or classification. They are popular due to their good predictive performance (compared to, e.g., decision trees) requiring only minimal tuning of…

Methodology · Statistics 2022-10-20 Nikolaus Umlauf , Nadja Klein

Machine learning models are often criticized for their black-box nature, raising concerns about their applicability in critical decision-making scenarios. Consequently, there is a growing demand for interpretable models in such contexts. In…

Machine Learning · Computer Science 2024-08-28 I-Ling Cheng , Chan Hsu , Chantung Ku , Pei-Ju Lee , Yihuang Kang

Background: An early diagnosis together with an accurate disease progression monitoring of multiple sclerosis is an important component of successful disease management. Prior studies have established that multiple sclerosis is correlated…

Audio and Speech Processing · Electrical Eng. & Systems 2021-09-28 Emil Svoboda , Tomáš Bořil , Jan Rusz , Tereza Tykalová , Dana Horáková , Charles R. G. Guttman , Krastan B. Blagoev , Hiroto Hatabu , Vlad I. Valtchinov

Road accidents have significant economic and societal costs, with a small number of severe accidents accounting for a large portion of these costs. Predicting accident severity can help in the proactive approach to road safety by…

Machine Learning · Computer Science 2023-10-10 Adekunle Adefabi , Somtobe Olisah , Callistus Obunadike , Oluwatosin Oyetubo , Esther Taiwo , Edward Tella

The interpretability of deep learning is crucial for evaluating the reliability of medical imaging models and reducing the risks of inaccurate patient recommendations. This study addresses the "human out of the loop" and "trustworthiness"…

Computer Vision and Pattern Recognition · Computer Science 2024-07-01 Haozhe Luo , Aurélie Pahud de Mortanges , Oana Inel , Abraham Bernstein , Mauricio Reyes

Distributional Random Forest (DRF) is a flexible forest-based method to estimate the full conditional distribution of a multivariate output of interest given input variables. In this article, we introduce a variable importance algorithm for…

Machine Learning · Statistics 2024-02-15 Clément Bénard , Jeffrey Näf , Julie Josse

The random forest (RF) algorithm has become a very popular prediction method for its great flexibility and promising accuracy. In RF, it is conventional to put equal weights on all the base learners (trees) to aggregate their predictions.…

Machine Learning · Statistics 2023-05-18 Xinyu Chen , Dalei Yu , Xinyu Zhang

Patient no-shows disrupt outpatient clinic operations, reduce productivity, and may delay necessary care. Clinics often adopt overbooking or double-booking to mitigate these effects. However, poorly calibrated policies can increase…

Machine Learning · Computer Science 2026-03-10 Ninda Nurseha Amalina , Heungjo An

This paper presents an impact assessment for the imputation of missing data. The data set used is HIV Seroprevalence data from an antenatal clinic study survey performed in 2001. Data imputation is performed through five methods: Random…

Methodology · Statistics 2020-11-25 Adam Pantanowitz , Tshilidzi Marwala

Recent years have experienced increasing utilization of complex machine learning models across multiple sources of data to inform more generalizable decision-making. However, distribution shifts across data sources and privacy concerns…

Methodology · Statistics 2024-05-16 Yi Liu , Alexander W. Levis , Sharon-Lise Normand , Larry Han

Understanding and inferencing Heterogeneous Treatment Effects (HTE) and Conditional Average Treatment Effects (CATE) are vital for developing personalized treatment recommendations. Many state-of-the-art approaches achieve inspiring…

Machine Learning · Computer Science 2024-08-28 Chan Hsu , Jun-Ting Wu , Yihuang Kang

We propose a method for transfer learning in nonparametric regression using a random forest (RF) with distance covariance-based feature weights, assuming the unknown source and target regression functions are sparsely different. Our method…

Machine Learning · Statistics 2026-03-17 Chenze Li , Subhadeep Paul

This research presents an examination of categorizing the severity states of patients based on their electronic health records during a certain time range using multiple machine learning and deep learning approaches. The suggested method…

Machine Learning · Computer Science 2022-09-30 A. N. M. Sajedul Alam , Rimi Reza , Asir Abrar , Tanvir Ahmed , Salsabil Ahmed , Shihab Sharar , Annajiat Alim Rasel

It is often critical for prediction models to be robust to distributional shifts between training and testing data. From a causal perspective, the challenge is to distinguish the stable causal relationships from the unstable spurious…

Machine Learning · Computer Science 2021-01-15 Shuxi Zeng , Murat Ali Bayir , Joesph J. Pfeiffer , Denis Charles , Emre Kiciman

We propose an innovative statistical method, called Ordinal Mixed-Effect Random Forest (OMERF), that extends the use of random forest to the analysis of hierarchical data and ordinal responses. The model preserves the flexibility and…

Methodology · Statistics 2024-06-06 Giulia Bergonzoli , Lidia Rossi , Chiara Masci

Decision trees are widely used for classification and regression tasks in a variety of application fields due to their interpretability and good accuracy. During the past decade, growing attention has been devoted to globally optimized…

Machine Learning · Computer Science 2025-01-28 Antonio Consolo , Edoardo Amaldi , Andrea Manno

Random Forest (Breiman, 2001) is a successful and widely used regression and classification algorithm. Part of its appeal and reason for its versatility is its (implicit) construction of a kernel-type weighting function on training data,…

Machine Learning · Statistics 2022-10-13 Domagoj Ćevid , Loris Michel , Jeffrey Näf , Nicolai Meinshausen , Peter Bühlmann