English
Related papers

Related papers: A Multi-Head Attention Soft Random Forest for Inte…

200 papers

The Distributional Random Forest (DRF) is a recently introduced Random Forest algorithm to estimate multivariate conditional distributions. Due to its general estimation procedure, it can be employed to estimate a wide range of targets such…

Statistics Theory · Mathematics 2023-12-20 Jeffrey Näf , Corinne Emmenegger , Peter Bühlmann , Nicolai Meinshausen

Machine learning (ML) algorithms become increasingly important in the analysis of astronomical data. However, since most ML algorithms are not designed to take data uncertainties into account, ML based studies are mostly restricted to data…

Instrumentation and Methods for Astrophysics · Physics 2018-12-26 Itamar Reis , Dalya Baron , Sahar Shahaf

The decision tree ensembles use a single data feature at each node for splitting the data. However, splitting in this manner may fail to capture the geometric properties of the data. Thus, oblique decision trees generate the oblique…

Machine Learning · Computer Science 2023-04-17 M. A. Ganaie , M. Tanveer , I. Beheshti , N. Ahmad , P. N. Suganthan

Long-running clinical trials offer a unique opportunity to study disease progression and treatment response over time, enabling questions about how and when interventions alter patient trajectories. However, drawing causal conclusions in…

Applications · Statistics 2025-08-13 Emma Prevot , Dieter A. Häring , Thomas E. Nichols , Chris C. Holmes , Habib Ganjgahi

New models of random forests jointly using the attention and self-attention mechanisms are proposed for solving the regression problem. The models can be regarded as extensions of the attention-based random forest whose idea stems from…

Machine Learning · Computer Science 2022-07-12 Lev V. Utkin , Andrei V. Konstantinov

We introduce a novel interpretable tree based algorithm for prediction in a regression setting. Our motivation is to estimate the unknown regression function from a functional decomposition perspective in which the functional components…

Machine Learning · Statistics 2023-08-04 Munir Hiabu , Enno Mammen , Joseph T. Meyer

Methods for estimating heterogeneous treatment effect in observational data have largely focused on continuous or binary outcomes, and have been relatively less vetted with survival outcomes. Using flexible machine learning methods in the…

Applications · Statistics 2021-07-09 Liangyuan Hu , Jiayi Ji , Fan Li

An algorithm to improve performance parameter for unsupervised decision forest clustering and density estimation is presented. Specifically, a dual assignment parameter is introduced as a density estimator by combining Random Forest and…

Computer Vision and Pattern Recognition · Computer Science 2015-07-19 Hayder Albehadili , Naz Islam

Heart disease morbidity and mortality rates are increasing, which has a negative impact on public health and the global economy. Early detection of heart disease reduces the incidence of heart mortality and morbidity. Recent research has…

Quantum Physics · Physics 2024-04-30 Hanif Heidari , Gerhard Hellstern , Murugappan Murugappan

It is not clear how to target patients who are most likely to benefit from digital care management programs ex-ante, a shortcoming of current risk score based approaches. This study focuses on defining impactability by identifying those…

Quantitative Methods · Quantitative Biology 2019-05-16 Heather Mattie , Patrick Reidy , Patrik Bachtiger , Emily Lindemer , Mohammad Jouni , Trishan Panch

This paper proposes the automatic Doubly Robust Random Forest (DRRF) algorithm for estimating the conditional expectation of a moment functional in the presence of high-dimensional nuisance functions. DRRF extends the automatic debiasing…

Methodology · Statistics 2025-06-10 Zhaomeng Chen , Junting Duan , Victor Chernozhukov , Vasilis Syrgkanis

A major challenge in embedding or visualizing clinical patient data is the heterogeneity of variable types including continuous lab values, categorical diagnostic codes, as well as missing or incomplete data. In particular, in EHR data,…

Conventionally, random forests are built from "greedy" decision trees which each consider only one split at a time during their construction. The sub-optimality of greedy implementation has been well-known, yet mainstream adoption of more…

Machine Learning · Computer Science 2021-04-01 Delilah Donick , Sandro Claudio Lera

This study addresses a critical gap in the healthcare system by developing a clinically meaningful, practical, and explainable disease surveillance system for multiple chronic diseases, utilizing routine EHR data from multiple U.S.…

Machine Learning · Computer Science 2025-01-28 Shaheer Ahmad Khan , Muhammad Usamah Shahid , Ahmad Abdullah , Ibrahim Hashmat , Muddassar Farooq

Interpretable machine learning has emerged as central in leveraging artificial intelligence within high-stakes domains such as healthcare, where understanding the rationale behind model predictions is as critical as achieving high…

Machine Learning · Computer Science 2024-04-30 Christel Sirocchi , Martin Urschler , Bastian Pfeifer

Random forest (RF) missing data algorithms are an attractive approach for dealing with missing data. They have the desirable properties of being able to handle mixed types of missing data, they are adaptive to interactions and nonlinearity,…

Machine Learning · Statistics 2017-01-23 Fei Tang , Hemant Ishwaran

Estimation of heterogeneous treatment effects (HTE) is of prime importance in many disciplines, ranging from personalized medicine to economics among many others. Random forests have been shown to be a flexible and powerful approach to HTE…

Methodology · Statistics 2025-10-07 Susanne Dandl , Torsten Hothorn , Heidi Seibold , Erik Sverdrup , Stefan Wager , Achim Zeileis

We consider the estimation of average treatment effects in observational studies and propose a new framework of robust causal inference with unobserved confounders. Our approach is based on distributionally robust optimization and proceeds…

Methodology · Statistics 2023-02-06 Dimitris Bertsimas , Kosuke Imai , Michael Lingzhi Li

This study presents a machine learning-based framework for heart disease prediction using the heart-disease dataset, comprising 303 samples with 14 features. The methodology involves data preprocessing, model training, and evaluation using…

Machine Learning · Computer Science 2025-05-16 Ali Azimi Lamir , Shiva Razzagzadeh , Zeynab Rezaei

Healthcare decision-making requires not only accurate predictions but also insights into how factors influence patient outcomes. While traditional Machine Learning (ML) models excel at predicting outcomes, such as identifying high risk…

Machine Learning · Computer Science 2025-01-28 Sheresh Zahoor , Pietro Liò , Gaël Dias , Mohammed Hasanuzzaman