English
Related papers

Related papers: MDA for random forests: inconsistency, and a pract…

200 papers

Value-at-risk (VaR), also known as quantile, is a crucial risk measure in finance and other fields. However, optimizing VaR metrics in Markov decision processes (MDPs) is challenging because VaR is non-additive and the traditional dynamic…

Optimization and Control · Mathematics 2025-07-31 Li Xia , Jinyan Pan

Deep learning models excel in computer vision tasks but often fail to generalize to out-of-distribution (OOD) domains. Invariant Risk Minimization (IRM) aims to address OOD generalization by learning domain-invariant features. However, IRM…

Computer Vision and Pattern Recognition · Computer Science 2025-01-24 Yaoyao Zhu , Xiuding Cai , Yingkai Wang , Dong Miao , Zhongliang Fu , Xu Luo

The Difference-in-Differences (DiD) method is a fundamental tool for causal inference, yet its application is often complicated by missing data. Although recent work has developed robust DiD estimators for complex settings like staggered…

Methodology · Statistics 2026-01-27 Lorenzo Testa , Edward H. Kennedy , Matthew Reimherr

Sobol' sensitivity indices allow to quantify the respective effects of random input variables and their combinations on the variance of mathematical model output. We focus on the problem of Sobol' indices estimation via a metamodeling…

Statistics Theory · Mathematics 2021-01-07 Ivan I. Panin

Multi-criteria decision analysis (MCDA) is a quantitative approach to the drug benefit-risk assessment (BRA) which allows for consistent comparisons by summarising all benefits and risks in a single score. The MCDA consists of several…

Methodology · Statistics 2021-07-27 Tom Menzies , Gaelle Saint-Hilary , Pavel Mozgunov

Domain shift remains a key challenge in deploying machine learning models to the real world. Unsupervised domain adaptation (UDA) aims to address this by minimising domain discrepancy during training, but the discrepancy estimates suffer…

Machine Learning · Computer Science 2026-05-07 Andrea Napoli , Paul White

Prediction in high dimensional settings is difficult due to large by number of variables relative to the sample size. We demonstrate how auxiliary "co-data" can be used to improve the performance of a Random Forest in such a setting.…

Applications · Statistics 2017-06-05 Dennis E. te Beest , Steven W. Mes , Ruud H. Brakenhoff , Mark A. van de Wiel

Importance sampling has become an important tool for the computation of tail-based risk measures. Since such quantities are often determined mainly by rare events standard Monte Carlo can be inefficient and importance sampling provides a…

Probability · Mathematics 2013-06-29 Pierre Nyquist

We introduce principal differences analysis (PDA) for analyzing differences between high-dimensional distributions. The method operates by finding the projection that maximizes the Wasserstein divergence between the resulting univariate…

Machine Learning · Statistics 2017-05-03 Jonas Mueller , Tommi Jaakkola

The Minimum Covariance Determinant (MCD) approach robustly estimates the location and scatter matrix using the subset of given size with lowest sample covariance determinant. Its main drawback is that it cannot be applied when the dimension…

Methodology · Statistics 2021-01-13 Kris Boudt , Peter J. Rousseeuw , Steven Vanduffel , Tim Verdonck

Manifold-valued functional data analysis (FDA) recently becomes an active area of research motivated by the raising availability of trajectories or longitudinal data observed on non-linear manifolds. The challenges of analyzing such data…

Machine Learning · Statistics 2022-05-27 Zhengwu Zhang , Bayan Saparbayeva

The monotone data augmentation (MDA) algorithm has been widely used to impute missing data for longitudinal continuous outcomes. Compared to a full data augmentation approach, the MDA scheme accelerates the mixing of the Markov chain,…

Methodology · Statistics 2025-12-23 Yongqiang Tang

The broad adoption of Machine Learning (ML) in security-critical fields demands the explainability of the approach. However, the research on understanding ML models, such as Random Forest (RF), is still in its infant stage. In this work, we…

Machine Learning · Computer Science 2022-02-28 Shucen Ma , Jianqi Shi , Yanhong Huang , Shengchao Qin , Zhe Hou

Active Domain Adaptation (ADA) aims to maximally boost model adaptation in a new target domain by actively selecting a limited number of target data to annotate.This setting neglects the more practical scenario where training data are…

Artificial Intelligence · Computer Science 2023-11-23 Wenqiao Zhang , Zheqi Lv , Hao Zhou , Jia-Wei Liu , Juncheng Li , Mengze Li , Siliang Tang , Yueting Zhuang

Transfer learning aims to learn robust classifiers for the target domain by leveraging knowledge from a source domain. Since the source and the target domains are usually from different distributions, existing methods mainly focus on…

Machine Learning · Computer Science 2019-09-19 Jindong Wang , Yiqiang Chen , Wenjie Feng , Han Yu , Meiyu Huang , Qiang Yang

Existing domain adaptation methods aim to reduce the distributional difference between the source and target domains and respect their specific discriminative information, by establishing the Maximum Mean Discrepancy (MMD) and the…

Machine Learning · Computer Science 2020-07-03 Wei Wang , Haojie Li , Zhengming Ding , Zhihui Wang

We propose a novel statistical method for testing the results of anomaly detection (AD) under domain adaptation (DA), which we call CAD-DA -- controllable AD under DA. The distinct advantage of the CAD-DA lies in its ability to control the…

Machine Learning · Statistics 2023-10-24 Vo Nguyen Le Duy , Hsuan-Tien Lin , Ichiro Takeuchi

The random forest algorithm (RF) has several hyperparameters that have to be set by the user, e.g., the number of observations drawn randomly for each tree and whether they are drawn with or without replacement, the number of variables…

Machine Learning · Statistics 2019-02-27 Philipp Probst , Marvin Wright , Anne-Laure Boulesteix

Global sensitivity analysis (GSA) is used to quantify the influence of uncertain variables in a mathematical model. Prior to performing GSA, the user must specify (or implicitly assume), a probability distribution to model the uncertainty,…

Statistics Theory · Mathematics 2018-11-22 Joseph Hart , Pierre Gremaud

Random forests (RFs) are well suited for prediction modeling and variable selection in high-dimensional omics studies. The effect of hyperparameters of the RF algorithm on prediction performance and variable importance estimation have…

Machine Learning · Statistics 2025-01-28 Cesaire J. K. Fouodo , Lea L. Kronziel , Inke R. König , Silke Szymczak