中文
相关论文

相关论文: Provable Boolean Interaction Recovery from Tree En…

200 篇论文

Random Forest (Breiman, 2001) is a successful and widely used regression and classification algorithm. Part of its appeal and reason for its versatility is its (implicit) construction of a kernel-type weighting function on training data,…

机器学习 · 统计学 2022-10-13 Domagoj Ćevid , Loris Michel , Jeffrey Näf , Nicolai Meinshausen , Peter Bühlmann

We initiate a novel approach to explain the predictions and out of sample performance of random forest (RF) regression and classification models by exploiting the fact that any RF can be mathematically formulated as an adaptive weighted K…

Several classification methods assume that the underlying distributions follow tree-structured graphical models. Indeed, trees capture statistical dependencies between pairs of variables, which may be crucial to attain low classification…

机器学习 · 统计学 2021-05-31 Yaniv Tenzer , Amit Moscovich , Mary Frances Dorn , Boaz Nadler , Clifford Spiegelman

Random forests is a state-of-the-art supervised machine learning method which behaves well in high-dimensional settings although some limitations may happen when $p$, the number of predictors, is much larger than the number of observations…

统计方法学 · 统计学 2019-02-01 Louis Capitaine , Robin Genuer , Rodolphe Thiébaut

Image understanding is an important research domain in the computer vision due to its wide real-world applications. For an image understanding framework that uses the Bag-of-Words model representation, the visual codebook is an essential…

计算机视觉与模式识别 · 计算机科学 2014-10-15 Wai Lam Hoo , Tae-Kyun Kim , Yuru Pei , Chee Seng Chan

We study the problem of learning a latent tree graphical model where samples are available only from a subset of variables. We propose two consistent and computationally efficient algorithms for learning minimal latent trees, that is, trees…

机器学习 · 统计学 2010-09-15 Myung Jin Choi , Vincent Y. F. Tan , Animashree Anandkumar , Alan S. Willsky

This paper proposes FREEtree, a tree-based method for high dimensional longitudinal data with correlated features. Popular machine learning approaches, like Random Forests, commonly used for variable selection do not perform well when there…

We propose the interval censored recursive forests (ICRF) which is an iterative tree ensemble method for interval censored survival data. This nonparametric regression estimator makes the best use of censored information by iteratively…

统计方法学 · 统计学 2021-05-21 Hunyong Cho , Nicholas P. Jewell , Michael R. Kosorok

Random forest is a popular prediction approach for handling high dimensional covariates. However, it often becomes infeasible to interpret the obtained high dimensional and non-parametric model. Aiming for obtaining an interpretable…

统计方法学 · 统计学 2020-05-12 Jasper Velthoen , Juan-Juan Cai , Geurt Jongbloed

Tree-based ensemble methods such as random forests, gradient-boosted trees, and Bayesianadditive regression trees have been successfully used for regression problems in many applicationsand research studies. In this paper, we study ensemble…

机器学习 · 统计学 2024-06-21 Alexandre Seiller , Éric Gaussier , Emilie Devijver , Marianne Clausel , Sami Alkhoury

Age estimation from facial images is typically cast as a label distribution learning or regression problem, since aging is a gradual progress. Its main challenge is the facial feature space w.r.t. ages is inhomogeneous, due to the large…

计算机视觉与模式识别 · 计算机科学 2019-08-26 Wei Shen , Yilu Guo , Yan Wang , Kai Zhao , Bo Wang , Alan Yuille

Shapley and Banzhaf interactions capture the complex dynamics inherent in modern machine learning applications. However, current estimators for these higher-order interactions trade off between speed and accuracy. To overcome this…

We propose a computationally efficient alternative to generalized random forests (GRFs) for estimating heterogeneous effects in large dimensions. While GRFs rely on a gradient-based splitting criterion, which in large dimensions is…

机器学习 · 统计学 2025-06-18 David Fleischer , David A. Stephens , Archer Y. Yang

Random forests is a common non-parametric regression technique which performs well for mixed-type unordered data and irrelevant features, while being robust to monotonic variable transformations. Standard random forests, however, do not…

统计计算 · 统计学 2019-06-19 Taylor Pospisil , Ann B. Lee

For various applications, the relations between the dependent and independent variables are highly nonlinear. Consequently, for large scale complex problems, neural networks and regression trees are commonly preferred over linear models…

机器学习 · 计算机科学 2017-05-23 Samet Oymak , Mehrdad Mahdavi , Jiasi Chen

Precision oncology aims to prescribe the optimal cancer treatment to the right patients, maximizing therapeutic benefits. However, identifying patient subgroups that may benefit more from experimental cancer treatments based on randomized…

统计方法学 · 统计学 2026-01-06 Xingyu Li , Qing Liu , Tony Jiang , Hong Amy Xia , Peng Wei , Brian P. Hobbs

The Random Forest (RF) algorithm can be applied to a broad spectrum of problems, including time series prediction. However, neither the classical IID (Independent and Identically distributed) bootstrap nor block bootstrapping strategies (as…

机器学习 · 统计学 2024-10-03 Cabrel Teguemne Fokam , Carsten Jentsch , Michel Lang , Markus Pauly

Recent random-forest (RF)-based image super-resolution approaches inherit some properties from dictionary-learning-based algorithms, but the effectiveness of the properties in RF is overlooked in the literature. In this paper, we present a…

计算机视觉与模式识别 · 计算机科学 2017-12-15 Hailiang Li , Kin-Man Lam , Miaohui Wang

We present Collaborative Trees, a novel tree model designed for regression prediction, along with its bagging version, which aims to analyze complex statistical associations between features and uncover potential patterns inherent in the…

统计方法学 · 统计学 2024-05-21 Chien-Ming Chi

Machine learning (ML) algorithms become increasingly important in the analysis of astronomical data. However, since most ML algorithms are not designed to take data uncertainties into account, ML based studies are mostly restricted to data…

天体物理仪器与方法 · 物理学 2018-12-26 Itamar Reis , Dalya Baron , Sahar Shahaf