English
Related papers

Related papers: On the adaptation of causal forests to manifold da…

200 papers

Estimating treatment effects from observational data is challenging due to two main reasons: (a) hidden confounding, and (b) covariate mismatch (control and treatment groups not having identical distributions). Long lines of works exist…

Machine Learning · Computer Science 2025-04-30 Praharsh Nanavati , Ranjitha Prasad , Karthikeyan Shanmugam

We extend the definition of the marginal causal effect to the continuous treatment setting and develop a novel characterization of causal bias in the framework of structural causal models. We prove that our derived bias expression is zero…

Methodology · Statistics 2022-02-01 Gianluca Detommaso , Michael Brückner , Philip Schulz , Victor Chernozhukov

Causal inference explores the causation between actions and the consequent rewards on a covariate set. Recently deep learning has achieved a remarkable performance in causal inference, but existing statistical theories cannot well explain…

Machine Learning · Computer Science 2020-11-04 Minshuo Chen , Hao Liu , Wenjing Liao , Tuo Zhao

Purpose: Prior research has established perceived pressure and life satisfaction as important correlates of depression, yet their causal interplay remains insufficiently identified. This study aims to disentangle whether satisfaction acts…

Applications · Statistics 2026-01-13 Zhaojin Nan

Healthcare decision-making requires not only accurate predictions but also insights into how factors influence patient outcomes. While traditional Machine Learning (ML) models excel at predicting outcomes, such as identifying high risk…

Machine Learning · Computer Science 2025-01-28 Sheresh Zahoor , Pietro Liò , Gaël Dias , Mohammed Hasanuzzaman

Ensembles of randomized decision trees, usually referred to as random forests, are widely used for classification and regression tasks in machine learning and statistics. Random forests achieve competitive predictive performance and are…

Machine Learning · Statistics 2015-02-17 Balaji Lakshminarayanan , Daniel M. Roy , Yee Whye Teh

Assume we are given a set of items from a general metric space, but we neither have access to the representation of the data nor to the distances between data points. Instead, suppose that we can actively choose a triplet of items (A,B,C)…

Machine Learning · Statistics 2018-06-19 Siavash Haghiri , Damien Garreau , Ulrike von Luxburg

This work studies the statistical implications of using features comprised of general linear combinations of covariates to partition the data in randomized decision tree and forest regression algorithms. Using random tessellation theory in…

Statistics Theory · Mathematics 2025-11-05 Eliza O'Reilly

Random forests are a statistical learning technique that use bootstrap aggregation to average high-variance and low-bias trees. Improvements to random forests, such as applying Lasso regression to the tree predictions, have been proposed in…

Machine Learning · Statistics 2025-11-13 Jing Shang , James Bannon , Benjamin Haibe-Kains , Robert Tibshirani

Random forests have become an established tool for classification and regression, in particular in high-dimensional settings and in the presence of complex predictor-response relationships. For bounded outcome variables restricted to the…

Methodology · Statistics 2019-01-21 Leonie Weinhold , Matthias Schmid , Marvin N. Wright , Moritz Berger

Random forests are a scheme proposed by Leo Breiman in the 2000's for building a predictor ensemble with a set of decision trees that grow in randomly selected subspaces of data. Despite growing interest and practical use, there has been…

Machine Learning · Statistics 2012-03-28 Gérard Biau

Causal representation learning (CRL) aims at recovering latent causal variables from high-dimensional observations to solve causal downstream tasks, such as predicting the effect of new interventions or more robust classification. A…

Machine Learning · Computer Science 2025-03-06 Dingling Yao , Dario Rancati , Riccardo Cadei , Marco Fumero , Francesco Locatello

In recent years, dynamically growing data and incrementally growing number of classes pose new challenges to large-scale data classification research. Most traditional methods struggle to balance the precision and computational burden when…

Machine Learning · Computer Science 2016-11-01 Tingting Xie , Yuxing Peng , Changjian Wang

Connected acyclic graphs (trees) are data objects that hierarchically organize categories. Collections of trees arise in a diverse variety of fields, including evolutionary biology, public health, machine learning, social sciences and…

Methodology · Statistics 2025-12-01 Maria Alejandra Valdez Cabrera , Amy D Willis , Armeen Taeb

Real-world observational datasets and machine learning have revolutionized data-driven decision-making, yet many models rely on empirical associations that may be misleading due to confounding and subgroup heterogeneity. Simpson's paradox…

Machine Learning · Computer Science 2026-03-03 Xian Teng , Yu-Ru Lin

The inaccessibility of controlled randomized trials due to inherent constraints in many fields of science has been a fundamental issue in causal inference. In this paper, we focus on distinguishing the cause from effect in the bivariate…

Machine Learning · Statistics 2021-02-23 Jean-Francois Ton , Dino Sejdinovic , Kenji Fukumizu

Recent years have seen rapid progress at the intersection between causality and machine learning. Motivated by scientific applications involving high-dimensional data, in particular in biomedicine, we propose a deep neural architecture for…

Machine Learning · Computer Science 2022-12-12 Kai Lagemann , Christian Lagemann , Bernd Taschler , Sach Mukherjee

We propose a random forest estimator for the intensity of spatial point processes, applicable with or without covariates. It retains the well-known advantages of a random forest approach, including the ability to handle a large number of…

Methodology · Statistics 2025-11-13 Christophe Biscio , Frédéric Lavancier

We present Random Partition Kernels, a new class of kernels derived by demonstrating a natural connection between random partitions of objects and kernels between those objects. We show how the construction can be used to create kernels…

Machine Learning · Statistics 2014-02-19 Alex Davies , Zoubin Ghahramani

Isolation Forest (iForest) stands out as a widely-used unsupervised anomaly detector, primarily owing to its remarkable runtime efficiency and superior performance in large-scale tasks. Despite its widespread adoption, a theoretical…

Machine Learning · Computer Science 2026-01-28 Qin-Cheng Zheng , Shao-Qun Zhang , Shen-Huan Lyu , Yuan Jiang , Zhi-Hua Zhou