English
Related papers

Related papers: Random Tessellation Forests

200 papers

The Mondrian process represents an elegant and powerful approach for space partition modelling. However, as it restricts the partitions to be axis-aligned, its modelling flexibility is limited. In this work, we propose a self-consistent…

Machine Learning · Statistics 2019-03-25 Xuhui Fan , Bin Li , Scott Anthony Sisson

The stable under iterated tessellation (STIT) process is a stochastic process that produces a recursive partition of space with cut directions drawn independently from a distribution over the sphere. The case of random axis-aligned cuts is…

Machine Learning · Statistics 2021-09-15 Eliza O'Reilly , Ngoc Tran

Random forests are a popular class of algorithms used for regression and classification. The algorithm introduced by Breiman in 2001 and many of its variants are ensembles of randomized decision trees built from axis-aligned partitions of…

Statistics Theory · Mathematics 2023-10-31 Eliza O'Reilly , Ngoc Mai Tran

Ensembles of randomized decision trees, usually referred to as random forests, are widely used for classification and regression tasks in machine learning and statistics. Random forests achieve competitive predictive performance and are…

Machine Learning · Statistics 2015-02-17 Balaji Lakshminarayanan , Daniel M. Roy , Yee Whye Teh

This report is concerned with the Mondrian process and its applications in machine learning. The Mondrian process is a guillotine-partition-valued stochastic process that possesses an elegant self-consistency property. The first part of the…

Machine Learning · Statistics 2015-07-21 Matej Balog , Yee Whye Teh

Shape modelling (with methods that output shapes) is a new and important task in Bayesian nonparametrics and bioinformatics. In this work, we focus on Bayesian nonparametric methods for capturing shapes by partitioning a space using curves.…

Machine Learning · Statistics 2022-11-08 Shufei Ge , Shijia Wang , Lloyd Elliott

The Binary Space Partitioning~(BSP)-Tree process is proposed to produce flexible 2-D partition structures which are originally used as a Bayesian nonparametric prior for relational modelling. It can hardly be applied to other learning tasks…

Machine Learning · Statistics 2019-03-25 Xuhui Fan , Bin Li , Scott Anthony Sisson

This work studies the statistical implications of using features comprised of general linear combinations of covariates to partition the data in randomized decision tree and forest regression algorithms. Using random tessellation theory in…

Statistics Theory · Mathematics 2025-11-05 Eliza O'Reilly

Introduced by Breiman, Random Forests are widely used classification and regression algorithms. While being initially designed as batch algorithms, several variants have been proposed to handle online learning. One particular instance of…

Machine Learning · Statistics 2019-04-10 Jaouad Mourtada , Stéphane Gaïffas , Erwan Scornet

Random forests are popular methods for regression and classification analysis, and many different variants have been proposed in recent years. One interesting example is the Mondrian random forest, in which the underlying constituent trees…

Statistics Theory · Mathematics 2025-11-10 Matias D. Cattaneo , Jason M. Klusowski , William G. Underwood

Random feature maps are used to decrease the computational cost of kernel machines in large-scale problems. The Mondrian kernel is one such example of a fast random feature approximation of the Laplace kernel, generated by a computationally…

Machine Learning · Computer Science 2025-03-13 Calvin Osborne , Eliza O'Reilly

We introduce the Mondrian kernel, a fast random feature approximation to the Laplace kernel. It is suitable for both batch and online learning, and admits a fast kernel-width-selection procedure as the random features can be re-used…

Machine Learning · Statistics 2016-06-17 Matej Balog , Balaji Lakshminarayanan , Zoubin Ghahramani , Daniel M. Roy , Yee Whye Teh

Many robotic tasks, such as inverse kinematics, motion planning, and optimal control, can be formulated as optimization problems. Solving these problems involves addressing nonlinear kinematics, complex contact dynamics, long-horizon…

Robotics · Computer Science 2025-09-10 Teng Xue , Yan Zhang , Amirreza Razmjoo , Sylvain Calinon

The Binary Space Partitioning-Tree~(BSP-Tree) process was recently proposed as an efficient strategy for space partitioning tasks. Because it uses more than one dimension to partition the space, the BSP-Tree Process is more efficient and…

Machine Learning · Statistics 2020-03-03 Xuhui Fan , Bin Li , Scott A. Sisson

Random forest regression is a powerful non-parametric method that adapts to local data characteristics through data-driven partitioning, making it effective across diverse application domains. However, the piecewise constant nature of…

Machine Learning · Computer Science 2026-05-19 Ziyi Liu , Phuc Luong , Mario Boley , Daniel F. Schmidt

Partitioning large machine learning models across distributed accelerator systems is a complex process, requiring a series of interdependent decisions that are further complicated by internal sharding ambiguities. Consequently, existing…

Random Forests have been extensively used in regression and classification, inspiring the development of various forest-based methods. Among these, Mondrian Forests, derived from the Mondrian process, mark a significant advancement.…

Statistics Theory · Mathematics 2025-02-28 Haoran Zhan , Jingli Wang , Yingcun Xia

Random forests are a statistical learning method widely used in many areas of scientific research because of its ability to learn complex relationships between input and output variables and also its capacity to handle high-dimensional…

Machine Learning · Statistics 2024-02-19 Louis Capitaine , Jérémie Bigot , Rodolphe Thiébaut , Robin Genuer

We propose a computationally efficient algorithm for gradient-based linear dimension reduction and high-dimensional regression. The algorithm initially computes a Mondrian forest and uses this estimator to identify a relevant feature…

Statistics Theory · Mathematics 2024-07-16 Ricardo Baptista , Eliza O'Reilly , Yangxinyu Xie

In this paper planar STIT tesselations with weighted axis-parallel cutting directions are considered. They are known also as weighted planar Mondrian tesselations in the machine learning literature, where they are used in random forest…

Probability · Mathematics 2022-04-29 Carina Betken , Tom Kaufmann , Kathrin Meier , Christoph Thäle
‹ Prev 1 2 3 10 Next ›