English
Related papers

Related papers: Modeling of time series using random forests: theo…

200 papers

Over the past decade, random forest models have become widely used as a robust method for high-dimensional data regression tasks. In part, the popularity of these models arises from the fact that they require little hyperparameter tuning…

Machine Learning · Computer Science 2020-03-18 Shipra Malhotra , John Karanicolas

Random forests are a widely used machine learning algorithm, but their computational efficiency is undermined when applied to large-scale datasets with numerous instances and useless features. Herein, we propose a nonparametric feature…

Machine Learning · Computer Science 2022-01-19 Xiaojun Mao , Liuhua Peng , Zhonglei Wang

The forest of mutations associated to a multitype branching forest is obtained by merging together all vertices of its clusters and by preserving connections between them. We first show that the forest of mutations of any mulitype branching…

Probability · Mathematics 2015-10-06 Loïc Chaumont , Thi Ngoc Anh Nguyen

Random forests are powerful non-parametric regression method but are severely limited in their usage in the presence of randomly censored observations, and naively applied can exhibit poor predictive performance due to the incurred biases.…

Machine Learning · Statistics 2020-01-13 Alexander Hanbo Li , Jelena Bradic

In this paper we investigate the asymptotic optimality property of a randomized sampling based motion planner, namely RRT. We prove that a RRT planner is not an asymptotically optimal motion planner. Our result, while being consistent with…

Robotics · Computer Science 2017-07-14 Titas Bera , Debasish Ghose , Sundaram Suresh

This paper presents a novel nonlinear regression model for estimating heterogeneous treatment effects from observational data, geared specifically towards situations with small effect sizes, heterogeneous effects, and strong confounding.…

Methodology · Statistics 2019-11-14 P. Richard Hahn , Jared S. Murray , Carlos Carvalho

The last decade has shed some light on theoretical properties such as their consistency for regression tasks. In the current paper, we propose a new class of very simple learners based on so-called naive trees. These naive trees partition…

Statistics Theory · Mathematics 2024-12-18 Nico Föge , Markus Pauly , Lena Schmid , Marc Ditzhaus

We define and study a model of winding for non-colliding particles in finite trees. We prove that the asymptotic behavior of this statistic satisfies a central limiting theorem, analogous to similar results on winding of bounded particles…

Combinatorics · Mathematics 2020-04-03 David A. Levin , Eric Ramos , Benjamin Young

The absence of time-reversal symmetry is a fundamental property of many nonlinear time series. Here, we propose a new set of statistical tests for time series irreversibility based on standard and horizontal visibility graphs. Specifically,…

Data Analysis, Statistics and Probability · Physics 2016-04-07 Jonathan F. Donges , Reik V. Donner , Jürgen Kurths

Irregularly sampled time series data arise naturally in many application domains including biology, ecology, climate science, astronomy, and health. Such data represent fundamental challenges to many classical models from machine learning…

Machine Learning · Computer Science 2021-01-07 Satya Narayan Shukla , Benjamin M. Marlin

In this paper, we consider the problem of estimating the marginal density in some nonlinear autoregressive time series models for which the conditional mean and variance have a parametric specification. Under some regularity conditions, we…

Statistics Theory · Mathematics 2016-10-31 Lionel Truquet

Data-driven methods for modeling dynamic systems have received considerable attention as they provide a mechanism for control synthesis directly from the observed time-series data. In the absence of prior assumptions on how the time-series…

Optimization and Control · Mathematics 2018-09-24 Atiye Alaeddini , Siavash Alemzadeh , Afshin Mesbahi , Mehran Mesbahi

We consider uniform random permutations drawn from a family enumerated through generating trees. We develop a new general technique to establish a central limit theorem for the number of consecutive occurrences of a fixed pattern in such…

Probability · Mathematics 2021-12-22 Jacopo Borga

We consider a model of random tree growth, where at each time unit a new vertex is added and attached to an already existing vertex chosen at random. The probability with which a vertex with degree $k$ is chosen is proportional to $w(k)$,…

Probability · Mathematics 2007-05-23 Anna Rudas , Balint Toth , Benedek Valko

Random forests, introduced by Leo Breiman in 2001, are a very effective statistical method. The complex mechanism of the method makes theoretical analysis difficult. Therefore, a simplified version of random forests, called purely random…

Statistics Theory · Mathematics 2010-07-28 Robin Genuer

We consider random recursive trees that are grown via community modulated schemes that involve random attachment or degree based attachment. The aim of this paper is to derive general techniques based on continuous time embedding to study…

Probability · Mathematics 2020-08-05 Shankar Bhamidi , Ruituo Fan , Nicolas Fraiman , Andrew Nobel

Assume we are given a set of items from a general metric space, but we neither have access to the representation of the data nor to the distances between data points. Instead, suppose that we can actively choose a triplet of items (A,B,C)…

Machine Learning · Statistics 2018-06-19 Siavash Haghiri , Damien Garreau , Ulrike von Luxburg

A stochastic forest model of young and old age class trees is studied. First, we prove existence, uniqueness and boundedness of global nonnegative solutions. Second, we investigate asymptotic behavior of solutions by giving a sufficient…

Probability · Mathematics 2016-11-15 Ton Viet Ta , Linh Thi Hoai Nguyen , Atsushi Yagi

Random forests are a scheme proposed by Leo Breiman in the 2000's for building a predictor ensemble with a set of decision trees that grow in randomly selected subspaces of data. Despite growing interest and practical use, there has been…

Machine Learning · Statistics 2012-03-28 Gérard Biau

Nonparametric regression problems with qualitative constraints such as monotonicity or convexity are ubiquitous in applications. For example, in predicting the yield of a factory in terms of the number of labor hours, the monotonicity of…

Statistics Theory · Mathematics 2023-11-21 Soham Mallick , Siddhaarth Sarkar , Arun Kumar Kuchibhotla