English
Related papers

Related papers: Understanding overfitting in random forest for pro…

200 papers

Modeling the diameter distribution of trees in forest stands is a common forestry task that supports key biologically and economically relevant management decisions. The choice of model used to represent the diameter distribution and how to…

Applications · Statistics 2019-11-26 Mahdi Teimouri , Jeffrey W. Doser , Andrew O. Finley

In this modern era of overpopulation disease prediction is a crucial step in diagnosing various diseases at an early stage. With the advancement of various machine learning algorithms, the prediction has become quite easy. However, the…

Machine Learning · Computer Science 2022-03-23 Ishu Gupta , Vartika Sharma , Sizman Kaur , Ashutosh Kumar Singh

Rapid increase of traffic volume on urban roads over time has changed the traffic scenario globally. It has also increased the ratio of road accidents that can be severe and fatal in the worst case. To improve traffic safety and its…

Other Computer Science · Computer Science 2020-10-29 Muhammad Umer , Saima Sadiq , Abid Ishaq , Saleem Ullah , Najia Saher , Hamza Ahmad Madni

Sampling-based motion planning algorithms are widely used in robotics because they are very effective in high-dimensional spaces. However, the success rate and quality of the solutions are determined by an adequate selection of their…

Without access to large compute clusters, building random forests on large datasets is still a challenging problem. This is, in particular, the case if fully-grown trees are desired. We propose a simple yet effective framework that allows…

Machine Learning · Computer Science 2018-02-20 Fabian Gieseke , Christian Igel

Manifold alignment is a type of data fusion technique that creates a shared low-dimensional representation of data collected from multiple domains, enabling cross-domain learning and improved performance in downstream tasks. This paper…

Machine Learning · Computer Science 2024-11-26 Jake S. Rhodes , Adam G. Rustad

Random forests are a powerful method for non-parametric regression, but are limited in their ability to fit smooth signals, and can show poor predictive performance in the presence of strong, smooth effects. Taking the perspective of random…

Machine Learning · Statistics 2020-09-08 Rina Friedberg , Julie Tibshirani , Susan Athey , Stefan Wager

The most popular approach for analyzing survival data is the Cox regression model. The Cox model may, however, be misspecified, and its proportionality assumption may not always be fulfilled. An alternative approach for survival prediction…

Machine Learning · Statistics 2018-05-17 Marvin N. Wright , Theresa Dankowski , Andreas Ziegler

Random survival forests (RSF) are a powerful method for risk prediction of right-censored outcomes in biomedical research. RSF use the log-rank split criterion to form an ensemble of survival trees. The most common approach to evaluate the…

Machine Learning · Statistics 2016-07-20 Matthias Schmid , Marvin Wright , Andreas Ziegler

Overfitting is a well-known issue in machine learning that occurs when a model struggles to generalize its predictions to new, unseen data beyond the scope of its training set. Traditional techniques to mitigate overfitting include early…

Machine Learning · Computer Science 2025-12-09 Flavio Giorgi , Fabiano Veglianti , Fabrizio Silvestri , Gabriele Tolomei

Most machine learning methods assume that the input data distribution is the same in the training and testing phases. However, in practice, this stationarity is usually not met and the distribution of inputs differs, leading to unexpected…

Machine Learning · Computer Science 2023-04-19 Firas Bayram , Bestoun S. Ahmed

We discuss the scaling behavior of the self-organized critical forest-fire model on large length scales. As indicated in earlier publications, the forest-fire model does not show conventional critical scaling, but has two qualitatively…

Statistical Mechanics · Physics 2009-11-07 Klaus Schenk , Barbara Drossel , Franz Schwabl

Due to the steadily increasing relevance of machine learning for practical applications, many of which are coming with safety requirements, the notion of uncertainty has received increasing attention in machine learning research in the last…

Machine Learning · Computer Science 2020-01-06 Mohammad Hossein Shaker , Eyke Hüllermeier

The goal of these lectures is to review some mathematical aspects of random tree models used in evolutionary biology to model gene trees or species trees. We start with stochastic models of tree shapes (finite trees without edge lengths),…

Probability · Mathematics 2017-08-30 Amaury Lambert

We demonstrate that, for a range of state-of-the-art machine learning algorithms, the differences in generalisation performance obtained using default parameter settings and using parameters tuned via cross-validation can be similar in…

Machine Learning · Computer Science 2017-03-21 Anthony Bagnall , Gavin C. Cawley

Random forests are classical ensemble algorithms that construct multiple randomized decision trees and aggregate their predictions using naive averaging. \citet{zhou2019deep} further propose a deep forest algorithm with multi-layer forests,…

Machine Learning · Computer Science 2025-02-04 Shen-Huan Lyu , Jin-Hui Wu , Qin-Cheng Zheng , Baoliu Ye

Minimising a spectral risk objective, defined as a convex combination of expected cost and Conditional Value-at-Risk (CVaR), is challenging when the uncertainty distribution is decision-dependent, making both surrogate modelling and…

Machine Learning · Computer Science 2026-03-16 Marcell T. Kurbucz

Machine-learning algorithms have gained popularity in recent years in the field of ecological modeling due to their promising results in predictive performance of classification problems. While the application of such algorithms has been…

Machine Learning · Statistics 2019-10-07 Patrick Schratz , Jannes Muenchow , Eugenia Iturritxa , Jakob Richter , Alexander Brenning

We describe the use of an unsupervised Random Forest for similarity learning and improved unsupervised anomaly detection. By training a Random Forest to discriminate between real data and synthetic data sampled from a uniform distribution…

Machine Learning · Statistics 2025-04-23 Joshua S. Harvey , Joshua Rosaler , Mingshu Li , Dhruv Desai , Dhagash Mehta

Wildfire is one of the biggest disasters that frequently occurs on the west coast of the United States. Many efforts have been made to understand the causes of the increases in wildfire intensity and frequency in recent years. In this work,…

Machine Learning · Computer Science 2021-09-07 Tanqiu Jiang , Sidhant K. Bendre , Hanjia Lyu , Jiebo Luo