English
Related papers

Related papers: On the Tunability of Random Survival Forests Model…

200 papers

We propose adaptive weight decay, which automatically tunes the hyper-parameter for weight decay during each training iteration. For classification problems, we propose changing the value of the weight decay hyper-parameter on the fly based…

Machine Learning · Computer Science 2023-12-05 Amin Ghiasi , Ali Shafahi , Reza Ardekani

We propose a method, a model, and a form of presenting model results for condition monitoring of a small set of wind turbines with rare failures. The main new ingredient of the method is to sample failure thresholds according to the profit…

Systems and Control · Electrical Eng. & Systems 2025-01-14 Viktor Begun , Ulrich Schlickewei

Fitting models with high predictive accuracy that include all relevant but no irrelevant or redundant features is a challenging task on data sets with similar (e.g. highly correlated) features. We propose the approach of tuning the…

Machine Learning · Statistics 2022-03-23 Andrea Bommert , Jörg Rahnenführer , Michel Lang

The Random Forest (RF) classifier is often claimed to be relatively well calibrated when compared with other machine learning methods. Moreover, the existing literature suggests that traditional calibration methods, such as isotonic…

Machine Learning · Computer Science 2025-01-29 Mohammad Hossein Shaker , Eyke Hüllermeier

Precise estimation of the Remaining Useful Life (RUL) of rolling bearings is an important consideration to avoid unexpected failures, reduce downtime, and promote safety and efficiency in industrial systems. Complications in degradation…

Machine Learning · Computer Science 2025-05-22 Ali Mohajerzarrinkelk , Maryam Ahang , Mehran Zoravar , Mostafa Abbasi , Homayoun Najjaran

In order to improve reproducibility, deep reinforcement learning (RL) has been adopting better scientific practices such as standardized evaluation metrics and reporting. However, the process of hyperparameter optimization still varies…

Machine Learning · Computer Science 2023-06-05 Theresa Eimer , Marius Lindauer , Roberta Raileanu

Functional survival models are key tools for analyzing time-to-event data with complex predictors, such as functional or high-dimensional inputs. Despite their predictive strength, these models often lack interpretability, which limits…

Machine Learning · Statistics 2025-04-28 Giuseppe Loffredo , Elvira Romano , Fabrizio MAturo

We introduce a new survival tree method for censored failure time data that incorporates three key advancements over traditional approaches. First, we develop a more computationally efficient splitting procedure that effectively mitigates…

Methodology · Statistics 2025-09-24 Ruiwen Zhou , Ke Xie , Lei Liu , Zhichen Xu , Jimin Ding , Xiaogang Su

Owing to their inherently interpretable structure, decision trees are commonly used in applications where interpretability is essential. Recent work has focused on improving various aspects of decision trees, including their predictive…

Machine Learning · Statistics 2023-05-30 Dimitris Bertsimas , Vassilis Digalakis

Neural network pruning has traditionally focused on weight-based criteria to achieve model compression, frequently overlooking the crucial balance between adversarial robustness and accuracy. Existing approaches often fail to preserve…

Machine Learning · Computer Science 2025-03-20 Lincen Bai , Hedi Tabia , Raúl Santos-Rodríguez

Decision trees are popular in survival analysis for their interpretability and ability to model complex relationships. Survival trees, which predict the timing of singular events using censored historical data, are typically built through…

Machine Learning · Computer Science 2025-11-24 Antonio Consolo , Edoardo Amaldi , Emilio Carrizosa

Survival random forest is a popular machine learning tool for modeling censored survival data. However, there is currently no statistically valid and computationally feasible approach for estimating its confidence band. This paper proposes…

Methodology · Statistics 2022-04-27 Sarah Elizabeth Formentini , Wei Liang , Ruoqing Zhu

A desirable property in fault-tolerant controllers is adaptability to system changes as they evolve during systems operations. An adaptive controller does not require optimal control policies to be enumerated for possible faults. Instead it…

Systems and Control · Electrical Eng. & Systems 2020-08-12 Ibrahim Ahmed , Hamed Khorasgani , Gautam Biswas

Random survival forests (RSF) are a powerful method for risk prediction of right-censored outcomes in biomedical research. RSF use the log-rank split criterion to form an ensemble of survival trees. The most common approach to evaluate the…

Machine Learning · Statistics 2016-07-20 Matthias Schmid , Marvin Wright , Andreas Ziegler

Random Forests (RFs) are widely used Machine Learning models in low-power embedded devices, due to their hardware friendly operation and high accuracy on practically relevant tasks. The accuracy of a RF often increases with the number of…

In this paper we propose using the principle of boosting to reduce the bias of a random forest prediction in the regression setting. From the original random forest fit we extract the residuals and then fit another random forest to these…

Machine Learning · Statistics 2021-02-25 Indrayudh Ghosal , Giles Hooker

By informing the onset of the degradation process, health status evaluation serves as a significant preliminary step for reliable remaining useful life (RUL) estimation of complex equipment. This paper proposes a novel temporal dynamics…

Machine Learning · Computer Science 2024-01-10 Anushiya Arunan , Yan Qin , Xiaoli Li , Chau Yuen

Sparse residual tree (SRT) is an adaptive exploration method for multivariate scattered data approximation. It leads to sparse and stable approximations in areas where the data is sufficient or redundant, and points out the possible local…

Numerical Analysis · Mathematics 2019-05-15 Xin Xu , Xiaopeng Luo

Loss of trainability refers to a phenomenon in continual learning where parameter updates no longer make progress on the optimization objective, so accuracy stalls or degrades as the learning problem changes over time. In this paper, we…

Machine Learning · Computer Science 2025-12-11 Gunbir Singh Baveja , Alex Lewandowski , Mark Schmidt

Modern supervised machine learning algorithms involve hyperparameters that have to be set before running them. Options for setting hyperparameters are default values from the software package, manual configuration by the user or configuring…

Machine Learning · Statistics 2018-10-23 Philipp Probst , Bernd Bischl , Anne-Laure Boulesteix