English
Related papers

Related papers: Optimizing Prediction Intervals by Tuning Random F…

200 papers

This paper develops a new approach to post-selection inference for screening high-dimensional predictors of survival outcomes. Post-selection inference for right-censored outcome data has been investigated in the literature, but much…

Methodology · Statistics 2021-12-22 Tzu-Jung Huang , Alex Luedtke , Ian W. McKeague

Neural networks are configured by choosing an architecture and hyperparameter values; doing so often involves expert intuition and hand-tuning to find a configuration that extrapolates well without overfitting. This paper considers…

Image and Video Processing · Electrical Eng. & Systems 2022-10-05 Matthew Dirks , David Poole

Given an ensemble of randomized regression trees, it is possible to restructure them as a collection of multilayered neural networks with particular connection weights. Following this principle, we reformulate the random forest method of…

Machine Learning · Statistics 2018-04-04 Gérard Biau , Erwan Scornet , Johannes Welbl

In this paper, an improved method for VR user experience prediction is investigated by introducing a sparrow search algorithm and a random forest algorithm improved by an iterative local search-optimised sparrow search algorithm. The study…

Machine Learning · Computer Science 2024-06-26 Xirui Tang , Feiyang Li , Zinan Cao , Qixuan Yu , Yulu Gong

Random forests are ensemble learning methods introduced by Breiman (2001) that operate by averaging several decision trees built on a randomly selected subspace of the data set. Despite their widespread use in practice, the respective roles…

Statistics Theory · Mathematics 2016-03-15 Roxane Duroux , Erwan Scornet

Random forests are a powerful method for non-parametric regression, but are limited in their ability to fit smooth signals, and can show poor predictive performance in the presence of strong, smooth effects. Taking the perspective of random…

Machine Learning · Statistics 2020-09-08 Rina Friedberg , Julie Tibshirani , Susan Athey , Stefan Wager

Conformal prediction, and split conformal prediction as a specific implementation, offer a distribution-free approach to estimating prediction intervals with statistical guarantees. Recent work has shown that split conformal prediction can…

Machine Learning · Statistics 2024-05-01 Nicolas Dewolf , Bernard De Baets , Willem Waegeman

We initiate a systematic study of utilizing predictions to improve over approximation guarantees of classic algorithms, without increasing the running time. We propose a systematic method for a wide class of optimization problems that ask…

Data Structures and Algorithms · Computer Science 2024-11-26 Antonios Antoniadis , Marek Eliáš , Adam Polak , Moritz Venzin

Deep learning models are being adopted and applied on various critical decision-making tasks, yet they are trained to provide point predictions without providing degrees of confidence. The trustworthiness of deep learning models can be…

Machine Learning · Computer Science 2024-10-28 Daniel Nolte , Souparno Ghosh , Ranadip Pal

Biased regularization and fine-tuning are two recent meta-learning approaches. They have been shown to be effective to tackle distributions of tasks, in which the tasks' target vectors are all close to a common meta-parameter vector.…

Machine Learning · Computer Science 2020-08-26 Giulia Denevi , Massimiliano Pontil , Carlo Ciliberto

Recurrent events are common in clinical, healthcare, social and behavioral studies. A recent analysis framework for potentially censored recurrent event data is to construct a censored longitudinal data set consisting of times to the first…

Applications · Statistics 2025-02-11 Abigail Loe , Susan Murray , Zhenke Wu

Survival random forest is a popular machine learning tool for modeling censored survival data. However, there is currently no statistically valid and computationally feasible approach for estimating its confidence band. This paper proposes…

Methodology · Statistics 2022-04-27 Sarah Elizabeth Formentini , Wei Liang , Ruoqing Zhu

Probabilistic regression models typically use the Maximum Likelihood Estimation or Cross-Validation to fit parameters. These methods can give an advantage to the solutions that fit observations on average, but they do not pay attention to…

Applications · Statistics 2022-05-24 Naoufal Acharki , Antoine Bertoncello , Josselin Garnier

Data analysis and machine learning have become an integrative part of the modern scientific methodology, offering automated procedures for the prediction of a phenomenon based on past observations, unraveling underlying patterns in data and…

Machine Learning · Statistics 2015-06-04 Gilles Louppe

This papers proposes a generic, high-level methodology for generating forecast combinations that would deliver the optimal linearly combined forecast in terms of the mean-squared forecast error if one had access to two population…

Methodology · Statistics 2023-09-01 Elliot Beck , Damian Kozbur , Michael Wolf

Instruction tuning has emerged as a critical paradigm for improving the capabilities and alignment of large language models (LLMs). However, existing iterative model-aware data selection methods incur significant computational overhead, as…

Machine Learning · Computer Science 2025-05-13 Xiaotian Lin , Yanlin Qi , Yizhang Zhu , Themis Palpanas , Chengliang Chai , Nan Tang , Yuyu Luo

Amounts of historical data collected increase and business intelligence applicability with automatic forecasting of time series are in high demand. While no single time series modeling method is universal to all types of dynamics,…

Machine Learning · Statistics 2022-04-18 Evaldas Vaiciukynas , Paulius Danenas , Vilius Kontrimas , Rimantas Butleris

Calibration error is commonly adopted for evaluating the quality of uncertainty estimators in deep neural networks. In this paper, we argue that such a metric is highly beneficial for training predictive models, even when we do not…

Machine Learning · Statistics 2019-11-01 Jayaraman J. Thiagarajan , Bindya Venkatesh , Deepta Rajan

When using machine learning for fault detection, a common problem is the fact that most data sets are very unbalanced, with the minority class (a fault) being the interesting one. In this paper, we investigate the usage of Venn-Abers…

Machine Learning · Computer Science 2023-06-13 Ulf Johansson , Tuwe Löfström , Cecilia Sönströd

This paper presents several strategies to tune the parameters of metaheuristic methods for (discrete) design optimization of reinforced concrete (RC) structures. A novel utility metric is proposed, based on the area under the average…

Neural and Evolutionary Computing · Computer Science 2021-10-13 Iván Negrin , Dirk Roose , Ernesto Chagoyén
‹ Prev 1 3 4 5 6 7 10 Next ›