English
Related papers

Related papers: Cross-validation on Extreme Regions

200 papers

We introduce a novel regression model for the conditional left and right tail of a possibly heavy-tailed response. The proposed model can be used to learn the effect of covariates on an extreme value setting via a Lasso-type specification…

Methodology · Statistics 2021-08-11 Miguel de Carvalho , Soraia Pereira , Paula Pereira , Patrícia de Zea Bermudez

We study high-dimensional asymptotic performance limits of binary supervised classification problems where the class conditional densities are Gaussian with unknown means and covariances and the number of signal dimensions scales faster…

Machine Learning · Statistics 2016-11-17 Mohammad Hossein Rohban , Prakash Ishwar , Birant Orten , William C. Karl , Venkatesh Saligrama

Estimating the value function for a fixed policy is a fundamental problem in reinforcement learning. Policy evaluation algorithms---to estimate value functions---continue to be developed, to improve convergence rates, improve stability and…

Machine Learning · Statistics 2018-08-29 Touqir Sajed , Wesley Chung , Martha White

We consider the problem of evaluating risk for a system that is modeled by a complex stochastic simulation with many possible input parameter values. Two sources of computational burden can be identified: the effort associated with…

Methodology · Statistics 2024-03-29 Armin Khayyer , Alexander Vinel , Joseph J. Kennedy

We study the mean-squared error of $k$-fold cross-validation as a risk estimator, with particular emphasis on how its accuracy depends on the number of folds $k$. Despite the widespread use of cross-validation, principled guidance for…

Statistics Theory · Mathematics 2026-05-26 Ido Nachum , Rüdiger Urbanke , Thomas Weinberger

Contrastive Representation Learning (CRL) has achieved strong empirical success in multiple machine learning disciplines, yet its theoretical sample complexity remains poorly understood. Existing analyses usually assume that input tuples…

Machine Learning · Statistics 2026-05-29 Nong Minh Hieu , Antoine Ledent

This paper focuses on the problem of determining as large a region as possible where a function exceeds a given threshold with high probability. We assume that we only have access to a noise-corrupted version of the function and that…

Machine Learning · Statistics 2018-11-27 Andrea Zanette , Junzi Zhang , Mykel J. Kochenderfer

Risk-sensitive reinforcement learning (RL) aims to optimize policies that balance the expected reward and risk. In this paper, we present a novel risk-sensitive RL framework that employs an Iterated Conditional Value-at-Risk (CVaR)…

Machine Learning · Computer Science 2023-12-05 Yu Chen , Yihan Du , Pihe Hu , Siwei Wang , Desheng Wu , Longbo Huang

When cross-validating standard or extended Cox models, the commonly used criterion is the cross-validated partial loglikelihood using a naive or a van Houwelingen scheme -to make efficient use of the death times of the left out data in…

Methodology · Statistics 2018-10-09 Frédéric Bertrand , Philippe Bastien , Myriam Maumy-Bertrand

Cross-validation is a common method for estimating the predictive performance of machine learning models. In a data-scarce regime, where one typically wishes to maximize the number of instances used for training the model, an approach…

Methodology · Statistics 2025-03-25 George I. Austin , Itsik Pe'er , Tal Korem

Options are generally learned by using an inaccurate environment model (or simulator), which contains uncertain model parameters. While there are several methods to learn options that are robust against the uncertainty of model parameters,…

Machine Learning · Computer Science 2019-11-01 Takuya Hiraoka , Takahisa Imagawa , Tatsuya Mori , Takashi Onishi , Yoshimasa Tsuruoka

Modeling heterogeneity on heavy-tailed distributions under a regression framework is challenging, and classical statistical methodologies usually place conditions on the distribution models to facilitate the learning procedure. However,…

Methodology · Statistics 2024-10-29 Jiaxi Wang , Yanxi Hou , Xingchi Li , Tiandong Wang

Extreme quantile regression provides estimates of conditional quantiles outside the range of the data. Classical quantile regression performs poorly in such cases since data in the tail region are too scarce. Extreme value theory is used…

Methodology · Statistics 2022-12-22 Jasper Velthoen , Clément Dombry , Juan-Juan Cai , Sebastian Engelke

The widescale deployment of Autonomous Vehicles (AV) seems to be imminent despite many safety challenges that are yet to be resolved. It is well known that there are no universally agreed Verification and Validation (VV) methodologies to…

Robotics · Computer Science 2020-03-05 Dhanoop Karunakaran , Stewart Worrall , Eduardo Nebot

Estimation of extreme quantile regions, spaces in which future extreme events can occur with a given low probability, even beyond the range of the observed data, is an important task in the analysis of extremes. Existing methods to estimate…

Methodology · Statistics 2020-10-28 Boris Beranger , Simone A. Padoan , Scott A. Sisson

In extreme value analysis, the extreme value index plays a vital role as it determines the tail heaviness of the underlying distribution and is the primary parameter required for the estimation of other extreme events. In this paper, we…

Computation · Statistics 2017-09-27 Richard Minkah , Tertius de Wet , Ezekiel Nii Noi Nortey

Though deep reinforcement learning (DRL) has obtained substantial success, it may encounter catastrophic failures due to the intrinsic uncertainty of both transition and observation. Most of the existing methods for safe reinforcement…

Machine Learning · Computer Science 2025-05-20 Chengyang Ying , Xinning Zhou , Hang Su , Dong Yan , Ning Chen , Jun Zhu

Deploying deep reinforcement learning in safety-critical settings requires developing algorithms that obey hard constraints during exploration. This paper contributes a first approach toward enforcing formal safety constraints on end-to-end…

Artificial Intelligence · Computer Science 2020-07-03 Nathan Hunt , Nathan Fulton , Sara Magliacane , Nghia Hoang , Subhro Das , Armando Solar-Lezama

This paper presents a novel semiparametric method to study the effects of extreme events on binary outcomes and subsequently forecast future outcomes. Our approach, based on Bayes' theorem and regularly varying (RV) functions, facilitates a…

Econometrics · Economics 2025-02-25 Laura Liu , Yulong Wang

Threshold selection is a fundamental problem in any threshold-based extreme value analysis. While models are asymptotically motivated, selecting an appropriate threshold for finite samples is difficult and highly subjective through standard…

Methodology · Statistics 2024-10-30 Conor Murphy , Jonathan A. Tawn , Zak Varty