English
Related papers

Related papers: Cross-validation on Extreme Regions

200 papers

We consider an online stochastic game with risk-averse agents whose goal is to learn optimal decisions that minimize the risk of incurring significantly high costs. Specifically, we use the Conditional Value at Risk (CVaR) as a risk measure…

Machine Learning · Computer Science 2022-06-17 Zifan Wang , Yi Shen , Michael M. Zavlanos

This paper addresses risk averse constrained optimization problems where the objective and constraint functions can only be computed by a blackbox subject to unknown uncertainties. To handle mixed aleatory/epistemic uncertainties, the…

Optimization and Control · Mathematics 2023-10-18 Charles Audet , Jean Bigeon , Romain Couderc , Michael Kokkolaras

In risk management, often the probability must be estimated that a random vector falls into an extreme failure set. In the framework of bivariate extreme value theory, we construct an estimator for such failure probabilities and analyze its…

Methodology · Statistics 2015-06-04 Holger Drees , Laurens de Haan

This study examines generalized cross-validation for the tuning parameter selection for ridge regression in high-dimensional misspecified linear models. The set of candidates for the tuning parameter includes not only positive values but…

Statistics Theory · Mathematics 2026-01-21 Akira Shinkyu

In risk-averse reinforcement learning (RL), the goal is to optimize some risk measure of the returns. A risk measure often focuses on the worst returns out of the agent's experience. As a result, standard methods for risk-averse RL often…

Machine Learning · Computer Science 2022-10-13 Ido Greenberg , Yinlam Chow , Mohammad Ghavamzadeh , Shie Mannor

Maximum likelihood estimation of large Markov-switching vector autoregressions (MS-VARs) can be challenging or infeasible due to parameter proliferation. To accommodate situations where dimensionality may be of comparable order to or…

Econometrics · Economics 2021-07-28 Kenwin Maung

Extreme value statistics (EVS) concerns the study of the statistics of the maximum or the minimum of a set of random variables. This is an important problem for any time-series and has applications in climate, finance, sports, all the way…

Statistical Mechanics · Physics 2020-10-12 Satya N. Majumdar , Arnab Pal , Gregory Schehr

Model selection is difficult to analyse yet theoretically and empirically important, especially for high-dimensional data analysis. Recently the least absolute shrinkage and selection operator (Lasso) has been applied in the statistical and…

Machine Learning · Statistics 2016-06-02 Ning Xu , Jian Hong , Timothy C. G. Fisher

Value-at-risk (VaR) is an established measure to assess risks in critical real-world applications with random environmental factors. This paper presents a novel VaR upper confidence bound (V-UCB) algorithm for maximizing the VaR of a…

Machine Learning · Computer Science 2021-05-14 Quoc Phong Nguyen , Zhongxiang Dai , Bryan Kian Hsiang Low , Patrick Jaillet

Probabilistic guarantees on the prediction of data-driven classifiers are necessary to define models that can be considered reliable. This is a key requirement for modern machine learning in which the goodness of a system is measured in…

Machine Learning · Statistics 2025-01-30 Alberto Carlevaro , Teodoro Alamo , Fabrizio Dabbene , Maurizio Mongelli

Distributional reinforcement learning (RL) -- in which agents learn about all the possible long-term consequences of their actions, and not just the expected value -- is of great recent interest. One of the most important affordances of a…

Artificial Intelligence · Computer Science 2021-11-15 Chris Gagne , Peter Dayan

Although the fundamental probabilistic theory of extremes has been well developed, there are many practical considerations that must be addressed in application. The contribution of this thesis is four-fold. The first concerns the choice of…

Methodology · Statistics 2016-11-28 Brian Bader

Cross-validation (CV) is routinely used across the sciences to select models and tune parameters, and the resulting choices are often interpreted as substantive scientific conclusions (e.g., which variables, mechanisms, or risk factors are…

Methodology · Statistics 2026-02-03 Kenichiro McAlinn , Kōsaku Takanashi

This paper develops a safety analysis method for stochastic systems that is sensitive to the possibility and severity of rare harmful outcomes. We define risk-sensitive safe sets as sub-level sets of the solution to a non-standard optimal…

Systems and Control · Electrical Eng. & Systems 2022-06-28 Margaret P. Chapman , Riccardo Bonalli , Kevin M. Smith , Insoon Yang , Marco Pavone , Claire J. Tomlin

With the growing application of spatial predictive modeling in ecology, the question of how to appropriately evaluate the resulting maps has gained increasing attention. While there is consensus that map accuracy is ideally estimated using…

Methodology · Statistics 2026-05-14 Jan Linnenbrink , Jakub Nowosad , Hanna Meyer

We investigate generically applicable and intuitively appealing prediction intervals based on $k$-fold cross validation. We focus on the conditional coverage probability of the proposed intervals, given the observations in the training…

Statistics Theory · Mathematics 2022-05-13 Lukas Steinberger , Hannes Leeb

Model comparison is the cornerstone of theoretical progress in psychological research. Common practice overwhelmingly relies on tools that evaluate competing models by balancing in-sample descriptive adequacy against model flexibility, with…

Applications · Statistics 2021-10-11 Viet-Hung Dao , David Gunawan , Minh-Ngoc Tran , Robert Kohn , Guy E. Hawkins , Scott D. Brown

Hyperparameter tuning plays a crucial role in optimizing the performance of predictive learners. Cross--validation (CV) is a widely adopted technique for estimating the error of different hyperparameter settings. Repeated cross-validation…

Machine Learning · Computer Science 2023-08-01 Giovanni Maria Merola

Threshold selection plays a key role for various aspects of statistical inference of rare events. Most classical approaches tackling this problem for heavy-tailed distributions crucially depend on tuning parameters or critical values to be…

Methodology · Statistics 2019-03-07 Laura Fee Schneider , Andrea Krajina , Tatyana Krivobokova

We propose an extreme dimension reduction method extending the Extreme-PLS approach to the case where the covariate lies in a possibly infinite-dimensional Hilbert space. The ideas are partly borrowed from both Partial Least-Squares and…

Statistics Theory · Mathematics 2026-01-01 Stéphane Girard , Cambyse Pakzad