English
Related papers

Related papers: Evaluation of binary classifiers for asymptoticall…

200 papers

When data are right-censored, i.e. some outcomes are missing due to a limited period of observation, survival analysis can compute the "time to event". Multiple classes of outcomes lead to a classification variant: predicting the most…

Artificial Intelligence · Computer Science 2024-06-21 Julie Alberge , Vincent Maladière , Olivier Grisel , Judith Abécassis , Gaël Varoquaux

With the increasing deployment of machine learning models in many socially sensitive tasks, there is a growing demand for reliable and trustworthy predictions. One way to accomplish these requirements is to allow a model to abstain from…

Machine Learning · Computer Science 2024-09-19 Andrea Pugnana , Lorenzo Perini , Jesse Davis , Salvatore Ruggieri

Marginal expected shortfall is unquestionably one of the most popular systemic risk measures. Studying its extreme behaviour is particularly relevant for risk protection against severe global financial market downturns. In this context,…

Statistics Theory · Mathematics 2023-04-18 Simone A. Padoan , Stefano Rizzelli , Matteo Schiavone

We introduce a simple but effective method for managing risk in model-based reinforcement learning with trajectory sampling that involves probabilistic safety constraints and balancing of optimism in the face of epistemic uncertainty and…

Machine Learning · Computer Science 2023-09-12 Marin Vlastelica , Sebastian Blaes , Cristina Pineri , Georg Martius

We discuss the use of likelihood asymptotics for inference on risk measures in univariate extreme value problems, focusing on estimation of high quantiles and similar summaries of risk for uncertainty quantification. We study whether…

Methodology · Statistics 2021-01-28 Léo R. Belzile , Anthony C. Davison

We use extreme value theory to estimate the probability of successive exceedances of a threshold value of a time-series of an observable on several classes of chaotic dynamical systems. The observables have either a Fr\'echet (fat-tailed)…

Dynamical Systems · Mathematics 2023-11-07 Meagan Carney , Mark Holland , Matthew Nicol , Phuong Tran

Many organizations face critical decisions that rely on forecasts of binary events. In these situations, organizations often gather forecasts from multiple experts or models and average those forecasts to produce a single aggregate…

Causal effect estimation seeks to determine the impact of an intervention from observational data. However, the existing causal inference literature primarily addresses treatment effects on frequently occurring events. But what if we are…

Machine Learning · Statistics 2025-06-18 Jiyuan Tan , Jose Blanchet , Vasilis Syrgkanis

Extreme weather events epitomize high cost: to society through their physical impacts, and to computer servers that simulate them to assess risk and advance physical understanding. It costs hundreds of simulation years to sample a few…

Atmospheric and Oceanic Physics · Physics 2026-04-14 Justin Finkel , Paul A. O'Gorman

A binary classifier capable of abstaining from making a label prediction has two goals in tension: minimizing errors, and avoiding abstaining unnecessarily often. In this work, we exactly characterize the best achievable tradeoff between…

Machine Learning · Computer Science 2016-11-30 Akshay Balsubramani

We consider regularly varying random vectors. Our goal is to estimate in a non-parametric way some characteristics related to conditioning on an extreme event, like the tail dependence coefficient. We introduce a quasi-spectral…

Methodology · Statistics 2015-02-26 Rafał Kulik , Zhigang Tong

In this article there is no intention to repeat basic concepts about risk management, but we will try to define why often is usefull the time series analysis during the assessment of risks, and how is possible to compute a significative…

Applications · Statistics 2016-01-13 Gianluca Rosso

Extreme events, such as market crashes, natural disasters, and pandemics, are rare but catastrophic, often triggering cascading failures across interconnected systems. Accurate prediction and early warning can help minimize losses and…

Machine Learning · Computer Science 2025-06-10 Jingyi Gu , Xuan Zhang , Guiling Wang

Most classification methods provide either a prediction of class membership or an assessment of class membership probability. In the case of two-group classification the predicted probability can be described as "risk" of belonging to a…

Machine Learning · Statistics 2011-10-28 Yizhar Toren

We propose a spectral clustering algorithm for analyzing the dependence structure of multivariate extremes. More specifically, we focus on the asymptotic dependence of multivariate extremes characterized by the angular or spectral measure…

Machine Learning · Statistics 2023-08-02 Marco Avella Medina , Richard A. Davis , Gennady Samorodnitsky

We consider deep multivariate models for heterogeneous collections of random variables. In the context of computer vision, such collections may e.g. consist of images, segmentations, image attributes, and latent variables. When developing…

Machine Learning · Computer Science 2026-02-03 Dmitrij Schlesinger , Boris Flach , Alexander Shekhovtsov

The problem of identifying the most discriminating features when performing supervised learning has been extensively investigated. In particular, several methods for variable selection in model-based classification have been proposed.…

Applications · Statistics 2020-12-16 Andrea Cappozzo , Francesca Greselin , Thomas Brendan Murphy

In studies of media coverage of extreme climate events, NLP methods have become indispensable for identifying relevant texts in large news databases. Still, enough annotated data to train accurate deep learning-based classifiers from…

Computation and Language · Computer Science 2026-05-06 Brielen Madureira , Mariana Madruga de Brito , Andreas Niekler

Class imbalance poses new challenges when it comes to classifying data streams. Many algorithms recently proposed in the literature tackle this problem using a variety of data-level, algorithm-level, and ensemble approaches. However, there…

Machine Learning · Computer Science 2023-07-19 Gabriel Aguiar , Bartosz Krawczyk , Alberto Cano

The structure of data organization is widely recognized as having a substantial influence on the efficacy of machine learning algorithms, particularly in binary classification tasks. Our research provides a theoretical framework suggesting…

Machine Learning · Computer Science 2024-07-15 Fei Jing , Zi-Ke Zhang , Yi-Cheng Zhang , Qingpeng Zhang