English
Related papers

Related papers: The tail wags the distribution: Only sample the ta…

200 papers

Reachability analysis is a popular method to give safety guarantees for stochastic cyber-physical systems (SCPSs) that takes in a symbolic description of the system dynamics and uses set-propagation methods to compute an overapproximation…

Robotics · Computer Science 2024-07-17 Navid Hashemi , Lars Lindemann , Jyotirmoy V. Deshmukh

Thompson sampling (TS) has optimal regret and excellent empirical performance in multi-armed bandit problems. Yet, in Bayesian optimization, TS underperforms popular acquisition functions (e.g., EI, UCB). TS samples arms according to the…

Machine Learning · Statistics 2024-12-02 David Sweet

Recent works have proposed optimal subsampling algorithms to improve computational efficiency in large datasets and to design validation studies in the presence of measurement error. Existing approaches generally fall into two categories:…

Methodology · Statistics 2025-12-25 Jasper B. Yang , Thomas Lumley , Bryan E. Shepherd , Pamela A. Shaw

Test suite reduction (TSR) aims at removing redundant test cases from regression test suites. A typical TSR approach ensures that structural profile elements covered by the original test suite are also covered by the reduced test suite. It…

Software Engineering · Computer Science 2018-08-27 Chadi Trad , Rawad Abou Assi , Wes Masri

The masses of data now available have opened up the prospect of discovering weak signals using machine-learning algorithms, with a view to predictive or interpretation tasks. As this survey of recent results attempts to show, bringing…

Statistics Theory · Mathematics 2026-05-06 Stephan Clémençon , Anne Sabourin

Expected Shortfall (ES) is a coherent measure of tail risk that captures the average loss beyond a quantile threshold. Despite the growing literature on ES regression conditional on covariates, no existing work considers ES modeling in…

Methodology · Statistics 2026-04-15 Yujie Hou , Xinbing Kong , Yalin Wang , Bin Wu

The idea of slicing divergences has been proven to be successful when comparing two probability measures in various machine learning applications including generative modeling, and consists in computing the expected value of a `base…

Machine Learning · Statistics 2022-01-05 Kimia Nadjahi , Alain Durmus , Lénaïc Chizat , Soheil Kolouri , Shahin Shahrampour , Umut Şimşekli

We study the fundamental task of outlier-robust mean estimation for heavy-tailed distributions in the presence of sparsity. Specifically, given a small number of corrupted samples from a high-dimensional heavy-tailed distribution whose mean…

Data Structures and Algorithms · Computer Science 2022-11-30 Ilias Diakonikolas , Daniel M. Kane , Jasper C. H. Lee , Ankit Pensia

Sequential directional importance sampling (SDIS) is an efficient adaptive simulation method for estimating failure probabilities. It expresses the failure probability as the product of a group of integrals that are easy to estimate,…

Methodology · Statistics 2024-10-31 Kai Chenga , Iason Papaioannou , Daniel Straub

Electricity systems are experiencing increased effects of randomness and variability due to emerging stochastic assets. The increased effects introduce new uncertainties into power systems that can impact system operability and reliability.…

Systems and Control · Electrical Eng. & Systems 2022-11-10 Naeem Turner-Bandele , Amritanshu Pandey , Larry Pileggi

Probabilistic forecasts are typically obtained using state-of-the-art statistical and machine learning models, with model parameters estimated by optimizing a proper scoring rule over a set of training data. If the model class is not…

Applications · Statistics 2026-05-05 Jakob Benjamin Wessel , Maybritt Schillinger , Frank Kwasniok , Sam Allen

In recent years research on credit risk modelling has mainly focused on default probabilities. Recovery rates are usually modelled independently, quite often they are even assumed constant. Then, however, the structural connection between…

Risk Management · Quantitative Finance 2015-03-06 Alexander F. R. Koivusalo , Rudi Schäfer

Risk-limiting audits (RLAs) offer a statistical guarantee: if a full manual tally of the paper ballots would show that the reported election outcome is wrong, an RLA has a known minimum chance of leading to a full manual tally. RLAs…

Applications · Statistics 2018-09-13 Kellie Ottoboni , Philip B. Stark , Mark Lindeman , Neal McBurnett

Motivated by the prominence of Conditional Value-at-Risk (CVaR) as a measure for tail risk in settings affected by uncertainty, we develop a new formula for approximating CVaR based optimization objectives and their gradients from limited…

Methodology · Statistics 2020-08-25 Anand Deo , Karthyek Murthy

This study examines the varying coefficient model in tail index regression. The varying coefficient model is an efficient semiparametric model that avoids the curse of dimensionality when including large covariates in the model. In fact,…

Statistics Theory · Mathematics 2023-12-12 Koki Momoki , Takuma Yoshida

Probabilistic forecasts comprehensively describe the uncertainty in the unknown future outcome, making them essential for decision making and risk management. While several methods have been introduced to evaluate probabilistic forecasts,…

Methodology · Statistics 2025-05-23 Sam Allen , Jonathan Koh , Johan Segers , Johanna Ziegel

Ensemble learning is a popular technique to improve the accuracy of machine learning models. It traditionally hinges on the rationale that aggregating multiple weak models can lead to better models with lower variance and hence higher…

Optimization and Control · Mathematics 2026-01-06 Huajie Qian , Donghao Ying , Henry Lam , Wotao Yin

Despite achieving excellent performance on benchmarks, deep neural networks often underperform in real-world deployment due to sensitivity to minor, often imperceptible shifts in input data, known as distributional shifts. These shifts are…

Machine Learning · Computer Science 2025-09-25 Birk Torpmann-Hagen , Pål Halvorsen , Michael A. Riegler , Dag Johansen

We investigate the application of the Adaptive Multilevel Splitting algorithm for the estimation of tail probabilities of solutions of Stochastic Differential Equations evaluated at a given time, and of associated temporal averages. We…

Probability · Mathematics 2019-03-27 Charles-Edouard Bréhier , Tony Lelièvre

Datasets with extreme observations and/or heavy-tailed error distributions are commonly encountered and should be analyzed with careful consideration of these features from a statistical perspective. Small deviations from an assumed model,…

Methodology · Statistics 2023-01-12 Meadhbh O'Neill , Kevin Burke