English
Related papers

Related papers: Estimating and backtesting risk under heavy tails

200 papers

To use machine learning in high stakes applications (e.g. medicine), we need tools for building confidence in the system and evaluating whether it is reliable. Methods to improve model reliability often require new learning algorithms (e.g.…

Machine Learning · Statistics 2019-03-04 Peter Schulam , Suchi Saria

Time series regression models are commonly used in time series analysis. However, in modern real-world applications, serially correlated data with an ultra-high dimension and fat tails are prevalent. This presents a challenge in developing…

Statistics Theory · Mathematics 2023-04-21 Linbo Liu , Danna Zhang

Value-at-Risk (VaR) estimation at high confidence levels is inherently a rare-event problem and is particularly sensitive to tail behavior and model misspecification. This paper studies the performance of two simulation-based VaR estimation…

Risk Management · Quantitative Finance 2026-01-16 Aditri

Learning-based solutions for long-tailed recognition face difficulties in generalizing on balanced test datasets. Due to imbalanced data prior, the learned \textit{a posteriori} distribution is biased toward the most frequent (head)…

Computer Vision and Pattern Recognition · Computer Science 2024-12-24 S Divakar Bhat , Amit More , Mudit Soni , Surbhi Agrawal

Power law distributions, in particular Pareto distributions, describe data across diverse areas of study. We have developed a package in R to estimate the tail index for such datasets focusing on speed (in particular with large datasets),…

Methodology · Statistics 2020-06-19 Ranjiva Munasinghe , Pathum Kossinna , Dovini Jayasinghe , Dilanka Wijeratne

We review recent progress in modeling credit risk for correlated assets. We start from the Merton model which default events and losses are derived from the asset values at maturity. To estimate the time development of the asset values, the…

Risk Management · Quantitative Finance 2018-03-02 Andreas Mühlbacher , Thomas Guhr

Expected Shortfall (ES) has been widely accepted as a risk measure that is conceptually superior to Value-at-Risk (VaR). At the same time, however, it has been criticised for issues relating to backtesting. In particular, ES has been found…

Risk Management · Quantitative Finance 2015-11-20 Susanne Emmer , Marie Kratz , Dirk Tasche

Bayesian models quantify uncertainty and facilitate optimal decision-making in downstream applications. For most models, however, practitioners are forced to use approximate inference techniques that lead to sub-optimal decisions due to…

Machine Learning · Statistics 2019-09-12 Tomasz Kuśmierczyk , Joseph Sakaya , Arto Klami

Several problems in statistics involve the combination of high-variance unbiased estimators with low-variance estimators that are only unbiased under strong assumptions. A notable example is the estimation of causal effects while combining…

Methodology · Statistics 2023-05-25 Michael Oberst , Alexander D'Amour , Minmin Chen , Yuyan Wang , David Sontag , Steve Yadlowsky

We propose a new approach to mixed-frequency regressions in a high-dimensional environment that resorts to Group Lasso penalization and Bayesian techniques for estimation and inference. In particular, to improve the prediction properties of…

Econometrics · Economics 2020-06-12 Matteo Mogliani , Anna Simoni

The risk of a credit portfolio depends crucially on correlations between the probability of default (PD) in different economic sectors. Often, PD correlations have to be estimated from relatively short time series of default rates, and the…

Statistical Mechanics · Physics 2008-12-02 Bernd Rosenow , Rafael Weissbach , Frank Altrock

Many tasks are accomplished via random processes. The completion time of such a task can be profoundly affected by restart: the occasional resetting of the task's underlying random process. Consequently, determining when restart will impede…

Statistical Mechanics · Physics 2021-05-26 Iddo Eliazar , Shlomi Reuveni

Context: Expert judgement is a common method for software effort estimations in practice today. Estimators are often shown extra obsolete requirements together with the real ones to be implemented. Only one previous study has been conducted…

Software Engineering · Computer Science 2021-03-25 Lucas Gren , Richard Berntsson Svensson

In this paper, we discuss the application of extreme value theory in the context of stationary $\beta$-mixing sequences that belong to the Fr\'echet domain of attraction. In particular, we propose a methodology to construct bias-corrected…

Statistics Theory · Mathematics 2017-08-24 Valérie Chavez-Demoulin , Armelle Guillou

Credit risk prediction is an effective way of evaluating whether a potential borrower will repay a loan, particularly in peer-to-peer lending where class imbalance problems are prevalent. However, few credit risk prediction models for…

Machine Learning · Computer Science 2018-05-03 Anahita Namvar , Mohammad Siami , Fethi Rabhi , Mohsen Naderpour

Value-based reinforcement-learning algorithms have shown strong results in games, robotics, and other real-world applications. Overestimation bias is a known threat to those algorithms and can sometimes lead to dramatic performance…

Machine Learning · Computer Science 2024-08-13 Martin Waltz , Ostap Okhrin

Over-fitting is a dreaded foe in challenge-based competitions. Because participants rely on public leaderboards to evaluate and refine their models, there is always the danger they might over-fit to the holdout data supporting the…

High-dimensional data subject to heavy-tailed phenomena and heterogeneity are commonly encountered in various scientific fields and bring new challenges to the classical statistical methods. In this paper, we combine the asymmetric square…

Statistics Theory · Mathematics 2019-10-02 Jun Zhao , Guan'ao Yan , Yi Zhang

A divide-and-conquer cryptanalysis can often be mounted against some keystream generators composed of several (nonlinear) independent devices combined by a Boolean function. In particular, any parity-check relation derived from the periods…

Cryptography and Security · Computer Science 2009-04-29 Anne Canteaut , Maria Naya-Plasencia

Probabilistic rounding error analysis can yield much sharper bounds than classical worst-case theory, but existing results typically rely on zero-mean rounding errors and often leave the confidence parameter implicit. This work revisits…

Computation · Statistics 2026-03-10 Sahil Bhola , Karthik Duraisamy