English
Related papers

Related papers: Stop Suppressing the Tail: Causal Inference for Ex…

200 papers

We consider estimation of the extreme value index and extreme quantiles for heavy-tailed data that are right-censored. We study a general procedure of removing low importance observations in tail estimators. This trimming procedure is…

Statistics Theory · Mathematics 2021-05-13 Martin Bladt , Hansjoerg Albrecher , Jan Beirlant

The estimation of causal effects with observational data continues to be a very active research area. In recent years, researchers have developed new frameworks which use machine learning to relax classical assumptions necessary for the…

Machine Learning · Statistics 2024-05-01 Jonathan Fuhr , Philipp Berens , Dominik Papies

Standard statistical analysis is unable to provide reliable confidence intervals on expectation values of probability distributions that do not satisfy the conditions of the central limit theorem. We present a regression-based estimator of…

Data Analysis, Statistics and Probability · Physics 2019-06-24 Pablo Lopez Rios , Gareth J. Conduit

Functional data are increasingly prevalent in biomedical research. While functional data analysis has been established for decades, causal inference with functional treatments remains largely unexplored. Existing methods typically focus on…

Methodology · Statistics 2026-02-11 Ziren Jiang , Erjia Cui , Jared D. Huling

Inference over tails is performed by applying only the results of extreme value theory. Whilst such theory is well defined and flexible enough in the univariate case, multivariate inferential methods often require the imposition of…

Methodology · Statistics 2017-08-11 Manuele Leonelli , Dani Gamerman

Conditional Value-at-Risk (CVaR) is a widely used risk-sensitive objective for learning under rare but high-impact losses, yet its statistical behavior under heavy-tailed data remains poorly understood. Unlike expectation-based risk, CVaR…

Machine Learning · Statistics 2026-02-23 Dinesh Karthik Mulumudi , Piyushi Manupriya , Gholamali Aminian , Anant Raj

By introducing a weight function into the density power divergence, we develop a new class of robust and smooth estimators for the tail index of Pareto-type distributions, offering improved efficiency in the presence of outliers. These…

Statistics Theory · Mathematics 2025-07-25 Saida Mancer , Abdelhakim Necir , Djamel Meraghni

Fine-tuning pre-trained diffusion and flow models to optimize downstream utilities is central to real-world deployment. Existing entropy-regularized methods primarily maximize expected reward, providing no mechanism to shape tail behavior.…

Machine Learning · Computer Science 2026-02-20 Zifan Wang , Riccardo De Santi , Xiaoyu Mo , Michael M. Zavlanos , Andreas Krause , Karl H. Johansson

We present a method to stop the evaluation of a prediction process when the result of the full evaluation is obvious. This trait is highly desirable in prediction tasks where a predictor evaluates all its features for every example in large…

Machine Learning · Statistics 2013-01-01 Raphael Pelossof , Zhiliang Ying

We introduce a new type of estimator for the spectral tail process of a regularly varying time series. The approach is based on a characterizing invariance property of the spectral tail process, which is incorporated into the new estimator…

Statistics Theory · Mathematics 2021-03-16 Holger Drees , Anja Janßen , Sebastian Neblung

Forecasting rare events in multivariate time-series data is challenging due to severe class imbalance, long-range dependencies, and distributional uncertainty. We introduce EVEREST, a transformer-based architecture for probabilistic…

Machine Learning · Computer Science 2026-01-29 Antanas Zilinskas , Robert N. Shorten , Jakub Marecek

Double Machine Learning is widely used to estimate causal treatment effects in large-scale observational data. The ``residuals-on-residuals'' regression estimator (RORR) is especially popular for its simplicity and computational…

Econometrics · Economics 2025-11-27 Apoorva Lal , Winston Chou

We study the problem of factor modelling vector- and tensor-valued time series in the presence of heavy tails in the data, which produce extreme observations with non-negligible probability. We propose to combine a two-step procedure for…

Methodology · Statistics 2025-09-08 Matteo Barigozzi , Haeran Cho , Hyeyoung Maeng

In econometrics, the Efficient Market Hypothesis posits that asset prices reflect all available information in the market. Several empirical investigations show that market efficiency drops when it undergoes extreme events. Many models for…

Statistical Finance · Quantitative Finance 2025-07-02 Junshu Jiang , Jordan Richards , Raphaël Huser , David Bolin

The purpose of this work is to improve the efficiency in estimating the average causal effect (ACE) on the survival scale where right-censoring exists and high-dimensional covariate information is available. We propose new estimators using…

Methodology · Statistics 2021-06-29 Ran Dai , Cheng Zheng , Mei-Jie Zhang

Learning in the combinatorially large output space of sequence generation problems is challenging as providing expert demonstrations scales poorly with sequence length, and RL struggles with sparse rewards. Between dense demonstrations in…

We propose a novel multi-task neural network approach for estimating distributional treatment effects (DTE) in randomized experiments. While DTE provides more granular insights into the experiment outcomes over conventional methods focusing…

Machine Learning · Computer Science 2025-07-11 Tomu Hirata , Undral Byambadalai , Tatsushi Oka , Shota Yasui , Shingo Uto

This work has been motivated by the challenge of the 2017 conference on Extreme-Value Analysis (EVA2017), with the goal of predicting daily precipitation quantiles at the $99.8\%$ level for each month at observed and unobserved locations.…

Methodology · Statistics 2018-02-06 Thomas Opitz , Raphaël Huser , Haakon Bakka , Håvard Rue

The natural world often follows a long-tailed data distribution where only a few classes account for most of the examples. This long-tail causes classifiers to overfit to the majority class. To mitigate this, prior solutions commonly adopt…

Machine Learning · Computer Science 2020-09-15 Rahul Duggal , Scott Freitas , Sunny Dhamnani , Duen Horng Chau , Jimeng Sun

The goal in extreme multi-label classification is to learn a classifier which can assign a small subset of relevant labels to an instance from an extremely large set of target labels. Datasets in extreme classification exhibit a long tail…

Machine Learning · Statistics 2018-03-06 Rohit Babbar , Bernhard Schölkopf