English
Related papers

Related papers: Tail Analysis without Parametric Models: A Worst-c…

200 papers

Affine policies (or control) are widely used as a solution approach in dynamic optimization where computing an optimal adjustable solution is usually intractable. While the worst case performance of affine policies can be significantly bad,…

Optimization and Control · Mathematics 2019-10-15 Omar El Housni , Vineet Goyal

The problem of regression extrapolation, or out-of-distribution generalization, arises when predictions are required at test points outside the range of the training data. In such cases, the non-parametric guarantees for regression methods…

Methodology · Statistics 2024-10-31 Gloria Buriticá , Sebastian Engelke

A simple way of obtaining robust estimates of the "center" (or the "location") and of the "scatter" of a dataset is to use the maximum likelihood estimate with a class of heavy-tailed distributions, regardless of the "true" distribution…

Statistics Theory · Mathematics 2023-11-28 Pavol Ševera

We propose a novel approach for detecting change points in high-dimensional linear regression models. Unlike previous research that relied on strict Gaussian/sub-Gaussian error assumptions and had prior knowledge of change points, we…

Methodology · Statistics 2024-05-22 Bin Liu , Zhengling Qi , Xinsheng Zhang , Yufeng Liu

We study random design linear regression with no assumptions on the distribution of the covariates and with a heavy-tailed response variable. In this distribution-free regression setting, we show that boundedness of the conditional second…

Statistics Theory · Mathematics 2022-02-25 Jaouad Mourtada , Tomas Vaškevičius , Nikita Zhivotovskiy

By introducing a weight function into the density power divergence, we develop a new class of robust and smooth estimators for the tail index of Pareto-type distributions, offering improved efficiency in the presence of outliers. These…

Statistics Theory · Mathematics 2025-07-25 Saida Mancer , Abdelhakim Necir , Djamel Meraghni

A strategy is proposed for characterizing the worst-case performance of algorithms for solving nonconvex smooth optimization problems. Contemporary analyses characterize worst-case performance by providing, under certain assumptions on an…

Optimization and Control · Mathematics 2018-08-28 Frank E. Curtis , Daniel P. Robinson

In this paper, we propose a reduced-bias estimator of the EVI for Pareto-type tails (heavy-tailed) distributions. This is derived using the weighted least squares method. It is shown that the estimator is unbiased, consistent and…

Methodology · Statistics 2022-04-12 E. Ocran , R. Minkah , K. Doku-Amponsah

Accurate channel modeling plays a pivotal role in optimizing communication systems, and fitting field measurements to stochastic models is crucial for capturing the key propagation features and to map these to achievable system…

Signal Processing · Electrical Eng. & Systems 2025-03-10 Santiago Fernández , José David Vega-Sánchez , Juan E. Galeote-Cazorla , F. Javier López-Martínez

Consider $n$ real/complex, independent/dependent random variables with respective tail bounds and $g$ a measurable function of the r.v.'s. Consider $f$ the "sharpest" tail bound of $g$ (sharpest in the sense that if $f$ were any less, then…

Probability · Mathematics 2026-05-26 Stephen Jordan Harrison

We address the problem of learning an unknown smooth function and its derivatives from noisy pointwise evaluations under the supremum norm. While classical nonparametric regression provides a strong theoretical foundation, traditional…

Machine Learning · Computer Science 2026-03-10 Davide Maran , Marcello Restelli

We present new algorithms for online convex optimization over unbounded domains that obtain parameter-free regret in high-probability given access only to potentially heavy-tailed subgradient estimates. Previous work in unbounded domains…

Machine Learning · Statistics 2023-02-28 Jiujia Zhang , Ashok Cutkosky

We develop an econometric framework integrating heavy-tailed Student's $t$ distributions with behavioral probability weighting while preserving infinite divisibility. Using 432{,}752 observations across 86 assets (2004--2024), we…

Mathematical Finance · Quantitative Finance 2025-11-21 Akash Deep , Svetlozar T. Rachev , Frank J. Fabozzi

We propose and analyze a new estimator of the covariance matrix that admits strong theoretical guarantees under weak assumptions on the underlying distribution, such as existence of moments of only low order. While estimation of covariance…

Statistics Theory · Mathematics 2018-01-17 Stanislav Minsker , Xiaohan Wei

Tail dependence models for distributions attracted to a max-stable law are fitted using observations above a high threshold. To cope with spatial, high-dimensional data, a rank-based M-estimator is proposed relying on bivariate margins…

Methodology · Statistics 2015-01-12 John Einmahl , Anna Kiriliouk , Andrea Krajina , Johan Segers

Probabilistic forecasts are typically obtained using state-of-the-art statistical and machine learning models, with model parameters estimated by optimizing a proper scoring rule over a set of training data. If the model class is not…

Applications · Statistics 2026-05-05 Jakob Benjamin Wessel , Maybritt Schillinger , Frank Kwasniok , Sam Allen

Stochastic-approximation gradient methods are attractive for large-scale convex optimization because they offer inexpensive iterations. They are especially popular in data-fitting and machine-learning applications where the data arrives in…

Optimization and Control · Mathematics 2014-01-09 Michael P. Friedlander , Gabriel Goh

Asymptotic theory of tail index estimation has been studied extensively in the frequentist literature on extreme values, but rarely in the Bayesian context. We investigate whether popular Bayesian kernel mixture models are able to support…

Statistics Theory · Mathematics 2018-04-19 Cheng Li , Lizhen Lin , David B. Dunson

The paper presents an efficient method for simulating the tails of a target variable Z=h(X) which depends on a set of basic variables X=(X_1, ..., X_n). To this aim, variables X_i, i=1, ..., n are sequentially simulated in such a manner…

Artificial Intelligence · Computer Science 2013-02-18 Enrique F. Castillo , Cristina Solares , Patricia Gomez

Using tail bounds, we introduce a new probabilistic condition for function estimation in stochastic derivative-free optimization which leads to a reduction in the number of samples and eases algorithmic analyses. Moreover, we develop simple…

Optimization and Control · Mathematics 2023-06-16 Francesco Rinaldi , Luis Nunes Vicente , Damiano Zeffiro