English
Related papers

Related papers: On Optimization over Tail Distributions

200 papers

The rate of uniform convergence in extreme value statistics is non-universal and can be arbitrarily slow. Further, the relative error can be unbounded in the tail of the approximation, leading to difficulty in extrapolating the extreme…

Statistics Theory · Mathematics 2014-12-05 Ashivni Shekhawat

In this paper, we present a new framework to obtain tail inequalities for sums of random matrices. Compared with existing works, our tail inequalities have the following characteristics: 1) high feasibility--they can be used to study the…

Machine Learning · Computer Science 2019-10-10 Chao Zhang , Min-Hsiu Hsieh , Dacheng Tao

The benefits of a recently proposed method to approximate hard optimization problems are demonstrated on the graph partitioning problem. The performance of this new method, called Extremal Optimization, is compared to Simulated Annealing in…

Statistical Mechanics · Physics 2009-10-31 S. Boettcher

Extreme economic outcomes are not shaped by tails alone. They are also shaped by unequal access to opportunities. This paper develops a theory of heterogeneous extremes by taking the distribution of opportunity access as the object of…

Theoretical Economics · Economics 2026-03-24 I. Sebastian Buhai

Causal inference for extreme events has many potential applications in fields such as climate science, medicine and economics. We study the extremal quantile treatment effect of a binary treatment on a continuous, heavy-tailed outcome.…

Methodology · Statistics 2023-07-06 David Deuber , Jinzhou Li , Sebastian Engelke , Marloes H. Maathuis

We consider a group of computation units trying to cooperatively solve a distributed optimization problem with shared linear equality and inequality constraints. Assuming that the computation units are communicating over a network whose…

Optimization and Control · Mathematics 2019-06-06 Simon Michalowsky , Bahman Gharesifard , Christian Ebenbauer

In extreme value inference it is a fundamental problem how the target value is required to be extreme by the extreme value theory. In iid settings this study both theoretically and numerically compares tail estimators, which are based on…

Statistics Theory · Mathematics 2024-09-04 Taku Moriyama

We consider a project that consists of activities to be performed in parallel under various temporal constraints, which include start-start, start-finish and finish-start precedence relationships, release times, deadlines, and due dates.…

Optimization and Control · Mathematics 2016-12-23 N. Krivulin

This paper establishes the functional convergence of the Extreme Nelson--Aalen and Extreme Kaplan--Meier estimators, which are designed to capture the heavy-tailed behaviour of censored losses. The resulting limit representations can be…

Methodology · Statistics 2024-08-22 Martin Bladt , Christoffer Øhlenschlæger

Nonconvex optimal-control problems governed by evolution problems in infinite-dimensional spaces (as e.g. parabolic boundary-value problems) needs a continuous (and possibly also smooth) extension on some (preferably convex)…

Optimization and Control · Mathematics 2021-02-02 Tomáš Roubíček

Superquantiles have recently gained significant interest as a risk-aware metric for addressing fairness and distribution shifts in statistical learning and decision making problems. This paper introduces a fast, scalable and robust…

Optimization and Control · Mathematics 2026-03-26 Jake Roth , Ying Cui

In existing distributed stochastic optimization studies, it is usually assumed that the gradient noise has a bounded variance. However, recent research shows that the heavy-tailed noise, which allows an unbounded variance, is closer to…

Optimization and Control · Mathematics 2025-05-15 Jun Hu , Chao Sun , Bo Chen , Jianzheng Wang , Zheming Wang

At high levels, the asymptotic distribution of a stationary, regularly varying Markov chain is conveniently given by its tail process. The latter takes the form of a geometric random walk, the increment distribution depending on the sign of…

Methodology · Statistics 2014-12-11 Holger Drees , Johan Segers , Michał Warchoł

The optimal fluctuation approach is applied to study the most distant (non-universal) tails of the free-energy distribution function P(F) for an elastic string (of a large but finite length L) interacting with a quenched random potential. A…

Disordered Systems and Neural Networks · Physics 2009-11-13 I. V. Kolokolov , S. E. Korshunov

Heavy tailed distributions present a tough setting for inference. They are also common in industrial applications, particularly with Internet transaction datasets, and machine learners often analyze such data without considering the biases…

Applications · Statistics 2016-10-14 Matt Taddy , Hedibert Freitas Lopes , Matt Gardner

We propose a variational tail bound for norms of random vectors under moment assumptions on their one-dimensional marginals. A simplified version of the bound that parametrizes the ``aggregating distribution'' using a certain pushforward of…

Probability · Mathematics 2026-02-02 Sohail Bahmani

This paper addresses the problem of estimating the tail index of distributions with heavy, Pareto-type tails for dependent data, that is of interest in the areas of finance, insurance, environmental monitoring and teletraffic analysis. A…

Methodology · Statistics 2010-05-25 Stilian A Stoev , George Michailidis

Understanding multivariate dependencies in both the bulk and the tails of a distribution is an important problem for many applications, such as ensuring algorithms are robust to observations that are infrequent but have devastating effects.…

Methodology · Statistics 2022-09-21 Yuting Ng , Ali Hasan , Vahid Tarokh

Many econometric models can be analyzed as finite mixtures. We focus on two-component mixtures and we show that they are nonparametrically point identified by a combination of an exclusion restriction and tail restrictions. Our…

Econometrics · Economics 2021-02-15 Marc Henry , Koen Jochmans , Bernard Salanié

Probabilistic forecasts are typically obtained using state-of-the-art statistical and machine learning models, with model parameters estimated by optimizing a proper scoring rule over a set of training data. If the model class is not…

Applications · Statistics 2026-05-05 Jakob Benjamin Wessel , Maybritt Schillinger , Frank Kwasniok , Sam Allen