English
Related papers

Related papers: Optimal upper bounds on expected kth record values…

200 papers

Mazucheli et al. (2019) introduced the unit-Gompertz (UG) distribution and studied some of its properties. More specifically, they considered the random variable X =exp(-Y), where Y has the Gompertz distribution. In this paper, we consider…

Statistics Theory · Mathematics 2023-09-26 Ehsan Ormoz , Zuber Akhter , Mahfooz Alam , S. M. T. K. MirMostafae

We consider the problem of minimizing a continuous function f over a compact set K. We analyze a hierarchy of upper bounds proposed by Lasserre in [SIAM J. Optim. 21(3) (2011), pp. 864--885], obtained by searching for an optimal probability…

Optimization and Control · Mathematics 2015-09-09 Etienne de Klerk , Monique Laurent , Zhao Sun

Hyperparameter tuning is a common technique for improving the performance of neural networks. Most techniques for hyperparameter search involve an iterated process where the model is retrained at every iteration. However, the expected…

Machine Learning · Computer Science 2022-08-18 Dan Navon , Alex M. Bronstein

This paper addresses the statistical problem of estimating the infinite-norm deviation from the empirical mean to the distribution mean for high-dimensional distributions on $\{0,1\}^d$, potentially with $d=\infty$. Unlike traditional…

Statistics Theory · Mathematics 2024-02-21 Moïse Blanchard , Václav Voráček

We consider the prediction error of linear regression with L1 regularization when the number of covariates p is large relative to the sample size n. When the model is k-sparse and well-specified, and restricted isometry or similar…

Statistics Theory · Mathematics 2011-08-02 Rina Foygel , Nathan Srebro

We study the optimal rates of convergence for estimating a prior distribution over a VC class from a sequence of independent data sets respectively labeled by independent target functions sampled from the prior. We specifically derive upper…

Machine Learning · Computer Science 2015-05-21 Liu Yang , Steve Hanneke , Jaime Carbonell

The extreme cases of risk measures, when considered within the context of distributional ambiguity, provide significant guidance for practitioners specializing in risk management of quantitative finance and insurance. In contrast to the…

Risk Management · Quantitative Finance 2025-07-01 Yuting Su , Taizhong Hu , Zhenfeng Zou

The extreme statistics of time signals is studied when the maximum is measured from the initial value. In the case of independent, identically distributed (iid) variables, we classify the limiting distribution of the maximum according to…

Statistical Mechanics · Physics 2009-11-13 T. W. Burkhardt , G. Gyorgyi , N. R. Moloney , Z. Racz

We present a distribution optimization framework that significantly improves confidence bounds for various risk measures compared to previous methods. Our framework encompasses popular risk measures such as the entropic risk measure,…

Machine Learning · Computer Science 2023-06-13 Hao Liang , Zhi-quan Luo

Let $X_1,\ldots,X_n$ be independent identically distributed random vectors in $\mathbb{R}^d$. We consider upper bounds on $\max_x \mathbb{P}(a_1X_1+\cdots+a_nX_n=x)$ under various restrictions on $X_i$ and the weights $a_i$. When…

Probability · Mathematics 2020-08-04 Tomas Juškevičius , Valentas Kurauskas

Integrative analysis of multiple datasets for estimating optimal individualized treatment rules (ITRs) can enhance decision efficiency. A central challenge is posterior shift, wherein the conditional distribution of potential outcomes given…

Machine Learning · Statistics 2026-03-09 Wenhai Cui , Wen Su , Xingqiu Zhao

Recently, the notion of implicit extreme value distributions has been established, which is based on a given loss function $f \ge 0$. From an application point of view, one is rather interested in extreme loss events that occur relative to…

Probability · Mathematics 2019-08-20 Dustin Kremer

In this note, we provide upper bounds on the expectation of the supremum of empirical processes indexed by H\"older classes of any smoothness and for any distribution supported on a bounded set in $\mathbb R^d$. These results can be…

Statistics Theory · Mathematics 2020-12-18 Nicolas Schreuder

The angular measure on the unit sphere characterizes the first-order dependence structure of the components of a random vector in extreme regions and is defined in terms of standardized margins. Its statistical recovery is an important step…

Statistics Theory · Mathematics 2022-10-18 Stéphan Clémençon , Hamid Jalalzai , Stéphane Lhaut , Anne Sabourin , Johan Segers

This work examines risk bounds for nonparametric distributional regression estimators. For convex-constrained distributional regression, general upper bounds are established for the continuous ranked probability score (CRPS) and the…

Hu and Mehta (2024) posed an open problem: what is the optimal instance-dependent rate for the stochastic decision-theoretic online learning (with $K$ actions and $T$ rounds) under $\varepsilon$-differential privacy? Before, the best known…

Machine Learning · Computer Science 2025-06-19 Ruihan Wu , Yu-Xiang Wang

We derive concentration inequalities for the supremum norm of the difference between a kernel density estimator (KDE) and its point-wise expectation that hold uniformly over the selection of the bandwidth and under weaker conditions on the…

Statistics Theory · Mathematics 2020-01-01 Jisu Kim , Jaehyeok Shin , Alessandro Rinaldo , Larry Wasserman

We present novel bounds for estimating discrete probability distributions under the $\ell_\infty$ norm. These are nearly optimal in various precise senses, including a kind of instance-optimality. Our data-dependent convergence guarantees…

Statistics Theory · Mathematics 2024-02-14 Aryeh Kontorovich , Amichai Painsky

We present a framework for the theoretical analysis of ensembles of low-complexity empirical risk minimisers trained on independent random compressions of high-dimensional data. First we introduce a general distribution-dependent…

Machine Learning · Computer Science 2021-06-03 Henry W. J. Reeve , Ata Kaban

In this note, we provide an explicit upper bound for $h_K \mathcal{R}_K d_K^{-1/2}$ which depends on an effective constant in the error term of the Ideal Theorem.

Number Theory · Mathematics 2022-07-26 Olivier Bordellès