English
Related papers

Related papers: Bernstein-type dimension-free concentration for se…

200 papers

Statistical inferences for quadratic functionals of linear regression parameter have found wide applications including signal detection, global testing, inferences of error variance and fraction of variance explained. Classical theory based…

Statistics Theory · Mathematics 2020-06-17 Xiao Guo , Guang Cheng

Stochastic linear bandits with high-dimensional sparse features are a practical model for a variety of domains, including personalized medicine and online advertising. We derive a novel $\Omega(n^{2/3})$ dimension-free minimax regret lower…

Machine Learning · Statistics 2021-09-07 Botao Hao , Tor Lattimore , Mengdi Wang

We present a constructive approach to Bernstein copulas with an admissible discrete skeleton in arbitrary dimensions when the underlying marginal grid sizes are smaller than the number of observations. This prevents an overfitting of the…

Risk Management · Quantitative Finance 2021-03-04 Dietmar Pfeifer , Olena Ragulina

For a fixed positive integer $\;k,\;$ limit laws of linearly normalized $\;k$-th upper order statistics are well known. In this article, a comprehensive study of tail behaviours of limit laws of normalized $k$-th upper order statistics…

Probability · Mathematics 2015-12-11 Sreenivasan Ravi , Mandagere Chandrashekhar Manohar

We study high-dimensional signal recovery from non-linear measurements with design vectors having elliptically symmetric distribution. Special attention is devoted to the situation when the unknown signal belongs to a set of low statistical…

Statistics Theory · Mathematics 2016-11-14 Larry Goldstein , Stanislav Minsker , Xiaohan Wei

As an alternative to the well-known methods of "chaining" and "bracketing" that have been developed in the study of random fields, a new method, which is based on a stochastic maximal inequality derived by using the Taylor expansion, is…

Probability · Mathematics 2020-08-03 Yoichi Nishiyama

The tail-dependence compatibility problem is introduced. It raises the question whether a given $d\times d$-matrix of entries in the unit interval is the matrix of pairwise tail-dependence coefficients of a $d$-dimensional random vector.…

Probability · Mathematics 2016-06-28 Paul Embrechts , Marius Hofert , Ruodu Wang

We consider the setting of online linear regression for arbitrary deterministic sequences, with the square loss. We are interested in the aim set by Bartlett et al. (2015): obtain regret bounds that hold uniformly over all competitor…

Machine Learning · Statistics 2019-02-26 Pierre Gaillard , Sébastien Gerchinovitz , Malo Huard , Gilles Stoltz

This article introduces a general class of heavy-tailed autoregressions for modeling integer-valued time series with outliers. The proposed specification is based on a heavy-tailed mixture of negative binomial distributions that features an…

Statistics Theory · Mathematics 2019-09-09 Paolo Gorgi

We propose a novel probabilistic model to facilitate the learning of multivariate tail dependence of multiple financial assets. Our method allows one to construct from known random vectors, e.g., standard normal, sophisticated joint…

Risk Management · Quantitative Finance 2020-01-14 Xing Yan , Qi Wu , Wen Zhang

Freedman's inequality is a supermartingale counterpart to Bennett's inequality. This result shows that the tail probabilities of a supermartingale is controlled by the quadratic characteristic and a uniform upper bound for the…

Probability · Mathematics 2017-08-03 Xiequan Fan , Ion Grama , Quansheng Liu

This paper considers the problem of regression over distributions, which is becoming increasingly important in machine learning. Existing approaches often ignore the geometry of the probability space or are computationally expensive. To…

Machine Learning · Computer Science 2025-10-31 Maksim Maslov , Alexander Kugaevskikh , Matthew Ivanov

We investigate high-dimensional sparse regression when both the noise and the design matrix exhibit heavy-tailed behavior. Standard algorithms typically fail in this regime, as heavy-tailed covariates distort the empirical risk geometry. We…

Methodology · Statistics 2026-01-12 Kaiyuan Zhou , Xiaoyu Zhang , Wenyang Zhang , Di Wang

We modify the classical Bernstein's inequality for the sums of independent centered random variables (r.v.) in the terms of relative tails or moments. We built also some examples in order to show the exactness of offered results.

Probability · Mathematics 2022-06-03 M. R. Formica , E. Ostrovsky , L. Sirota

The aim of this paper is to give a precise asymptotic description of some eigenvalue statistics stemming from random matrix theory. More precisely, we consider random determinants of the GUE, Laguerre, Uniform Gram and Jacobi beta ensembles…

Probability · Mathematics 2017-07-25 Martina Dal Borgo , Emma Hovhannisyan , Alain Rouault

We study the $\textit{single-index bandit}$ problem, where rewards depend on an unknown one-dimensional projection of high-dimensional contexts through an unknown reward function. This model extends linear and generalized linear bandits to…

Machine Learning · Statistics 2026-05-12 Devdan Dey , Sujoy Bhore , Avishek Ghosh

We are concerned with obtaining novel concentration inequalities for the missing mass, i.e. the total probability mass of the outcomes not observed in the sample. We not only derive - for the first time - distribution-free Bernstein-like…

Machine Learning · Statistics 2015-06-22 Bahman Yari Saeed Khanloo , Gholamreza Haffari

We construct an optimal exponential tail decreasing confidence region for an unknown density of distribution in the Lebesgue-Riesz as well as in the uniform} norm, built on the sample of the random vectors based of the famous recursive…

Statistics Theory · Mathematics 2024-09-04 Maria Rosaria Formica , Eugeny Ostrovsky , Leonid Sirota

We analyze the problem of sequential probability assignment for binary outcomes with side information and logarithmic loss, where regret---or, redundancy---is measured with respect to a (possibly infinite) class of experts. We provide upper…

Information Theory · Computer Science 2015-01-30 Alexander Rakhlin , Karthik Sridharan

We prove a new concentration inequality for U-statistics of order two for uniformly ergodic Markov chains. Working with bounded and $\pi$-canonical kernels, we show that we can recover the convergence rate of Arcones and Gin{\'e} who proved…

Probability · Mathematics 2022-03-21 Quentin Duchemin , Yohann de Castro , Claire Lacour