English
Related papers

Related papers: Optimal upper bounds on expected kth record values…

200 papers

Generalized t-tests are constructed under weaker than normal conditions. In the first part of this paper we assume only the symmetry (around zero) of the error distribution (i). In the second part we assume that the error distribution is a…

Statistics Theory · Mathematics 2016-08-16 Gábor J. Székely

We develop minimax optimal risk bounds for the general learning task consisting in predicting as well as the best function in a reference set $\mathcal{G}$ up to the smallest possible additive term, called the convergence rate. When the…

Statistics Theory · Mathematics 2009-09-09 Jean-Yves Audibert

We develop minimax optimal risk bounds for the general learning task consisting in predicting as well as the best function in a reference set G up to the smallest possible additive term, called the convergence rate. When the reference set…

Statistics Theory · Mathematics 2008-03-04 Jean-Yves Audibert

The study of Fourier transforms of probability measures on fractal sets plays an important role in recent research. Faster decay rates are known to yield enhanced results in areas such as metric number theory. This paper focuses on…

Classical Analysis and ODEs · Mathematics 2024-12-24 Ying Wai Lee

In this paper, we study the risk bounds for samples independently drawn from an infinitely divisible (ID) distribution. In particular, based on a martingale method, we develop two deviation inequalities for a sequence of random variables of…

Machine Learning · Statistics 2012-02-20 Chao Zhang , Dacheng Tao

In this article, we study a non-uniform distribution on permutations biased by their number of records that we call \emph{record-biased permutations}. We give several generative processes for record-biased permutations, explaining also how…

Probability · Mathematics 2026-04-01 Mathilde Bouvel , Cyril Nicaud , Carine Pivoteau

This paper focuses on nonparametric statistical inference of the hazard rate function of discrete distributions based on $\delta$-record data. We derive the explicit expression of the maximum likelihood estimator and determine its exact…

Statistics Theory · Mathematics 2025-04-03 Martín Alcalde , Miguel Lafuente , F. Javier López , Lina Maldonado , Gerardo Sanz

In this paper, we derive generic bounds on the maximum deviations in prediction errors for sequential prediction via an information-theoretic approach. The fundamental bounds are shown to depend only on the conditional entropy of the data…

Machine Learning · Computer Science 2021-05-12 Song Fang , Quanyan Zhu

We find explicit and optimal upper bounds for the expected occupation density for an It\^o-process when its drift and diffusion coefficients are unknown under boundedness and ellipticity conditions on the coefficients. This is related to…

Probability · Mathematics 2023-10-20 Paul Krühner , Shijie Xu

We study the problem of discrete distribution estimation in KL divergence and provide concentration bounds for the Laplace estimator. We show that the deviation from mean scales as $\sqrt{k}/n$ when $n \ge k$, improving upon the best prior…

Machine Learning · Statistics 2023-06-14 Clément L. Canonne , Ziteng Sun , Ananda Theertha Suresh

The estimation of information measures of continuous distributions based on samples is a fundamental problem in statistics and machine learning. In this paper, we analyze estimates of differential entropy in $K$-dimensional Euclidean space,…

Information Theory · Computer Science 2021-11-29 Georg Pichler , Pablo Piantanida , Günther Koliander

We address the problem of producing a lower bound for the mean of a discrete probability distribution, with known support over a finite set of real numbers, from an iid sample of that distribution. Up to a constant, this is equivalent to…

Statistics Theory · Mathematics 2025-02-25 Erik Learned-Miller

Diffusion models are a new class of generative models that revolve around the estimation of the score function associated with a stochastic differential equation. Subsequent to its acquisition, the approximated score function is then…

Statistics Theory · Mathematics 2024-09-13 Giovanni Conforti , Alain Durmus , Marta Gentiloni Silveri

We consider the maximum coding rate achievable by uniformly-random codes for the deletion channel. We prove an upper bound that's within 0.1 of the best known lower bounds for all values of the deletion probability $d,$ and much closer for…

Information Theory · Computer Science 2022-10-17 Berivan Isik , Francisco Pernice , Tsachy Weissman

In this paper, we investigate the supremum-norm generalization error and the uniform inference for a specific class of kernel regression methods, namely the kernel gradient flows. Under the widely adopted capacity-source condition framework…

Statistics Theory · Mathematics 2026-05-08 Yuqian Cheng , Zhuo Chen , Qian Lin

The performance of kernel density estimators is usually studied via Taylor expansions and asymptotic approximation arguments, in which the bandwidth parameter tends to zero with increasing sample size. In contrast, this paper focusses…

Statistics Theory · Mathematics 2026-02-25 Nils Lid Hjort , Nikolai G. Ushakov

We study a localized notion of uniform convergence known as an "optimistic rate" (Panchenko 2002; Srebro et al. 2010) for linear regression with Gaussian data. Our refined analysis avoids the hidden constant and logarithmic factor in…

Machine Learning · Statistics 2021-12-09 Lijia Zhou , Frederic Koehler , Danica J. Sutherland , Nathan Srebro

Upper and lower bounds are derived for the mode(s) of the negative binomial distribution of order k, type I, with parameters r and p, which are employed to establish an explicit formula for the mode(s) in terms of r and k when p equals 0.5.…

Probability · Mathematics 2017-02-09 Costas Georghiou , Andreas N. Philippou , Zaharias M. Psillakis

We present a generalization of the maximal inequalities that upper bound the expectation of the maximum of $n$ jointly distributed random variables. We control the expectation of a randomly selected random variable from $n$ jointly…

Probability · Mathematics 2017-08-31 Jiantao Jiao , Yanjun Han , Tsachy Weissman

The first order loss function and its complementary function are extensively used in practical settings. When the random variable of interest is normally distributed, the first order loss function can be easily expressed in terms of the…

Optimization and Control · Mathematics 2014-09-09 Roberto Rossi , S. Armagan Tarim , Steven Prestwich , Brahim Hnich