English
Related papers

Related papers: Worst-case Nonparametric Bounds for the Student T-…

200 papers

We address the problem of learning an unknown smooth function and its derivatives from noisy pointwise evaluations under the supremum norm. While classical nonparametric regression provides a strong theoretical foundation, traditional…

Machine Learning · Computer Science 2026-03-10 Davide Maran , Marcello Restelli

The aim of this paper is to provide several novel upper bounds on the excess risk with a primal focus on classification problems. We suggest two approaches and the obtained bounds are represented via the distribution dependent local…

Statistics Theory · Mathematics 2018-03-13 Nikita Zhivotovskiy

We consider a heat conduction problem $S$ with mixed boundary conditions in a $n$-dimensional domain $\Omega$ with regular boundary and a family of problems $S_{\alpha}$ with also mixed boundary conditions in $\Omega$, where $\alpha>0$ is…

Optimization and Control · Mathematics 2021-03-30 C. M. Bollo , C. M. Gariboldi , D. A. Tarzia

Introduced by Kiefer and Wolfowitz \cite{KW56}, the nonparametric maximum likelihood estimator (NPMLE) is a widely used methodology for learning mixture odels and empirical Bayes estimation. Sidestepping the non-convexity in mixture…

Statistics Theory · Mathematics 2020-09-08 Yury Polyanskiy , Yihong Wu

Let $\{X_i\}_{i\geq1}$ be an i.i.d. sequence of random variables and define, for $n\geq2$, \[T_n=\cases{n^{-1/2}\hat{\sigma}_n^{-1}S_n,\quad \hat{\sigma}_n>0,\cr 0,\quad \hat{\sigma}_n=0,}with S_n=\sum_{i=1}^nX_i,…

Statistics Theory · Mathematics 2011-02-11 Fredrik Jonsson

We derive the unique e-values with optimal (relative) growth rate in the worst case for testing the mean of a bounded random variable, hereby contributing with the first application beyond the assumption of mutually absolutely continuous…

Statistics Theory · Mathematics 2026-01-19 Sebastian Arnold , Eugenio Clerico

We investigate the problem of semi-parametric maximum likelihood under constraints on summary statistics. Such a procedure results in a discrete probability distribution that maximises the likelihood among all such distributions under the…

Statistics Theory · Mathematics 2020-07-21 Subhro Ghosh , Sanjay Chaudhuri

Let $M_n^{(k)}$ denote the $k$th largest maximum of a sample $(X_1,X_2,...,X_n)$ from parent $X$ with continuous distribution. Assume there exist normalizing constants $a_n>0$, $b_n\in \mathbb{R}$ and a nondegenerate distribution $G$ such…

Statistics Theory · Mathematics 2008-10-06 Zuoxiang Peng , Jiaona Li , Saralees Nadarajah

We address extremum problems for spectral quantities associated with operators of the form $\Delta^2-\tau\Delta$ with Dirichlet boundary conditions, for non-negative values of $\tau$. The focus is on two shape optimisation problems:…

Analysis of PDEs · Mathematics 2025-07-10 Pedro Freitas , Roméo Leylekian

We propose upper and lower bounds on the maximum success probability for discriminating given quantum states. The proposed upper bound is obtained from a suboptimal solution to the dual problem of the corresponding optimal state…

Quantum Physics · Physics 2018-01-12 Kenji Nakahira , Tsuyoshi Sasaki Usuda , Kentaro Kato

Providing generalization guarantees for stochastic optimization algorithms remains a key challenge in learning theory. Recently, numerous works demonstrated the impact of the geometric properties of optimization trajectories on…

Machine Learning · Computer Science 2026-01-23 Mario Tuci , Lennart Bastian , Benjamin Dupuis , Nassir Navab , Tolga Birdal , Umut Şimşekli

We consider the Grenander estimator that is the maximum likelihood estimator for non-increasing densities. We prove uniform central limit theorems for certain subclasses of bounded variation functions and for H\"older balls of smoothness…

Statistics Theory · Mathematics 2015-06-29 Jakob Söhl

The reverse isoperimetric problem asks for existence and properties of bounded convex sets in a Riemannian manifold which maximise the perimeter under all those sets of fixed volume which roll freely in a ball of some given radius. If the…

Differential Geometry · Mathematics 2025-11-05 Deniz M. Hamdy , Julian Scheuer

In this note we consider the finite-dimensional parameter estimation problem associated to inverse problems. In such scenarios, one seeks to maximize the marginal likelihood associated to a Bayesian model. This latter model is connected to…

Numerical Analysis · Mathematics 2025-04-10 Ajay Jasra , Abylay Zhumekenov

This article connects the theory of extremal doubly stochastic measures to the geometry and topology of optimal transportation. We begin by reviewing an old question (# 111) of Birkhoff in probability and statistics [4], which is to give a…

Probability · Mathematics 2010-04-26 Najma Ahmad , Hwa Kil Kim , Robert J. McCann

We establish higher-order nonasymptotic expansions for a difference between probability distributions of sums of i.i.d. random vectors in a Euclidean space. The derived bounds are uniform over two classes of sets: the set of all Euclidean…

Statistics Theory · Mathematics 2022-11-30 Mayya Zhilova

An important yet challenging problem in numerical linear algebra is finding a principal submatrix with maximum determinant from a given symmetric positive semidefinite matrix. This problem arises in experimental design, statistics, and…

Optimization and Control · Mathematics 2026-05-26 Hao Hu , Stefan Sremac , Hugo J. Woerdeman , Henry Wolkowicz

For a positive integer $k$, a graph property $\mathcal{H}$, and a graph parameter $\mathcal{P}$, let $\operatorname{ex}_{\mathcal{P}}(n, \mathcal{H}; \delta \geq k)$ denote the maximum value of $\mathcal{P}$ over all $n$-vertex graphs with…

Combinatorics · Mathematics 2026-04-02 Xu Liu , Bo Ning , Tao Wang

In this paper, tight upper and lower bounds are derived on the weighted sum of minimum mean-squared errors for additive Gaussian noise channels. The bounds are obtained by constraining the input distribution to be close to a Gaussian…

Information Theory · Computer Science 2020-01-23 Michael Fauß , Abdelhak M. Zoubir , Alex Dytso , H. Vincent Poor , K. G. Nagananda

We study the sample complexity of the best-case Empirical Risk Minimizer in the setting of stochastic convex optimization. We show that there exists an instance in which the sample size is linear in the dimension, learning is possible, but…

Machine Learning · Computer Science 2026-02-10 Tal Burla , Roi Livni