English
Related papers

Related papers: Minimax properties of Dirichlet kernel density est…

200 papers

We analyze the problem of discrete distribution estimation under $\ell_1$ loss. We provide non-asymptotic upper and lower bounds on the maximum risk of the empirical distribution (the maximum likelihood estimator), and the minimax risk in…

Information Theory · Computer Science 2015-12-31 Yanjun Han , Jiantao Jiao , Tsachy Weissman

The Chebyshev or $\ell_{\infty}$ estimator is an unconventional alternative to the ordinary least squares in solving linear regressions. It is defined as the minimizer of the $\ell_{\infty}$ objective function \begin{align*}…

Statistics Theory · Mathematics 2023-03-16 Yufei Yi , Matey Neykov

Robust inference based on the minimization of statistical divergences has proved to be a useful alternative to classical techniques based on maximum likelihood and related methods. Basu et al. (1998) introduced the density power divergence…

Statistics Theory · Mathematics 2025-02-17 Subhrajyoty Roy , Abir Sarkar , Abhik Ghosh , Ayanendranath Basu

The Blackstock-Crighton equation models nonlinear acoustic wave propagation in thermo-viscous fluids. In the present work we investigate the associated inhomogeneous Dirichlet and Neumann boundary value problems in a bounded domain and…

Analysis of PDEs · Mathematics 2015-06-10 Rainer Brunnhuber , Stefan Meyer

Consider the problem of nonparametric estimation of an unknown $\beta$-H\"older smooth density $p_{XY}$ at a given point, where $X$ and $Y$ are both $d$ dimensional. An infinite sequence of i.i.d.\ samples $(X_i,Y_i)$ are generated…

Information Theory · Computer Science 2023-08-29 Jingbo Liu

We consider a nonparametric regression setup, where the covariate is a random element in a complete separable metric space, and the parameter of interest associated with the conditional distribution of the response lies in a separable…

Statistics Theory · Mathematics 2018-11-16 Joydeep Chowdhury , Probal Chaudhuri

Regularized kernel methods such as, e.g., support vector machines and least-squares support vector regression constitute an important class of standard learning algorithms in machine learning. Theoretical investigations concerning…

Machine Learning · Statistics 2012-03-21 Robert Hable

Recent results in quantization theory show that the mean-squared expected distortion can reach a rate of convergence of $\mathcal{O}(1/n)$, where $n$ is the sample size [see, e.g., IEEE Trans. Inform. Theory 60 (2014) 7279-7292 or Electron.…

Statistics Theory · Mathematics 2015-04-02 Clément Levrard

This paper is concerned with the asymptotic stability analysis of a one dimensional wave equation with Dirichlet boundary conditions subject to a nonlinear distributed damping with an L p functional framework, p $\in$ [2, $\infty$]. Some…

Analysis of PDEs · Mathematics 2019-07-30 Yacine Chitour , Swann Marx , Christophe Prieur

Averaging provides an alternative to bandwidth selection for density kernel estimation. We propose a procedure to combine linearly several kernel estimators of a density obtained from different, possibly data-driven, bandwidths. The method…

Statistics Theory · Mathematics 2019-11-05 O. Chernova , F. Lavancier , P. Rochet

Online estimation and modelling of i.i.d. data for short sequences over large or complex "alphabets" is a ubiquitous (sub)problem in machine learning, information theory, data compression, statistical language processing, and document…

Information Theory · Computer Science 2013-05-17 Marcus Hutter

We provide matching upper and lower bounds of order $\sigma^2/\log(d/n)$ for the prediction error of the minimum $\ell_1$-norm interpolator, a.k.a. basis pursuit. Our result is tight up to negligible terms when $d \gg n$, and is the first…

Statistics Theory · Mathematics 2022-03-09 Guillaume Wang , Konstantin Donhauser , Fanny Yang

We consider a metric measure space with a local regular Dirichlet form. We establish necessary and sufficient conditions for upper heat kernel bounds with sub-diffusive space-time exponent to hold. This characterization is stable under…

Probability · Mathematics 2015-03-17 Sebastian Andres , Martin T. Barlow

This paper studies Kernel Density Estimation for a high-dimensional distribution $\rho(x)$. Traditional approaches have focused on the limit of large number of data points $n$ and fixed dimension $d$. We analyze instead the regime where…

Machine Learning · Computer Science 2024-10-21 Giulio Biroli , Marc Mézard

Consider the semiparametric transformation model $\Lambda_{\theta_o}(Y)=m(X)+\epsilon$, where $\theta_o$ is an unknown finite dimensional parameter, the functions $\Lambda_{\theta_o}$ and $m$ are smooth, $\epsilon$ is independent of $X$,…

Statistics Theory · Mathematics 2011-10-11 Rawane Samb , Cédric Heuchenne , Ingrid Van Keilegom

We study identifiability of finite mixtures of Dirichlet distributions on the interior of the simplex. We first prove a shift identity showing that every Dirichlet density can be written as a mixture of $J$ shifted Dirichlet densities,…

Statistics Theory · Mathematics 2026-03-24 Hien Duy Nguyen , Mayetri Gupta

We study the spectral properties of minimizers of the M\"uller functional for atoms and molecules with $N$ electrons and total nuclear charge $Z$. We prove that under some suitable assumptions on $Z$ and $N$, the $k$-th eigenvalue of a…

Mathematical Physics · Physics 2026-04-21 Rupert L. Frank , Long Meng , Phan Thành Nam , Heinz Siedentop

Ordinary Differential Equations (ODEs) have recently gained a lot of attention in machine learning. However, the theoretical aspects, e.g., identifiability and asymptotic properties of statistical estimation are still obscure. This paper…

Machine Learning · Statistics 2024-06-04 Yuanyuan Wang , Wei Huang , Mingming Gong , Xi Geng , Tongliang Liu , Kun Zhang , Dacheng Tao

We establish consistency and asymptotic normality of the minimum density power divergence estimator under regularity conditions different from those originally provided by Basu et al.

Statistics Theory · Mathematics 2016-08-16 Sergio F. Juárez , William R. Schucany

We solve the nonlinear Dirichlet problem (uniquely) for functions with prescribed asymptotic singularities at a finite number of points, and with arbitrary continuous boundary data, on a domain in euclidean space. The main results apply, in…

Analysis of PDEs · Mathematics 2017-12-12 F. Reese Harvey , H. Blaine Lawson