English
Related papers

Related papers: Towards Model Selection for Local Log-Density Esti…

200 papers

We discuss properties of two methods for ascribing probabilities to the shape of a probability distribution. One is based on the idea of counting the number of modes of a bootstrap version of a standard kernel density estimator. We argue…

Statistics Theory · Mathematics 2007-06-13 Peter Hall , Hong Ooi

A novel computational approach to log-concave density estimation is proposed. Previous approaches utilize the piecewise-affine parametrization of the density induced by the given sample set. The number of parameters as well as non-smooth…

Computation · Statistics 2019-02-21 Fabian Rathke , Christoph Schnörr

This paper revisits the classical inference results for profile quasi maximum likelihood estimators (profile MLE) in the semiparametric estimation problem. We mainly focus on two prominent theorems: the Wilks phenomenon and Fisher expansion…

Statistics Theory · Mathematics 2014-06-18 Andreas Andresen , Vladimir Spokoiny

In this paper, we study the estimation of the threshold predictive regression model with hybrid stochastic local unit root predictors. We demonstrate the estimation procedure and derive the asymptotic distribution of the least square…

Econometrics · Economics 2023-05-16 Christis Katsouris

We investigate finite stochastic partial monitoring, which is a general model for sequential learning with limited feedback. While Thompson sampling is one of the most promising algorithms on a variety of online decision-making problems,…

Machine Learning · Statistics 2021-06-11 Taira Tsuchiya , Junya Honda , Masashi Sugiyama

The log-concave maximum likelihood estimator of a density on the real line based on a sample of size $n$ is known to attain the minimax optimal rate of convergence of $O(n^{-4/5})$ with respect to, e.g., squared Hellinger distance. In this…

Statistics Theory · Mathematics 2016-09-06 Arlene K. H. Kim , Adityanand Guntuboyina , Richard J. Samworth

A new data-based smoothing parameter for circular kernel density (and its derivatives) estimation is proposed. Following the plug-in ideas, unknown quantities on an optimal smoothing parameter are replaced by suitable estimates. This paper…

Computation · Statistics 2022-11-21 Jose Ameijeiras-Alonso

We consider estimating the density of a response conditioning on an error-prone covariate. Motivated by two existing kernel density estimators in the absence of covariate measurement error, we propose a method to correct the existing…

Methodology · Statistics 2020-01-09 Xianzheng Huang , Haiming Zhou

Welch's method provides an estimator of the power spectral density that is statistically consistent. This is achieved by averaging over periodograms calculated from overlapping segments of a time series. For a finite length time series,…

Methodology · Statistics 2024-04-12 Lachlan C. Astfalck , Adam M. Sykulski , Edward J. Cripps

Evaluating explanation techniques using human subjects is costly, time-consuming and can lead to subjectivity in the assessments. To evaluate the accuracy of local explanations, we require access to the true feature importance scores for a…

Machine Learning · Computer Science 2022-01-31 Amir Hossein Akhavan Rahnama , Judith Butepage , Pierre Geurts , Henrik Bostrom

We derive a new asymptotic expansion for the global excess risk of a local-$k$-nearest neighbour classifier, where the choice of $k$ may depend upon the test point. This expansion elucidates conditions under which the dominant contribution…

Statistics Theory · Mathematics 2019-05-21 Timothy I. Cannings , Thomas B. Berrett , Richard J. Samworth

Theoretical guarantees are established for a standard estimator in a semi-parametric finite mixture model, where each component density is modeled as a product of univariate densities under a conditional independence assumption. The focus…

Statistics Theory · Mathematics 2025-11-07 Marie Du Roy de Chaumaray , Michael Levine , Matthieu Marbac

Kernel density estimation is a key component of a wide variety of algorithms in machine learning, Bayesian inference, stochastic dynamics and signal processing. However, the unsupervised density estimation technique requires tuning a…

Machine Learning · Computer Science 2025-12-17 Sunia Tanweer , Firas A. Khasawneh

Modeling complex conditional distributions is critical in a variety of settings. Despite a long tradition of research into conditional density estimation, current methods employ either simple parametric forms or are difficult to learn in…

Machine Learning · Statistics 2018-02-15 Brian L Trippe , Richard E Turner

It is shown that the variable bandwidth density estimator proposed by McKay (1993a and b) following earlier findings by Abramson (1982) approximates density functions in $C^4(\mathbb R^d)$ at the minimax rate in the supremum norm over…

Statistics Theory · Mathematics 2013-05-07 Evarist Giné , Hailin Sang

High-dimensional data analysis has been an active area, and the main focuses have been variable selection and dimension reduction. In practice, it occurs often that the variables are located on an unknown, lower-dimensional nonlinear…

Statistics Theory · Mathematics 2012-07-31 Ming-Yen Cheng , Hau-tieng Wu

There has been growing interest in the AI community for precise uncertainty quantification. Conditional density models f(y|x), where x represents potentially high-dimensional features, are an integral part of uncertainty quantification in…

Methodology · Statistics 2021-07-26 David Zhao , Niccolò Dalmasso , Rafael Izbicki , Ann B. Lee

Many spatial models exhibit locality structures that effectively reduce their intrinsic dimensionality, enabling efficient approximation and sampling of high-dimensional distributions. However, existing approximation techniques primarily…

Machine Learning · Statistics 2026-02-02 Tiangang Cui , Shuigen Liu , Xin T. Tong

Orbital-free density functional theory promises to deliver linear-scaling electronic structure calculations. This requires the knowledge of the non-interacting kinetic-energy density functional (KEDF), which should be accurate and must…

Materials Science · Physics 2024-12-12 Michael A. J. Mitchell , Teresa Del Aguila Ferrandis , Stefano Sanvito

Log-linear models are often used to estimate the size of a closed population using capture-recapture data. When capture probabilities are related to auxiliary covariates, one may select a separate model based on each of several post-strata.…

Methodology · Statistics 2014-06-11 Zachary T. Kurtz