English
Related papers

Related papers: On multiplicative bias correction in kernel densit…

200 papers

Subsampling methods aim to select a subsample as a surrogate for the observed sample. Such methods have been used pervasively in large-scale data analytics, active learning, and privacy-preserving analysis in recent decades. Instead of…

Machine Learning · Statistics 2022-06-03 Jingyi Zhang , Cheng Meng , Jun Yu , Mengrui Zhang , Wenxuan Zhong , Ping Ma

This work studies how to estimate the mean-field density of large-scale systems in a distributed manner. Such problems are motivated by the recent swarm control technique that uses mean-field approximations to represent the collective…

Systems and Control · Electrical Eng. & Systems 2021-12-21 Tongjia Zheng , Qing Han , Hai Lin

A new data-based smoothing parameter for circular kernel density (and its derivatives) estimation is proposed. Following the plug-in ideas, unknown quantities on an optimal smoothing parameter are replaced by suitable estimates. This paper…

Computation · Statistics 2022-11-21 Jose Ameijeiras-Alonso

Kernel mean embeddings are a popular tool that consists in representing probability measures by their infinite-dimensional mean embeddings in a reproducing kernel Hilbert space. When the kernel is characteristic, mean embeddings can be used…

Machine Learning · Computer Science 2021-06-29 Boris Muzellec , Francis Bach , Alessandro Rudi

We consider quantile estimation in a semi-supervised setting, characterized by two available data sets: (i) a small or moderate sized labeled data set containing observations for a response and a set of possibly high dimensional covariates,…

Methodology · Statistics 2024-08-15 Abhishek Chakrabortty , Guorong Dai , Raymond J. Carroll

This paper studies an intriguing phenomenon related to the good generalization performance of estimators obtained by using large learning rates within gradient descent algorithms. First observed in the deep learning literature, we show that…

Machine Learning · Statistics 2022-06-06 Gaspard Beugnot , Julien Mairal , Alessandro Rudi

We propose two approaches to estimate semiparametric discrete choice models for bundles. Our first approach is a kernel-weighted rank estimator based on a matching-based identification strategy. We establish its complete asymptotic…

Econometrics · Economics 2024-12-18 Fu Ouyang , Thomas Tao Yang

We propose two approaches to estimate semiparametric discrete choice models for bundles. Our first approach is a kernel-weighted rank estimator based on a matching-based identification strategy. We establish its complete asymptotic…

Econometrics · Economics 2024-12-18 Fu Ouyang , Thomas T. Yang

This paper presents a new perspective on the identification at infinity for the intercept of the sample selection model as identification at the boundary via a transformation of the selection index. This perspective suggests generalizations…

Econometrics · Economics 2023-02-13 Zhewen Pan

In a smooth semi-parametric model, the marginal posterior distribution for a finite dimensional parameter of interest is expected to be asymptotically equivalent to the sampling distribution of any efficient point-estimator. The assertion…

Statistics Theory · Mathematics 2018-03-26 Minwoo Chae , Yongdai Kim , Bas Kleijn

Density Ratio Estimation has attracted attention from the machine learning community due to its ability to compare the underlying distributions of two datasets. However, in some applications, we want to compare distributions of random…

Machine Learning · Statistics 2020-06-26 Song Liu , Yulong Zhang , Mingxuan Yi , Mladen Kolar

In this paper, we study a class of non-parametric density estimators under Bayesian settings. The estimators are piecewise constant functions on binary partitions. We analyze the concentration rate of the posterior distribution under a…

Statistics Theory · Mathematics 2015-08-21 Linxi Liu , Wing Hung Wong

Nonparametric curve estimation by kernel methods has attracted widespread interest in theoretical and applied statistics. One area of conflict between theory and application relates to the evaluation of the performance of the estimators.…

Statistics Theory · Mathematics 2026-03-03 Olaf Gefeller , Nils Lid Hjort

Given a set of points $P\subset \mathbb{R}^{d}$ and a kernel $k$, the Kernel Density Estimate at a point $x\in\mathbb{R}^{d}$ is defined as $\mathrm{KDE}_{P}(x)=\frac{1}{|P|}\sum_{y\in P} k(x,y)$. We study the problem of designing a data…

Data Structures and Algorithms · Computer Science 2018-09-03 Moses Charikar , Paris Siminelakis

We introduce a novel conditional density estimation model termed the conditional density operator (CDO). It naturally captures multivariate, multimodal output densities and shows performance that is competitive with recent neural…

Machine Learning · Computer Science 2019-10-30 Ingmar Schuster , Mattes Mollenhauer , Stefan Klus , Krikamol Muandet

Estimating the score, i.e., the gradient of log density function, from a set of samples generated by an unknown distribution is a fundamental task in inference and learning of probabilistic models that involve flexible yet intractable…

Machine Learning · Statistics 2020-07-01 Yuhao Zhou , Jiaxin Shi , Jun Zhu

Bias in datasets can be very detrimental for appropriate statistical estimation. In response to this problem, importance weighting methods have been developed to match any biased distribution to its corresponding target unbiased…

Machine Learning · Computer Science 2022-09-12 Antoine de Mathelin , Francois Deheeger , Mathilde Mougeot , Nicolas Vayatis

We consider selection of random predictors for high-dimensional regression problem with binary response for a general loss function. Important special case is when the binary model is semiparametric and the response function is misspecified…

Statistics Theory · Mathematics 2020-02-19 Mariusz Kubkowski , Jan Mielniczuk

Density level sets can be estimated using plug-in methods, excess mass algorithms or a hybrid of the two previous methodologies. The plug-in algorithms are based on replacing the unknown density by some nonparametric estimator, usually the…

Statistics Theory · Mathematics 2016-11-26 A. Rodríguez-Casal , P. Saavedra-Nieves

We study non-parametric estimation of an unknown density with support in R (respectively R+). The proposed estimation procedure is based on the projection on finite dimensional subspaces spanned by the Hermite (respectively the Laguerre)…

Statistics Theory · Mathematics 2020-01-30 Sergio Brenner Miguel , Jan Johannes