English
Related papers

Related papers: Recursive density estimators based on Robbins-Monr…

200 papers

The horseshoe prior, defined as a half Cauchy scale mixture of normal, provides a state of the art approach to Bayesian sparse signal recovery. We provide a new representation of the horseshoe density as a scale mixture of the Laplace…

Methodology · Statistics 2023-01-04 Ksheera Sagar , Anindya Bhadra

Additive regression models have a long history in multivariate nonparametric regression. They provide a model in which each regression function depends only on a single explanatory variable allowing to obtain estimators at the optimal…

Methodology · Statistics 2015-09-16 Graciela Boente , Alejandra Martinez

We develop a general class of Bayesian repulsive Gaussian mixture models that encourage well-separated clusters, aiming at reducing potentially redundant components produced by independent priors for locations (such as the Dirichlet…

Methodology · Statistics 2017-10-24 Fangzheng Xie , Yanxun Xu

Estimating the score, i.e., the gradient of log density function, from a set of samples generated by an unknown distribution is a fundamental task in inference and learning of probabilistic models that involve flexible yet intractable…

Machine Learning · Statistics 2020-07-01 Yuhao Zhou , Jiaxin Shi , Jun Zhu

We study an unbiased estimator for the density of a sum of random variables that are simulated from a computer model. A numerical study on examples with copula dependence is conducted where the proposed estimator performs favourably in…

Statistics Theory · Mathematics 2018-09-19 Patrick J. Laub , Robert Salomone , Zdravko I. Botev

Given $iid$ observations from an unknown absolute continuous distribution defined on some domain $\Omega$, we propose a nonparametric method to learn a piecewise constant function to approximate the underlying probability density function.…

Machine Learning · Statistics 2018-03-13 Dangna Li , Kun Yang , Wing Hung Wong

In this paper we refine the procedure proposed by Lin et al. (2015) to estimate the density at a given quantile based on a resampling method. The approach consists on generating multiple samples of the zero-mean Gaussian variable from which…

Applications · Statistics 2025-09-04 Beatriz Farah , Aurélien Latouche , Olivier Bouaziz

We consider mixed finite element approximation of a singularly perturbed fourth-order elliptic problem with two different boundary conditions, and present a new measure of the error, whose components are balanced with respect to the…

Numerical Analysis · Mathematics 2016-09-16 Shaohong Du , Runchang Lin , Zhimin Zhang

We introduce a new approach for estimating the invariant density of a multidimensional diffusion when dealing with high-frequency observations blurred by independent noises. We consider the intermediate regime, where observations occur at…

Statistics Theory · Mathematics 2024-04-19 Raphaël Maillet , Grégoire Szymanski

Using a perturbation technique, we derive a new approximate filtering and smoothing methodology generalizing along different directions several existing approaches to robust filtering based on the score and the Hessian matrix of the…

Methodology · Statistics 2023-06-06 Giuseppe Buccheri , Giacomo Bormetti , Fulvio Corsi , Fabrizio Lillo

We examine a wide class of stochastic approximation algorithms for solving (stochastic) nonlinear problems on Riemannian manifolds. Such algorithms arise naturally in the study of Riemannian optimization, game theory and optimal transport,…

Optimization and Control · Mathematics 2022-12-29 Mohammad Reza Karimi , Ya-Ping Hsieh , Panayotis Mertikopoulos , Andreas Krause

The order of smoothness chosen in nonparametric estimation problems is critical. This choice balances the tradeoff between model parsimony and data overfitting. The most common approach used in this context is cross-validation. However,…

Methodology · Statistics 2015-10-13 Daniel Taylor-Rodriguez , Sujit Ghosh

This study proposes a recursive and easy-to-implement algorithm to compute the score and Hessian matrix in general regime-switching models. We use simulation to compare the asymptotic variance estimates constructed from the Hessian matrix…

Econometrics · Economics 2026-01-13 Chaojun Li , Shi Qiu

The estimation of the ratio of two density probability functions is of great interest in many statistics fields, including causal inference. In this study, we develop an ensemble estimator of density ratios with a novel loss function based…

Machine Learning · Statistics 2024-08-12 Wencheng Wu , David Benkeser

In this work, we use the Belief Function Theory which extends the probabilistic framework in order to provide uncertainty bounds to different categories of crowd density estimators. Our method allows us to compare the multi-scale…

Computer Vision and Pattern Recognition · Computer Science 2019-02-11 Jennifer Vandoni , Emanuel Aldea , Sylvie Le Hégarat-Mascle

Given i.i.d samples from some unknown continuous density on hyper-rectangle $[0, 1]^d$, we attempt to learn a piecewise constant function that approximates this underlying density non-parametrically. Our density estimate is defined on a…

Machine Learning · Statistics 2015-09-24 Kun Yang , Hao Su , Wing Hung Wang

We derive and analyze a generic, recursive algorithm for estimating all splits in a finite cluster tree as well as the corresponding clusters. We further investigate statistical properties of this generic clustering algorithm when it…

Machine Learning · Statistics 2021-11-02 Ingo Steinwart , Bharath K. Sriperumbudur , Philipp Thomann

This paper studies a method, which has been proposed in the Physics literature by [8, 7, 10], for estimating the quasi-stationary distribution. In contrast to existing methods in eigenvector estimation, the method eliminates the need for…

Probability · Mathematics 2014-01-03 Jose Blanchet , Peter Glynn , Shuheng Zheng

A two-class mixture model, where the density of one of the components is known, is considered. We address the issue of the nonparametric adaptive estimation of the unknown probability density of the second component. We propose a randomly…

Statistics Theory · Mathematics 2021-02-08 Gaelle Chagny , Antoine Channarond , Van Ha Hoang , Angelina Roche

Probabilistic Regression refers to predicting a full probability density function for the target conditional on the features. We present a nonparametric approach to this problem which combines base classifiers (typically gradient boosted…

Machine Learning · Computer Science 2022-10-31 Brian Lucena