English
Related papers

Related papers: Boundary Adaptive Local Polynomial Conditional Den…

200 papers

We consider the problem of calculating learning curves (i.e., average generalization performance) of Gaussian processes used for regression. On the basis of a simple expression for the generalization error, in terms of the eigenvalue…

Disordered Systems and Neural Networks · Physics 2007-05-23 Peter Sollich , Anason Halees

Active domain adaptation has emerged as a solution to balance the expensive annotation cost and the performance of trained models in semantic segmentation. However, existing works usually ignore the correlation between selected samples and…

Computer Vision and Pattern Recognition · Computer Science 2023-12-18 Shizhan Liu , Zhengkai Jiang , Yuxi Li , Jinlong Peng , Yabiao Wang , Weiyao Lin

Probabilistic Regression refers to predicting a full probability density function for the target conditional on the features. We present a nonparametric approach to this problem which combines base classifiers (typically gradient boosted…

Machine Learning · Computer Science 2022-10-31 Brian Lucena

We consider a non-parametric Bayesian model for conditional densities. The model is a finite mixture of normal distributions with covariate dependent multinomial logit mixing probabilities. A prior for the number of mixture components is…

Statistics Theory · Mathematics 2016-01-21 Andriy Norets , Debdeep Pati

Kernel estimation of a probability density function supported on the unit interval has proved difficult, because of the well known boundary bias issues a conventional kernel density estimator would necessarily face in this situation.…

Methodology · Statistics 2013-03-19 Gery Geenens

We consider the classification problem of a high-dimensional mixture of two Gaussians with general covariance matrices. Using the replica method from statistical physics, we investigate the asymptotic behavior of a general class of…

Machine Learning · Statistics 2024-10-29 Hanwen Huang , Peng Zeng

We study an unbiased estimator for the density of a sum of random variables that are simulated from a computer model. A numerical study on examples with copula dependence is conducted where the proposed estimator performs favourably in…

Statistics Theory · Mathematics 2018-09-19 Patrick J. Laub , Robert Salomone , Zdravko I. Botev

Estimating boundary curves has many applications such as economics, climate science, and medicine. Bayesian trend filtering has been developed as one of locally adaptive smoothing methods to estimate the non-stationary trend of data. This…

Methodology · Statistics 2023-11-13 Takahiro Onizuka , Fumiya Iwashige , Shintaro Hashimoto

We consider uniform moment convergence of lag-window spectral density estimates for univariate and multivariate stationary processes. Optimal rates of convergence are obtained under mild and easily verifiable conditions. Our theory…

Methodology · Statistics 2015-05-15 Wei Biao Wu , Paolo Zaffaroni

We examine theoretical properties of the denoising score matching estimate. We model the density of observations with a nonparametric Gaussian mixture. We significantly relax the standard manifold assumption allowing the samples step away…

Machine Learning · Computer Science 2026-01-01 Konstantin Yakovlev , Nikita Puchkin

We consider Bayesian inference problems with computationally intensive likelihood functions. We propose a Gaussian process (GP) based method to approximate the joint distribution of the unknown parameters and the data. In particular, we…

Computation · Statistics 2018-03-15 Hongqiao Wang , Jinglai Li

In the regression framework, the empirical measure based on the responses resulting from the nearest neighbors, among the covariates, to a given point $x$ is introduced and studied as a central statistical quantity. First, the associated…

Statistics Theory · Mathematics 2024-04-11 François Portier

This paper considers the problem of computing Bayesian estimates of both states and model parameters for nonlinear state-space models. Generally, this problem does not have a tractable solution and approximations must be utilised. In this…

Machine Learning · Statistics 2020-12-15 Jarrad Courts , Johannes Hendriks , Adrian Wills , Thomas Schön , Brett Ninness

This paper addresses the problem of detecting boundary points and estimating the sampling density of a dataset derived from a compact manifold with boundary, potentially in the presence of noise. We extend recent advances in doubly…

Statistics Theory · Mathematics 2026-04-03 Dhruv Kohli , Jesse He , Chester Holtz , Alexander Cloninger , Gal Mishne

When modeling a probability distribution with a Bayesian network, we are faced with the problem of how to handle continuous variables. Most previous work has either solved the problem by discretizing, or assumed that the data are generated…

Machine Learning · Computer Science 2013-02-21 George H. John , Pat Langley

This paper describes a new Bayesian interpretation of a class of skew--Student $t$ distributions. We consider a hierarchical normal model with unknown covariance matrix and show that by imposing different restrictions on the parameter…

Methodology · Statistics 2018-05-25 Abdolnasser Sadeghkhani

We estimate on a compact interval densities with isolated irregularities, such as discontinuities or discontinuities in some derivatives. From independent and identically distributed observations we construct a kernel estimator with…

Statistics Theory · Mathematics 2024-07-16 Céline Duval , Émeline Schmisser

We provide a new approach to approximate emulation of large computer experiments. By focusing expressly on desirable properties of the predictive equations, we derive a family of local sequential design schemes that dynamically define the…

Methodology · Statistics 2014-10-13 Robert B. Gramacy , Daniel W. Apley

In numerous applications data are observed at random times and an estimated graph of the spectral density may be relevant for characterizing and explaining phenomena. By using a wavelet analysis, one derives a nonparametric estimator of the…

Statistics Theory · Mathematics 2009-11-27 Jean-Marc Bardet , Pierre Bertrand

We develop a novel asymptotic theory for local polynomial extremum estimators of time-varying parameters in a broad class of nonlinear time series models. We show the proposed estimators are consistent and follow normal distributions in…

Econometrics · Economics 2025-07-25 Dennis Kristensen , Young Jun Lee