English
Related papers

Related papers: Density Estimation with Distribution Element Trees

200 papers

Deep neural networks lack interpretability and tend to be overconfident, which poses a serious problem in safety-critical applications like autonomous driving, medical imaging, or machine vision tasks with high demands on reliability.…

Computer Vision and Pattern Recognition · Computer Science 2024-03-27 Steven Landgraf , Kira Wursthorn , Markus Hillemann , Markus Ulrich

One of the popular measures of central tendency that provides better representation and interesting insights of the data compared to the other measures like mean and median is the metric mode. If the analytical form of the density function…

Machine Learning · Computer Science 2019-06-04 Chandramouli Kamanchi , Raghuram Bharadwaj Diddigi , Prabuchandran K. J. , Shalabh Bhatnagar

Tree-based priors for probability distributions are usually specified using a predetermined, data-independent collection of candidate recursive partitions of the sample space. To characterize an unknown target density in detail over the…

Methodology · Statistics 2025-04-14 Li Ma , Benedetta Bruni

Given i.i.d. data from an unknown distribution, we consider the problem of predicting future items. An adaptive way to estimate the probability density is to recursively subdivide the domain to an appropriate data-dependent granularity. A…

Probability · Mathematics 2009-12-30 Marcus Hutter

Stochastic Differential Equations (SDEs) serve as a powerful modeling tool in various scientific domains, including systems science, engineering, and ecological science. While the specific form of SDEs is typically known for a given…

Methodology · Statistics 2024-02-27 Xin Cai , Jingyu Yang , Zhibao Li , Hongqiao Wang , Miao Huang

In order to develop reliable services using machine learning, it is important to understand the uncertainty of the model outputs. Often the probability distribution that the prediction target follows has a complex shape, and a mixture…

Machine Learning · Computer Science 2021-05-11 Ryuichi Kanoh , Tomu Yanabe

Deep learning models frequently make incorrect predictions with high confidence when presented with test examples that are not well represented in their training dataset. We propose a novel and straightforward approach to estimate…

Machine Learning · Computer Science 2019-10-04 Tiago Ramalho , Miguel Miranda

In this paper we provide new methodology for inference of the geometric features of a multivariate density in deconvolution. Our approach is based on multiscale tests to detect significant directional derivatives of the unknown density at…

Methodology · Statistics 2016-11-21 Konstantin Eckle , Nicolai Bissantz , Holger Dette

Sampling is an important tool for estimating large, complex sums and integrals over high dimensional spaces. For instance, important sampling has been used as an alternative to exact methods for inference in belief networks. Ideally, we…

Artificial Intelligence · Computer Science 2013-01-18 Luis E. Ortiz , Leslie Pack Kaelbling

[Abridged] We present a novel technique, dubbed FiEstAS, to estimate the underlying density field from a discrete set of sample points in an arbitrary multidimensional space. FiEstAS assigns a volume to each point by means of a binary tree.…

Astrophysics · Physics 2009-11-10 Y. Ascasibar , J. Binney

We present sparse tree-based and list-based density estimation methods for binary/categorical data. Our density estimation models are higher dimensional analogies to variable bin width histograms. In each leaf of the tree (or list), the…

Machine Learning · Statistics 2023-11-16 Siong Thye Goh , Lesia Semenova , Cynthia Rudin

A random set is a generalisation of a random variable, i.e. a set-valued random variable. The random set theory allows a unification of other uncertainty descriptions such as interval variable, mass belief function in Dempster-Shafer theory…

Numerical Analysis · Mathematics 2018-11-27 Truong-Vinh Hoang , Hermann G. Matthies

A prominent family of methods for learning data distributions relies on density ratio estimation (DRE), where a model is trained to $\textit{classify}$ between data samples and samples from some reference distribution. DRE-based models can…

Machine Learning · Computer Science 2024-11-01 Shahar Yadin , Noam Elata , Tomer Michaeli

We introduce a broadly applicable statistical procedure for testing which parametric distribution family generated a random sample of data. The method, termed the Difference in Differential Entropy (DDE) test, provides a unified framework…

Econometrics · Economics 2025-12-15 Ron Mittelhammer , George Judge , Miguel Henry

We consider statistical inference in the density estimation model using a tree-based Bayesian approach, with Optional P\'olya trees as prior distribution. We derive near-optimal convergence rates for corresponding posterior distributions…

Statistics Theory · Mathematics 2021-10-12 Ismaël Castillo , Thibault Randrianarisoa

Conditional density estimation (CDE) goes beyond regression by modeling the full conditional distribution, providing a richer understanding of the data than just the conditional mean in regression. This makes CDE particularly useful in…

Machine Learning · Computer Science 2024-10-16 Lincen Yang , Matthijs van Leeuwen

We present a local density estimator based on first order statistics. To estimate the density at a point, $x$, the original sample is divided into subsets and the average minimum sample distance to $x$ over all such subsets is used to…

Methodology · Statistics 2014-12-10 Vikram V. Garg , Luis Tenorio , Karen Willcox

Conditional density estimation (CDE) models can be useful for many statistical applications, especially because the full conditional density is estimated instead of traditional regression point estimates, revealing more information about…

Methodology · Statistics 2021-07-12 Alex Akira Okuno , Felipe Maia Polo

The clusters of a distribution are often defined by the connected components of a density level set. However, this definition depends on the user-specified level. We address this issue by proposing a simple, generic algorithm, which uses an…

Methodology · Statistics 2015-10-29 Ingo Steinwart

Given i.i.d samples from some unknown continuous density on hyper-rectangle $[0, 1]^d$, we attempt to learn a piecewise constant function that approximates this underlying density non-parametrically. Our density estimate is defined on a…

Machine Learning · Statistics 2015-09-24 Kun Yang , Hao Su , Wing Hung Wang