English
Related papers

Related papers: Nonparametric Probabilistic Regression with Coarse…

200 papers

Probability density estimation is a core problem of statistics and signal processing. Moment methods are an important means of density estimation, but they are generally strongly dependent on the choice of feasible functions, which severely…

Machine Learning · Statistics 2023-07-06 Guangyu Wu , Anders Lindquist

The fundamental task of general density estimation $p(x)$ has been of keen interest to machine learning. In this work, we attempt to systematically characterize methods for density estimation. Broadly speaking, most of the existing methods…

Various problems in Engineering and Statistics require the computation of the likelihood ratio function of two probability densities. In classical approaches the two densities are assumed known or to belong to some known parametric family.…

Signal Processing · Electrical Eng. & Systems 2019-11-06 George V. Moustakides , Kalliopi Basioti

Doubly robust estimators of causal effects are a popular means of estimating causal effects. Such estimators combine an estimate of the conditional mean of the outcome given treatment and confounders (the so-called outcome regression) with…

Methodology · Statistics 2019-01-17 David Benkeser , Weixin Cai , Mark J van der Laan

Quantifying uncertainty in predictions or, more generally, estimating the posterior conditional distribution, is a core challenge in machine learning and statistics. We introduce Convex Nonparanormal Regression (CNR), a conditional…

Machine Learning · Statistics 2021-09-15 Yonatan Woodbridge , Gal Elidan , Ami Wiesel

Kernel density estimation is a key component of a wide variety of algorithms in machine learning, Bayesian inference, stochastic dynamics and signal processing. However, the unsupervised density estimation technique requires tuning a…

Machine Learning · Computer Science 2025-12-17 Sunia Tanweer , Firas A. Khasawneh

Background modelling is one of the main challenges in particle physics data analysis. Commonly employed strategies include the use of simulated events of the background processes, and the fitting of parametric background models to the…

High Energy Physics - Experiment · Physics 2022-10-19 A. Chisholm , T. Neep , K. Nikolopoulos , R. Owen , E. Reynolds , J. Silva

The estimation of the ratio of two density probability functions is of great interest in many statistics fields, including causal inference. In this study, we develop an ensemble estimator of density ratios with a novel loss function based…

Machine Learning · Statistics 2024-08-12 Wencheng Wu , David Benkeser

A nonparanormal graphical model is a semiparametric generalization of a Gaussian graphical model for continuous variables in which it is assumed that the variables follow a Gaussian graphical model only after some unknown smooth monotone…

Methodology · Statistics 2021-02-23 Jami J. Mulgrave , Subhashis Ghosal

Given i.i.d. data from an unknown distribution, we consider the problem of predicting future items. An adaptive way to estimate the probability density is to recursively subdivide the domain to an appropriate data-dependent granularity. A…

Statistics Theory · Mathematics 2007-06-13 Marcus Hutter

Probabilistic prediction aims to compute predictive distributions rather than single point predictions. These distributions enable practitioners to quantify uncertainty, compute risk, and detect outliers. However, most probabilistic methods…

Machine Learning · Computer Science 2024-10-23 Nicolas Beltran-Velez , Alessandro Antonio Grande , Achille Nazaret , Alp Kucukelbir , David Blei

In unsupervised learning, dimensionality reduction is an important tool for data exploration and visualization. Because these aims are typically open-ended, it can be useful to frame the problem as looking for patterns that are enriched in…

Machine Learning · Statistics 2018-11-16 Kristen Severson , Soumya Ghosh , Kenney Ng

Nonparametric learning is a fundamental concept in machine learning that aims to capture complex patterns and relationships in data without making strong assumptions about the underlying data distribution. Owing to simplicity and…

Machine Learning · Computer Science 2024-02-06 Amartya Banerjee , Christopher J. Hazard , Jacob Beel , Cade Mack , Jack Xia , Michael Resnick , Will Goddin

We study non-parametric regression estimates for random fields. The data satisfies certain strong mixing conditions and is defined on the regular $N$-dimensional lattice structure. We show consistency and obtain rates of convergence. The…

Statistics Theory · Mathematics 2018-07-06 Johannes T. N. Krebs

High concentration episodes for NO$_2$ are increasingly dealt with by authorities through traffic restrictions which are activated when air quality deteriorates beyond certain thresholds. Foreseeing the probability that pollutant…

Applications · Statistics 2020-03-26 Sebastián Pérez Vasseur , José L. Aznarte

It is often of interest to assess whether a function-valued statistical parameter, such as a density function or a mean regression function, is equal to any function in a class of candidate null parameters. This can be framed as a…

Methodology · Statistics 2023-06-14 Aaron Hudson

We study prediction-powered conditional inference in the setting where labeled data are scarce, unlabeled covariates are abundant, and a black-box machine-learning predictor is available. The goal is to perform statistical inference on…

Machine Learning · Statistics 2026-03-09 Yang Sui , Jin Zhou , Hua Zhou , Xiaowu Dai

Predictive recursion is an accurate and computationally efficient algorithm for nonparametric estimation of mixing densities in mixture models. In semiparametric mixture models, however, the algorithm fails to account for any uncertainty in…

Methodology · Statistics 2015-03-19 Ryan Martin , Surya T. Tokdar

Conformal prediction is a technique for constructing prediction intervals that attain valid coverage in finite samples, without making distributional assumptions. Despite this appeal, existing conformal methods can be unnecessarily…

Methodology · Statistics 2019-05-09 Yaniv Romano , Evan Patterson , Emmanuel J. Candès

Conditional generative models map input variables to complex, high-dimensional distributions, enabling realistic sample generation in a diverse set of domains. A critical challenge with these models is the absence of calibrated uncertainty,…

Machine Learning · Computer Science 2026-02-02 Qidong Yang , Qianyu Julie Zhu , Jonathan Giezendanner , Youssef Marzouk , Stephen Bates , Sherrie Wang