English
Related papers

Related papers: Conditional density estimation in a regression set…

200 papers

We study the problem of bivariate discrete or continuous probability density estimation under low-rank constraints.For discrete distributions, we assume that the two-dimensional array to estimate is a low-rank probability matrix. In the…

Statistics Theory · Mathematics 2024-10-23 Julien Chhor , Olga Klopp , Alexandre Tsybakov

We consider the problem of conditional density estimation, which is a major topic of interest in the fields of statistical and machine learning. Our method, called Marginal Contrastive Discrimination, MCD, reformulates the conditional…

Machine Learning · Statistics 2026-01-05 Katia Meziani , Aminata Ndiaye , Benjamin Riu

In this paper, we study the problem of pointwise estimation of a multivariate density. We provide a data-driven selection rule from the family of kernel estimators and derive for it a pointwise oracle inequality. Using the latter bound, we…

Statistics Theory · Mathematics 2015-09-21 Gilles Rebelles

Conditional density estimation generalizes regression by modeling a full density f(yjx) rather than only the expected value E(yjx). This is important for many tasks, including handling multi-modality and generating prediction intervals.…

Methodology · Statistics 2012-06-26 Michael P. Holmes , Alexander G. Gray , Charles Lee Isbell

Non-linear latent variable models have become increasingly popular in a variety of applications. However, there has been little study on theoretical properties of these models. In this article, we study rates of posterior contraction in…

Statistics Theory · Mathematics 2017-01-27 Shuang Zhou , Debdeep Pati , Anirban Bhattacharya , David Dunson

This article is dedicated to the estimation of the regression function when the explanatory variable is a weakly dependent process whose correlation coefficient exhibits exponential decay and has a known bounded density function. The…

Statistics Theory · Mathematics 2025-07-17 Karine Bertin , Lisandro Fermin , Miguel Padrino

Conditional density estimation (CDE) models can be useful for many statistical applications, especially because the full conditional density is estimated instead of traditional regression point estimates, revealing more information about…

Methodology · Statistics 2021-07-12 Alex Akira Okuno , Felipe Maia Polo

We consider the problem of adaptive inference on a regression function at a point under a multivariate nonparametric regression setting. The regression function belongs to a H\"older class and is assumed to be monotone with respect to some…

Statistics Theory · Mathematics 2020-12-01 Koohyun Kwon , Soonwoo Kwon

Should prediction models always deliver a prediction? In the pursuit of maximum predictive performance, critical considerations of reliability and fairness are often overshadowed, particularly when it comes to the role of uncertainty.…

Machine Learning · Computer Science 2024-10-29 Anna Sokol , Nuno Moniz , Nitesh Chawla

This paper considers extensions of minimum-disparity estimators to the problem of estimating parameters in a regression model that is conditionally specified; that is where a parametric model describes the distribution of a response $y$…

Statistics Theory · Mathematics 2016-02-10 Giles Hooker

This paper deals with non-parametric density estimation on $\bR^2$ from i.i.d observations. It is assumed that after unknown rotation of the coordinate system the coordinates of the observations are independent random variables whose…

Statistics Theory · Mathematics 2020-02-26 Lepski O. V. , Rebelles G

Given a set of empirical observations, conditional density estimation aims to capture the statistical relationship between a conditional variable $\mathbf{x}$ and a dependent variable $\mathbf{y}$ by modeling their conditional probability…

Machine Learning · Statistics 2019-04-16 Jonas Rothfuss , Fabio Ferreira , Simon Walther , Maxim Ulrich

In this paper we consider regression problems subject to arbitrary noise in the operator or design matrix. This characterization appropriately models many physical phenomena with uncertainty in the regressors. Although the problem has been…

Computation · Statistics 2021-04-08 Richard J Clancy , Stephen Becker

We present a structured additive regression approach to model conditional densities given scalar covariates, where only samples of the conditional distributions are observed. This links our approach to distributional regression models for…

Methodology · Statistics 2025-10-17 Eva-Maria Maier , Alexander Fottner , Sonja Greven , Almond Stöcker

Under a single-index regression assumption, we introduce a new semiparametric procedure to estimate a conditional density of a censored response. The regression model can be seen as a generalization of Cox regression model and also as a…

Statistics Theory · Mathematics 2009-03-22 Olivier Bouaziz , Olivier Lopez

In various applications of regression analysis, in addition to errors in the dependent observations also errors in the predictor variables play a substantial role and need to be incorporated in the statistical modeling process. In this…

Statistics Theory · Mathematics 2020-09-03 Katharina Proksch , Nicolai Bissantz , Hajo Holzmann

The research is about a systematic investigation on the following issues. First, we construct different outcome regression-based estimators for conditional average treatment effect under, respectively, true (oracle), parametric,…

Statistics Theory · Mathematics 2020-09-23 Lu Li , Niwen Zhou , Lixing Zhu

We consider a non-parametric Bayesian model for conditional densities. The model is a finite mixture of normal distributions with covariate dependent multinomial logit mixing probabilities. A prior for the number of mixture components is…

Statistics Theory · Mathematics 2016-01-21 Andriy Norets , Debdeep Pati

We propose a way of transforming the problem of conditional density estimation into a single nonparametric regression task via the introduction of auxiliary samples. This allows leveraging regression methods that work well in high…

Machine Learning · Statistics 2025-11-25 Alexander G. Reisach , Olivier Collier , Alex Luedtke , Antoine Chambaz

Confidence sets play a fundamental role in statistical inference. In this paper, we consider confidence intervals for high dimensional linear regression with random design. We first establish the convergence rates of the minimax expected…

Statistics Theory · Mathematics 2015-11-30 T. Tony Cai , Zijian Guo