English
Related papers

Related papers: Neural-Kernelized Conditional Density Estimation

200 papers

Density estimation in high-dimensional settings is an important and challenging statistical problem.Traditional methods based on kernel smoothing are inefficient in high dimensions due to the difficulties in specifying appropriate…

Machine Learning · Statistics 2026-05-14 Ruitong Zhang , Ke Deng

Modelling statistical relationships beyond the conditional mean is crucial in many settings. Conditional density estimation (CDE) aims to learn the full conditional probability density from data. Though highly expressive, neural network…

Machine Learning · Statistics 2020-02-17 Jonas Rothfuss , Fabio Ferreira , Simon Boehm , Simon Walther , Maxim Ulrich , Tamim Asfour , Andreas Krause

Score-based causal discovery methods can effectively identify causal relationships by evaluating candidate graphs and selecting the one with the highest score. One popular class of scores is kernel-based generalized score functions, which…

Machine Learning · Computer Science 2025-06-10 Yixin Ren , Haocheng Zhang , Yewei Xia , Hao Zhang , Jihong Guan , Shuigeng Zhou

We propose an estimation method for the conditional mode when the conditioning variable is high-dimensional. In the proposed method, we first estimate the conditional density by solving quantile regressions multiple times. We then estimate…

Machine Learning · Statistics 2017-12-27 Hirofumi Ohta , Satoshi Hara

Feature matching is a challenging computer vision task that involves finding correspondences between two images of a 3D scene. In this paper we consider the dense approach instead of the more common sparse paradigm, thus striving to find…

Computer Vision and Pattern Recognition · Computer Science 2022-11-28 Johan Edstedt , Ioannis Athanasiadis , Mårten Wadenbäck , Michael Felsberg

Kernel density estimation is a popular method for estimating unseen probability distributions. However, the convergence of these classical estimators to the true density slows down in high dimensions. Moreover, they do not define meaningful…

Statistics Theory · Mathematics 2025-05-30 Jack Kendrick

Conformal prediction is a simple and powerful tool that can quantify uncertainty without any distributional assumptions. Many existing methods only address the average coverage guarantee, which is not ideal compared to the stronger…

Machine Learning · Statistics 2023-02-21 Xing Han , Ziyang Tang , Joydeep Ghosh , Qiang Liu

Simulations of complex physical systems are typically realized by discretizing partial differential equations (PDEs) on unstructured meshes. While neural networks have recently been explored for surrogate and reduced order modeling of PDE…

Machine Learning · Computer Science 2021-10-27 Jiayang Xu , Aniruddhe Pradhan , Karthik Duraisamy

The traditional kernel density estimator of an unknown density is by construction completely nonparametric, in the sense that it has no preferences and will work reasonably well for all shapes. The present paper develops a class of…

Methodology · Statistics 2026-05-05 Nils Lid Hjort , Ingrid Kristine Glad

This article proposes a novel density estimation based algorithm for carrying out supervised machine learning. The proposed algorithm features O(n) time complexity for generating a classifier, where n is the number of sampling instances in…

Machine Learning · Statistics 2007-11-06 Yen-Jen Oyang , Chien-Yu Chen , Darby Tien-Hao Chang , Chih-Peng Wu

We propose a way of transforming the problem of conditional density estimation into a single nonparametric regression task via the introduction of auxiliary samples. This allows leveraging regression methods that work well in high…

Machine Learning · Statistics 2025-11-25 Alexander G. Reisach , Olivier Collier , Alex Luedtke , Antoine Chambaz

This paper deals with nonparametric estimation of conditional den-sities in mixture models in the case when additional covariates are available. The proposed approach consists of performing a prelim-inary clustering algorithm on the…

Statistics Theory · Mathematics 2015-02-09 Stéphane Auray , Nicolas Klutchnikoff , Laurent Rouvière

Modal regression is aimed at estimating the global mode (i.e., global maximum) of the conditional density function of the output variable given input variables, and has led to regression methods robust against heavy-tailed or skewed noises.…

Machine Learning · Statistics 2019-10-21 Hiroaki Sasaki , Tomoya Sakai , Takafumi Kanamori

In this paper, we consider the problem of estimating a conditional density in moderately large dimensions. Much more informative than regression functions, conditional densities are of main interest in recent methods, particularly in the…

Methodology · Statistics 2018-01-22 Minh-Lien Jeanne Nguyen

High-dimensional covariates often admit linear factor structure. To effectively screen correlated covariates in high-dimension, we propose a conditional variable screening test based on non-parametric regression using neural networks due to…

Econometrics · Economics 2024-08-21 Jianqing Fan , Weining Wang , Yue Zhao

Conditional density estimation (CDE) goes beyond regression by modeling the full conditional distribution, providing a richer understanding of the data than just the conditional mean in regression. This makes CDE particularly useful in…

Machine Learning · Computer Science 2024-10-16 Lincen Yang , Matthijs van Leeuwen

We consider the problem of conditional density estimation, which is a major topic of interest in the fields of statistical and machine learning. Our method, called Marginal Contrastive Discrimination, MCD, reformulates the conditional…

Machine Learning · Statistics 2026-01-05 Katia Meziani , Aminata Ndiaye , Benjamin Riu

High-dimensional inference methods often rely on coefficient sparsity, an assumption that can be restrictive when signals are dense but individually weak. In such settings, valid inference may still be possible if the covariates exhibit…

Methodology · Statistics 2026-04-14 Wenjun Xiong , Yan Chen , Mingya Long , Qizhai Li

We propose a new estimation procedure of the conditional density for independent and identically distributed data. Our procedure aims at using the data to select a function among arbitrary (at most countable) collections of candidates. By…

Statistics Theory · Mathematics 2016-10-26 Mathieu Sart

We propose a novel deep neural network methodology for density estimation on product Riemannian manifold domains. In our approach, the network directly parameterizes the unknown density function and is trained using a penalized maximum…

Machine Learning · Statistics 2026-01-01 William Consagra , Zhiling Gu , Zhengwu Zhang