English
Related papers

Related papers: Kernel Conditional Exponential Family

200 papers

The paper considers nonparametric kernel density/regression estimation from a stochastic optimization point of view. The estimation problem is represented through a family of stochastic optimization problems. Recursive constrained…

Statistics Theory · Mathematics 2024-09-05 Vladimir Norkin , Vladimir Kirilyuk

We present a new non-parametric estimator of the conditional density of the kernel type. It is based on an efficient transformation of the data by quantile transform. By use of the copula representation, it turns out to have a remarkable…

Methodology · Statistics 2008-06-13 Olivier P. Faugeras

We propose a method to infer causal structures containing both discrete and continuous variables. The idea is to select causal hypotheses for which the conditional density of every variable, given its causes, becomes smooth. We define a…

Machine Learning · Statistics 2009-10-30 Dominik Janzing , Xiaohai Sun , Bernhard Schoelkopf

Conditional expectiles are becoming an increasingly important tool in finance as well as in other areas of applications. We analyse a support vector machine type approach for estimating conditional expectiles and establish learning rates…

Machine Learning · Statistics 2017-02-28 Muhammad Farooq , Ingo Steinwart

We introduce Neural Conditional Probability (NCP), an operator-theoretic approach to learning conditional distributions with a focus on statistical inference tasks. NCP can be used to build conditional confidence regions and extract key…

Machine Learning · Computer Science 2025-06-03 Vladimir R. Kostic , Karim Lounici , Gregoire Pacreau , Pietro Novelli , Giacomo Turri , Massimiliano Pontil

Neural Processes (NPs) are a family of conditional generative models that are able to model a distribution over functions, in a way that allows them to perform predictions at test time conditioned on a number of context points. A recent…

Machine Learning · Computer Science 2021-06-14 Jens Petersen , Gregor Köhler , David Zimmerer , Fabian Isensee , Paul F. Jäger , Klaus H. Maier-Hein

Modern machine learning (ML) methods typically fail to adequately capture causal information. Consequently, such models do not handle data distributional shifts, are vulnerable to adversarial examples, and often learn spurious correlations.…

Quantum Physics · Physics 2026-01-27 Rishi Goel , Casey R. Myers , Sally Shrapnel

We establish the first nonasymptotic error bounds for Kaplan-Meier-based nearest neighbor and kernel survival probability estimators where feature vectors reside in metric spaces. Our bounds imply rates of strong consistency for these…

Machine Learning · Statistics 2022-09-16 George H. Chen

Conditional density estimation generalizes regression by modeling a full density f(yjx) rather than only the expected value E(yjx). This is important for many tasks, including handling multi-modality and generating prediction intervals.…

Methodology · Statistics 2012-06-26 Michael P. Holmes , Alexander G. Gray , Charles Lee Isbell

Deep kernel learning provides an elegant and principled framework for combining the structural properties of deep learning algorithms with the flexibility of kernel methods. By means of a deep neural network, we learn a parametrized kernel…

Machine Learning · Computer Science 2020-12-14 Prudencio Tossou , Basile Dura , Francois Laviolette , Mario Marchand , Alexandre Lacoste

Factor modeling is a powerful statistical technique that permits to capture the common dynamics in a large panel of data with a few latent variables, or factors, thus alleviating the curse of dimensionality. Despite its popularity and…

Econometrics · Economics 2021-03-03 Varlam Kutateladze

Kernel-based approach to operator approximation for partial differential equations has been shown to be unconditionally stable for linear PDEs and numerically exhibit unconditional stability for non-linear PDEs. These methods have the same…

Numerical Analysis · Mathematics 2025-11-25 Andrew Christlieb , Sining Gong , Hyoseon Yang

We introduce the convolutional spectral kernel (CSK), a novel family of non-stationary, nonparametric covariance kernels for Gaussian process (GP) models, derived from the convolution between two imaginary radial basis functions. We present…

Machine Learning · Statistics 2019-10-15 Zheyang Shen , Markus Heinonen , Samuel Kaski

We construct $\bf genRBF$ kernel, which generalizes the classical Gaussian RBF kernel to the case of incomplete data. We model the uncertainty contained in missing attributes making use of data distribution and associate every point with a…

Machine Learning · Computer Science 2017-05-03 Łukasz Struski , Marek Śmieja , Jacek Tabor

The success of kernel-based learning methods depend on the choice of kernel. Recently, kernel learning methods have been proposed that use data to select the most appropriate kernel, usually by combining a set of base kernels. We introduce…

Machine Learning · Computer Science 2011-12-21 Arash Afkanpour , Csaba Szepesvari , Michael Bowling

This paper presents an algorithm, Voted Kernel Regularization , that provides the flexibility of using potentially very complex kernel functions such as predictors based on much higher-degree polynomial kernels, while benefitting from…

Machine Learning · Computer Science 2015-09-16 Corinna Cortes , Prasoon Goyal , Vitaly Kuznetsov , Mehryar Mohri

We provide a general condition under which e-variables in the form of a simple-vs.-simple likelihood ratio exist when the null hypothesis is a composite, multivariate exponential family. Such `simple' e-variables are easy to compute and…

Methodology · Statistics 2025-04-02 Peter Grünwald , Tyron Lardy , Yunda Hao , Shaul K. Bar-Lev , Martijn de Jong

This paper introduces a new type of probabilistic semiparametric model that takes advantage of data binning to reduce the computational cost of kernel density estimation in nonparametric distributions. Two new conditional probability…

Machine Learning · Computer Science 2026-04-02 Rafael Sojo , Javier Díaz-Rozo , Concha Bielza , Pedro Larrañaga

The use of covariance kernels is ubiquitous in the field of spatial statistics. Kernels allow data to be mapped into high-dimensional feature spaces and can thus extend simple linear additive methods to nonlinear methods with higher order…

Machine Learning · Statistics 2017-11-16 Jean-Francois Ton , Seth Flaxman , Dino Sejdinovic , Samir Bhatt

Conditional probabilities are a core concept in machine learning. For example, optimal prediction of a label $Y$ given an input $X$ corresponds to maximizing the conditional probability of $Y$ given $X$. A common approach to inference tasks…

Machine Learning · Computer Science 2017-08-09 Yoav Wald , Amir Globerson