English
Related papers

Related papers: Kernel Conditional Density Operators

200 papers

We consider parameter estimation in a regression model corresponding to an iid sequence of censored observations of a finite state modulated renewal process. The model assumes a similar form as in Cox regression except that the baseline…

Statistics Theory · Mathematics 2007-06-13 Dorota M. Dabrowska , Wai Tung Ho

New bandwidth selectors for kernel density estimation with directional data are presented in this work. These selectors are based on asymptotic and exact error expressions for the kernel density estimator combined with mixtures of von Mises…

Methodology · Statistics 2020-09-22 Eduardo García-Portugués

Hjort and Glad (1995) present a method for semiparametric density estimation. Relative to the ordinary kernel density estimator, this technique performs much better when a parametric vehicle distribution fits the data, and otherwise…

Statistics Theory · Mathematics 2026-05-29 M. C. Jones , D. F. Signorini , Nils Lid Hjort

A nonparametric family of conditional distributions is introduced, which generalizes conditional exponential families using functional parameters in a suitable RKHS. An algorithm is provided for learning the generalized natural parameter,…

Machine Learning · Statistics 2018-04-10 Michael Arbel , Arthur Gretton

We describe a method to perform functional operations on probability distributions of random variables. The method uses reproducing kernel Hilbert space representations of probability distributions, and it is applicable to all operations…

Machine Learning · Statistics 2016-09-14 Bernhard Schölkopf , Krikamol Muandet , Kenji Fukumizu , Jonas Peters

We propose a generalization of modern representation learning objectives by reframing them as recursive divergence alignment processes over localized conditional distributions While recent frameworks like Information Contrastive Learning…

Machine Learning · Computer Science 2025-05-02 Anthony D Martin

Consider the semiparametric transformation model $\Lambda_{\theta_o}(Y)=m(X)+\epsilon$, where $\theta_o$ is an unknown finite dimensional parameter, the functions $\Lambda_{\theta_o}$ and $m$ are smooth, $\epsilon$ is independent of $X$,…

Statistics Theory · Mathematics 2011-10-11 Rawane Samb , Cédric Heuchenne , Ingrid Van Keilegom

The notion of reproducing kernel Hilbert space (RKHS) has emerged in system identification during the past decade. In the resulting framework, the impulse response estimation problem is formulated as a regularized optimization defined on an…

Systems and Control · Electrical Eng. & Systems 2022-04-19 Mohammad Khosravi , Roy S. Smith

A recursive estimator of the conditional geometric median in Hilbert spaces is studied. It is based on a stochastic gradient algorithm whose aim is to minimize a weighted L1 criterion and is consequently well adapted for robust online…

Statistics Theory · Mathematics 2012-04-18 Hervé Cardot , Peggy Cénac , Pierre-André Zitt

In this work, we address optimization problems where the objective function is a nonlinear function of an expected value, i.e., compositional stochastic {strongly convex programs}. We consider the case where the decision variable is not…

Optimization and Control · Mathematics 2020-11-30 Amrit Singh Bedi , Alec Koppel , Ketan Rajawat , Panchajanya Sanyal

Neural operators have achieved significant success in modern scientific computing due to their flexibility and strong generalization capabilities. Existing models, however, primarily rely on first-order kernel integral approximations, which…

Machine Learning · Computer Science 2026-05-22 Pengyuan Zhu , Ivor W. Tsang , Yueming Lyu

In supervised learning, the output variable to be predicted is often represented as a function, such as a spectrum or probability distribution. Despite its importance, functional output regression remains relatively unexplored. In this…

Machine Learning · Statistics 2025-03-19 Minoru Kusaba , Megumi Iwayama , Ryo Yoshida

Estimating the ratio of two probability densities from finitely many observations of the densities is a central problem in machine learning and statistics with applications in two-sample testing, divergence estimation, generative modeling,…

Machine Learning · Computer Science 2024-03-12 Werner Zellinger , Stefan Kindermann , Sergei V. Pereverzyev

A Hilbert space embedding of a distribution---in short, a kernel mean embedding---has recently emerged as a powerful tool for machine learning and inference. The basic idea behind this framework is to map distributions into a reproducing…

Machine Learning · Statistics 2020-12-15 Krikamol Muandet , Kenji Fukumizu , Bharath Sriperumbudur , Bernhard Schölkopf

Neural operators are capable of capturing nonlinear mappings between infinite-dimensional functional spaces, offering a data-driven approach to modeling complex functional relationships in classical density functional theory (cDFT). In this…

Kernel density estimation (KDE) is integral to a range of generative and discriminative tasks in machine learning. Drawing upon tools from the multidimensional calculus of variations, we derive an optimal weight function that reduces bias…

Machine Learning · Computer Science 2023-11-07 Sangwoong Yoon , Frank C. Park , Gunsu S Yun , Iljung Kim , Yung-Kyun Noh

We discuss and compare various approaches to the problem of bandwidth selection for kernel estimators of intensity functions of spatial point processes. We also propose a new method based on the Campbell formula applied to the reciprocal…

Methodology · Statistics 2016-12-01 O. Cronie , M. N. M. van Lieshout

Conditional kernel mean embeddings are nonparametric models that encode conditional expectations in a reproducing kernel Hilbert space. While they provide a flexible and powerful framework for probabilistic inference, their performance is…

Machine Learning · Statistics 2018-11-09 Kelvin Hsu , Richard Nock , Fabio Ramos

Many dimensionality and model reduction techniques rely on estimating dominant eigenfunctions of associated dynamical operators from data. Important examples include the Koopman operator and its generator, but also the Schr\"odinger…

Dynamical Systems · Mathematics 2021-04-06 Stefan Klus , Feliks Nüske , Boumediene Hamzi

We introduce a new nonparametric density estimator inspired by Markov Chains, and generalizing the well-known Kernel Density Estimator (KDE). Our estimator presents several benefits with respect to the usual ones and can be used…

Methodology · Statistics 2020-09-15 Andrea De Simone , Alessandro Morandini