English
Related papers

Related papers: Kernel Mean Estimation by Marginalized Corrupted D…

200 papers

We propose a novel framework for matching estimators for causal effect from observational data that is based on minimizing the dual norm of estimation error when expressed as an operator. We show that many popular matching estimators can be…

Methodology · Statistics 2017-03-01 Nathan Kallus

Comparing conditional distributions is a fundamental challenge in statistics and machine learning, with applications across a wide range of domains. While proposed methods for measuring discrepancies using kernel embeddings of distributions…

Machine Learning · Statistics 2026-05-05 Peter Moskvichev , Siu Lun Chau , Dino Sejdinovic

Non-linear systems of differential equations have attracted the interest in fields like system biology, ecology or biochemistry, due to their flexibility and their ability to describe dynamical systems. Despite the importance of such models…

Methodology · Statistics 2014-05-09 Javier González , Ivan Vujačić , Ernst Wit

We propose two new kernel-type estimators of the mean residual life function $m_X(t)$ of bounded or half-bounded interval supported distributions. Though not as severe as the boundary problems in the kernel density estimation, eliminating…

Methodology · Statistics 2020-05-29 Rizky Reza Fauzi , Yoshihiko Maesono

This study proposes multivariate kernel density estimation by stagewise minimization algorithm based on $U$-divergence and a simple dictionary. The dictionary consists of an appropriate scalar bandwidth matrix and a part of the original…

Machine Learning · Statistics 2021-08-11 Kiheiji Nishida , Kanta Naito

In this paper, we consider the nonparametric least square regression in a Reproducing Kernel Hilbert Space (RKHS). We propose a new randomized algorithm that has optimal generalization error bounds with respect to the square loss, closing a…

Machine Learning · Computer Science 2019-05-28 Kwang-Sung Jun , Ashok Cutkosky , Francesco Orabona

Multivariate associated kernel estimators, which depend on both target point and bandwidth matrix, are appropriate for partially or totally bounded distributions and generalize the classical ones as Gaussian. Previous studies on…

Statistics Theory · Mathematics 2021-09-08 Célestin C. Kokonendji , Sobom M. Somé

We consider kernel estimators of the instantaneous frequency of a slowly evolving sinusoid in white noise. The expected estimation error consists of two terms. The systematic bias error grows as the kernel halfwidth increases while the…

Methodology · Statistics 2020-02-18 Kurt S. Riedel

In the modern age, rankings data is ubiquitous and it is useful for a variety of applications such as recommender systems, multi-object tracking and preference learning. However, most rankings data encountered in the real world is…

Machine Learning · Statistics 2018-07-27 Maria Lomeli , Mark Rowland , Arthur Gretton , Zoubin Ghahramani

Many signal processing and machine learning applications are built from evaluating a kernel on pairs of signals, e.g. to assess the similarity of an incoming query to a database of known signals. This nonlinear evaluation can be simplified…

Signal Processing · Electrical Eng. & Systems 2021-03-16 Vincent Schellekens , Laurent Jacques

Although recovering an Euclidean distance matrix from noisy observations is a common problem in practice, how well this could be done remains largely unknown. To fill in this void, we study a simple distance matrix estimate based upon the…

Machine Learning · Statistics 2014-09-18 Luwan Zhang , Grace Wahba , Ming Yuan

Recent research in the theory of overparametrized learning has sought to establish generalization guarantees in the interpolating regime. Such results have been established for a few common classes of methods, but so far not for ensemble…

Machine Learning · Statistics 2022-05-20 Yutong Wang , Clayton D. Scott

Regularized empirical risk minimization using kernels and their corresponding reproducing kernel Hilbert spaces (RKHSs) plays an important role in machine learning. However, the actually used kernel often depends on one or on a few…

Machine Learning · Statistics 2017-09-25 Andreas Christmann , Daohong Xiang , Ding-Xuan Zhou

The mean shift algorithm is a popular way to find modes of some probability density functions taking a specific kernel-based shape, used for clustering or visual tracking. Since its introduction, it underwent several practical improvements…

Machine Learning · Computer Science 2020-01-08 Sébastien Razakarivony , Axel Barrau

We study estimation of a class prior for unlabeled target samples which possibly differs from that of source population. Moreover, it is assumed that the source data is partially observable: only samples from the positive class and from the…

Machine Learning · Statistics 2026-05-22 Jan Mielniczuk , Wojciech Rejchel , Paweł Teisseyre

Kernel mean embeddings have recently attracted the attention of the machine learning community. They map measures $\mu$ from some set $M$ to functions in a reproducing kernel Hilbert space (RKHS) with kernel $k$. The RKHS distance of two…

Machine Learning · Statistics 2019-12-18 Carl-Johann Simon-Gabriel , Bernhard Schölkopf

Learning kernels in operators from data lies at the intersection of inverse problems and statistical learning, providing a powerful framework for capturing non-local dependencies in function spaces and high-dimensional settings. In contrast…

Statistics Theory · Mathematics 2025-06-24 Sichong Zhang , Xiong Wang , Fei Lu

We study policy evaluation of offline contextual bandits subject to unobserved confounders. Sensitivity analysis methods are commonly used to estimate the policy value under the worst-case confounding over a given uncertainty set. However,…

Machine Learning · Statistics 2023-09-25 Kei Ishikawa , Niao He

Kernel $k$-means clustering can correctly identify and extract a far more varied collection of cluster structures than the linear $k$-means clustering algorithm. However, kernel $k$-means clustering is computationally expensive when the…

Machine Learning · Computer Science 2019-02-12 Shusen Wang , Alex Gittens , Michael W. Mahoney

The separate tasks of denoising, least squares expectation, and manifold learning can often be posed in a common setting of finding the conditional expectations arising from a product of two random variables. This paper focuses on this more…

Machine Learning · Statistics 2024-02-15 Suddhasattwa Das