English
Related papers

Related papers: Kernel Debiased Plug-in Estimation based on the Un…

200 papers

We propose a closed-form spectral framework for relative log-density estimation in linearly parameterized probabilistic models, including unnormalized and conditional models. This is achieved by representing the Kullback-Leibler (KL)…

Machine Learning · Computer Science 2026-05-12 Francis Bach

We propose Deep Longitudinal Targeted Minimum Loss-based Estimation (Deep LTMLE), a novel approach to estimate the counterfactual mean of outcome under dynamic treatment policies in longitudinal problem settings. Our approach utilizes a…

Machine Learning · Statistics 2025-06-09 Toru Shirakawa , Yi Li , Yulun Wu , Sky Qiu , Yuxuan Li , Mingduo Zhao , Hiroyasu Iso , Mark van der Laan

The scalability of Generalized Linear Models (GLMs) for large-scale, high-dimensional data often forces a trade-off between computational feasibility and statistical accuracy, particularly for inference on pre-specified parameters. While…

Methodology · Statistics 2025-12-09 Bo Fu , Dandan Jiang

Any applied mathematical model contains parameters. The paper proposes to use kernel learning for the parametric analysis of the model. The approach consists in setting a distribution on the parameter space, obtaining a finite training…

Optimization and Control · Mathematics 2025-01-27 Vladimir Norkin , Alois Pichler

The reproducing kernel Hilbert space (RKHS) embedding of distributions offers a general and flexible framework for testing problems in arbitrary domains and has attracted considerable amount of attention in recent years. To gain insights…

Machine Learning · Statistics 2017-09-26 Krishnakumar Balasubramanian , Tong Li , Ming Yuan

We describe a fast method for solving elliptic partial differential equations (PDEs) with uncertain coefficients using kernel interpolation at a lattice point set. By representing the input random field of the system using the model…

Numerical Analysis · Mathematics 2023-08-15 Vesa Kaarnioja , Frances Y. Kuo , Ian H. Sloan

Many real-world applications generate continuous data streams for regression. Hoeffding trees and their variants have a long-standing tradition due to their effectiveness, either alone or as base models in broader ensembles. Recent…

Machine Learning · Computer Science 2026-03-06 Pantia-Marina Alchirch , Dimitrios I. Diochnos

Conditional kernel mean embeddings are nonparametric models that encode conditional expectations in a reproducing kernel Hilbert space. While they provide a flexible and powerful framework for probabilistic inference, their performance is…

Machine Learning · Statistics 2018-11-09 Kelvin Hsu , Richard Nock , Fabio Ramos

This paper considers the design of nonlinear data-enabled predictive control (DeePC) using kernel functions. Compared with existing methods that use kernels to parameterize multi-step predictors for nonlinear DeePC, we adopt a novel,…

Optimization and Control · Mathematics 2025-01-30 Thomas de Jong , Siep Weiland , Mircea Lazar

A reduced-bias nonparametric estimator of the cumulative distribution function (CDF) and the survival function is proposed using infinite-order kernels. Fourier transform theory on generalized functions is utilized to obtain the improved…

Methodology · Statistics 2009-03-18 Arthur Berg , Dimitris N. Politis

Learning nonparametric systems of Ordinary Differential Equations (ODEs) dot x = f(t,x) from noisy data is an emerging machine learning topic. We use the well-developed theory of Reproducing Kernel Hilbert Spaces (RKHS) to define candidates…

Machine Learning · Statistics 2023-11-14 Kamel Lahouel , Michael Wells , Victor Rielly , Ethan Lew , David Lovitz , Bruno M. Jedynak

Kernel adaptive filters (KAF) are a class of powerful nonlinear filters developed in Reproducing Kernel Hilbert Space (RKHS). The Gaussian kernel is usually the default kernel in KAF algorithms, but selecting the proper kernel size…

Machine Learning · Statistics 2016-05-10 Badong Chen , Junli Liang , Nanning Zheng , Jose C. Principe

Non-Gaussian noise and the uncertainty of noise distribution are the common factors that reduce accuracy in dynamic state estimation of power systems (PS). In addition, the optimal value of the free coefficients in the unscented Kalman…

Signal Processing · Electrical Eng. & Systems 2025-04-11 Duc Viet Nguyen , Haiquan Zhao , Jinhui Hu , Le Ngoc Giang

This article presents a general framework for the transport of probability measures towards minimum divergence generative modeling and sampling using ordinary differential equations (ODEs) and Reproducing Kernel Hilbert Spaces (RKHSs),…

Machine Learning · Statistics 2024-02-14 Biraj Pandey , Bamdad Hosseini , Pau Batlle , Houman Owhadi

Surrogate modeling and uncertainty quantification tasks for PDE systems are most often considered as supervised learning problems where input and output data pairs are used for training. The construction of such emulators is by definition a…

Computational Physics · Physics 2019-06-26 Yinhao Zhu , Nicholas Zabaras , Phaedon-Stelios Koutsourelakis , Paris Perdikaris

Nonparametric kernel density and local polynomial regression estimators are very popular in Statistics, Economics, and many other disciplines. They are routinely employed in applied work, either as part of the main empirical analysis or as…

Computation · Statistics 2020-07-21 Sebastian Calonico , Matias D. Cattaneo , Max H. Farrell

Sequential neural posterior estimation (SNPE) techniques have been recently proposed for dealing with simulation-based models with intractable likelihoods. Unlike approximate Bayesian computation, SNPE techniques learn the posterior from…

Machine Learning · Statistics 2025-01-17 Yifei Xiong , Xiliang Yang , Sanguo Zhang , Zhijian He

Estimating probability density and its score from samples remains a core problem in generative modeling, Bayesian inference, and kinetic theory. Existing methods are bifurcated: classical kernel density estimators (KDE) generalize across…

Machine Learning · Computer Science 2026-05-29 Vasily Ilin , Peter Sushko , Ranjay Krishna

Functional regression is very crucial in functional data analysis and a linear relationship between scalar response and functional predictor is often assumed. However, the linear assumption may not hold in practice, which makes the methods…

Methodology · Statistics 2023-01-18 Rou Zhong , Dongxue Wang , Jingxiao Zhang

A framework for estimation and hypothesis testing of functional restrictions against general alternatives is proposed. The parameter space is a reproducing kernel Hilbert space (RKHS). The null hypothesis does not necessarily define a…

Methodology · Statistics 2018-08-21 Alessio Sancetta