English
Related papers

Related papers: Partial Mean Processes with Generated Regressors: …

200 papers

The application of Gaussian processes (GPs) to large data sets is limited due to heavy memory and computational requirements. A variety of methods has been proposed to enable scalability, one of which is to exploit structure in the kernel…

Machine Learning · Computer Science 2019-12-30 Jan Graßhoff , Alexandra Jankowski , Philipp Rostalski

It is possible to approach regression analysis with random covariates from a semiparametric perspective where information is combined from multiple multivariate sources. The approach assumes a semiparametric density ratio model where…

Methodology · Statistics 2012-10-02 Anastasia Voulgaraki , Benjamin Kedem , Barry I. Graubard

Compared to nonparametric estimators in the multivariate setting, kernel estimators for functional data models have a larger order of bias. This is problematic for constructing confidence regions or statistical tests since the bias might…

Statistics Theory · Mathematics 2025-11-21 Melanie Birke , Tim Greger

In this paper we propose a generalized Gaussian process concurrent regression model for functional data where the functional response variable has a binomial, Poisson or other non-Gaussian distribution from an exponential family while the…

Methodology · Statistics 2014-02-03 Bo Wang , Jian Qing Shi

We introduce a broad class of models called semiparametric spatial point process for making inference between spatial point patterns and spatial covariates. These models feature an intensity function with both parametric and nonparametric…

Methodology · Statistics 2025-09-24 Xindi Lin , Bumjun Park , Christopher Zahasky , Hyunseung Kang

Machine-learning (ML) methods now routinely generate regressors used in subsequent econometric analyses, for example, estimated propensity scores, control-function residuals, imputed covariates, learned proxies, or low-dimensional…

Econometrics · Economics 2026-03-17 Juan Carlos Escanciano , Telmo Pérez-Izquierdo

Difficulties may arise when analyzing longitudinal data using mixed-effects models if there are nonparametric functions present in the linear predictor component. This study extends the use of semiparametric mixed-effects modeling in cases…

Methodology · Statistics 2024-02-05 Mozhgan Taavoni , Mohammad Arashi

The behavior of a GP regression depends on the choice of covariance function. Stationary covariance functions are preferred in machine learning applications. However, (non-periodic) stationary covariance functions are always mean reverting…

Machine Learning · Statistics 2024-05-16 Luca Ambrogioni

We provide a theoretical foundation for non-parametric estimation of functions of random variables using kernel mean embeddings. We show that for any continuous function $f$, consistent estimators of the mean embedding of a random variable…

Machine Learning · Statistics 2018-06-04 Carl-Johann Simon-Gabriel , Adam Ścibior , Ilya Tolstikhin , Bernhard Schölkopf

The paper considers probability distribution, density, conditional distribution and density and conditional moments as well as their kernel estimators in spaces of generalized functions. This approach does not require restrictions on…

Statistics Theory · Mathematics 2013-03-07 Victoria Zinde-Walsh

Gaussian Processes (GPs) are powerful kernelized methods for non-parameteric regression used in many applications. However, their use is limited to a few thousand of training samples due to their cubic time complexity. In order to scale GPs…

Machine Learning · Statistics 2021-12-20 Manuel Schürch , Dario Azzimonti , Alessio Benavoli , Marco Zaffalon

We provide new asymptotic theory for kernel density estimators, when these are applied to autoregressive processes exhibiting moderate deviations from a unit root. This fills a gap in the existing literature, which has to date considered…

Statistics Theory · Mathematics 2019-08-19 James A. Duffy

Marginal structural models are a popular method for estimating causal effects in the presence of time-varying exposures. In spite of their popularity, no scalable non-parametric estimator exist for marginal structural models with…

Methodology · Statistics 2024-09-30 Axel Martin , Michele Santacatterina , Iván Díaz

Most machine learning algorithms, such as classification or regression, treat the individual data point as the object of interest. Here we consider extending machine learning algorithms to operate on groups of data points. We suggest…

Machine Learning · Computer Science 2021-01-15 Danica J. Sutherland , Liang Xiong , Barnabás Póczos , Jeff Schneider

Local polynomial regression of order at least one often performs poorly in regions of sparse data. Local constant regression is exceptional in this regard, though it is the least accurate method in general, especially at the boundaries of…

Methodology · Statistics 2024-06-18 Chunlei Ge , W. John Braun

In this paper, we study nonparametric models allowing for locally stationary regressors and a regression function that changes smoothly over time. These models are a natural extension of time series models with time-varying coefficients. We…

Statistics Theory · Mathematics 2013-02-19 Michael Vogt

We present a general principle for estimating a regression function nonparametrically, allowing for a wide variety of data filtering, for example, repeated left truncation and right censoring. Both the mean and the median regression cases…

Statistics Theory · Mathematics 2011-02-10 Oliver Linton , Enno Mammen , Jens Perch Nielsen , Ingrid Van Keilegom

This paper discusses the solution of nonlinear integral equations with noisy integral kernels as they appear in nonparametric instrumental regression. We propose a regularized Newton-type iteration and establish convergence and convergence…

Numerical Analysis · Mathematics 2015-04-01 Fabian Dunker , Jean-Pierre Florens , Thorsten Hohage , Jan Johannes , Enno Mammen

We propose two new kernel-type estimators of the mean residual life function $m_X(t)$ of bounded or half-bounded interval supported distributions. Though not as severe as the boundary problems in the kernel density estimation, eliminating…

Methodology · Statistics 2020-05-29 Rizky Reza Fauzi , Yoshihiko Maesono

The research is about a systematic investigation on the following issues. First, we construct different outcome regression-based estimators for conditional average treatment effect under, respectively, true (oracle), parametric,…

Statistics Theory · Mathematics 2020-09-23 Lu Li , Niwen Zhou , Lixing Zhu