English
Related papers

Related papers: Kernel-Based Nonparametric Tests For Shape Constra…

200 papers

Regularized empirical risk minimization including support vector machines plays an important role in machine learning theory. In this paper regularized pairwise learning (RPL) methods based on kernels will be investigated. One example is…

Statistics Theory · Mathematics 2015-10-13 Andreas Christmann , Ding-Xuan Zhou

In nonparametric regression analysis, errors are possibly correlated in practice, and neglecting error correlation can undermine most bandwidth selection methods. When no prior knowledge or parametric form of the correlation structure is…

Methodology · Statistics 2025-04-29 Sisheng Liu , Xiaoli Kong

We study kernel-based estimation of nonparametric time-varying parameters (TVPs) in linear models. Our contributions are threefold. First, we establish consistency and asymptotic normality of the kernel-based estimator for a broad class of…

Econometrics · Economics 2026-01-26 Mikihito Nishi

Needlets have been recognized as state-of-the-art tools to tackle spherical data, due to their excellent localization properties in both spacial and frequency domains. This paper considers developing kernel methods associated with the…

Machine Learning · Computer Science 2015-09-11 Shaobo Lin

We present a general variational framework for the training of freeform nonlinearities in layered computational architectures subject to some slope constraints. The regularization that we add to the traditional training loss penalizes the…

Machine Learning · Statistics 2025-03-31 Michael Unser , Alexis Goujon , Stanislas Ducotterd

Elliptical distribution is a basic assumption underlying many multivariate statistical methods. For example, in sufficient dimension reduction and statistical graphical models, this assumption is routinely imposed to simplify the data…

Statistics Theory · Mathematics 2024-12-16 Yin Tang , Bing Li

A kernelization is an efficient algorithm that given an instance of a parameterized problem returns an equivalent instance of size bounded by some function of the input parameter value. It is quite well understood which problems do or…

Data Structures and Algorithms · Computer Science 2025-10-02 Leonid Antipov , Stefan Kratsch

We study prediction-powered conditional inference in the setting where labeled data are scarce, unlabeled covariates are abundant, and a black-box machine-learning predictor is available. The goal is to perform statistical inference on…

Machine Learning · Statistics 2026-03-09 Yang Sui , Jin Zhou , Hua Zhou , Xiaowu Dai

We investigate the nonparametric estimation for regression in a fixed-design setting when the errors are given by a field of dependent random variables. Sufficient conditions for kernel estimators to converge uniformly are obtained. These…

Statistics Theory · Mathematics 2007-06-13 Mohamed El Machkouri

This paper develops tests for inequality constraints of nonparametric regression functions. The test statistics involve a one-sided version of $L_p$-type functionals of kernel estimators $(1 \leq p < \infty)$. Drawing on the approach of…

Statistics Theory · Mathematics 2023-08-28 Sokbae Lee , Kyungchul Song , Yoon-Jae Whang

We consider testing the significance of a subset of covariates in a nonparametric regression. These covariates can be continuous and/or discrete. We propose a new kernel-based test that smoothes only over the covariates appearing under the…

Statistics Theory · Mathematics 2014-03-28 Pascal Lavergne , Samuel Maistre , Valentin Patilea

We consider parametrized problems driven by spatially nonlocal integral operators with parameter-dependent kernels. In particular, kernels with varying nonlocal interaction radius $\delta > 0$ and fractional Laplace kernels, parametrized by…

Numerical Analysis · Mathematics 2019-10-02 Olena Burkovska , Max Gunzburger

Variational methods are widely used for approximate posterior inference. However, their use is typically limited to families of distributions that enjoy particular conjugacy properties. To circumvent this limitation, we propose a family of…

Machine Learning · Computer Science 2012-06-22 Samuel Gershman , Matt Hoffman , David Blei

We develop a unified theory of designs for controlled experiments that balance baseline covariates a priori (before treatment and before randomization) using the framework of minimax variance and a new method called kernel allocation. We…

Statistics Theory · Mathematics 2017-08-02 Nathan Kallus

In this work, we extend the classical framework of quantization for Borel probability measures defined on normed spaces $\mathbb{R}^k$ by introducing and analyzing the notions of the $n$th constrained quantization error, constrained…

Probability · Mathematics 2026-01-30 Megha Pandey , Mrinal Kanti Roychowdhury

The mainstream theory of hypothesis testing in high-dimensional regression typically assumes the underlying true model is a low-dimensional linear regression model, yet the Box-Cox transformation is a regression technique commonly used to…

Methodology · Statistics 2024-05-22 He Zhou , Hui Zou

Kernel-based nonparametric hazard rate estimation is considered with a special class of infinite-order kernels that achieves favorable bias and mean square error properties. A fully automatic and adaptive implementation of a density and…

Statistics Theory · Mathematics 2018-10-17 Arthur Berg , Dimitris N Politis , Kagba Suaray , Hui Zeng

Financial econometrics has become an increasingly popular research field. In this paper we review a few parametric and nonparametric models and methods used in this area. After introducing several widely used continuous-time and…

Statistical Finance · Quantitative Finance 2008-12-02 Zhibiao Zhao

Kernelization investigates exact preprocessing algorithms with performance guarantees. The most prevalent type of parameters used in kernelization is the solution size for optimization problems; however, also structural parameters have been…

Data Structures and Algorithms · Computer Science 2015-07-21 Eduard Eiben , Robert Ganian , Stefan Szeider

In this paper, we are concerned with the generalization performance of non-parametric estimation for pairwise learning. Most of the existing work requires the hypothesis space to be convex or a VC-class, and the loss to be convex. However,…

Machine Learning · Statistics 2026-02-12 Junyu Zhou , Shuo Huang , Han Feng , Puyu Wang , Ding-Xuan Zhou