中文
相关论文

相关论文: On Uniform Error Bounds for Kernel Regression unde…

200 篇论文

This paper develops a method to construct uniform confidence bands for a nonparametric regression function where a predictor variable is subject to a measurement error. We allow for the distribution of the measurement error to be unknown,…

统计理论 · 数学 2019-06-17 Kengo Kato , Yuya Sasaki

In this work, we investigate Gaussian process regression used to recover a function based on noisy observations. We derive upper and lower error bounds for Gaussian process regression with possibly misspecified correlation functions. The…

统计理论 · 数学 2022-07-20 Wenjia Wang , Bing-Yi Jing

Consistent weighted least square estimators are proposed for a wide class of nonparametric regression models with random regression function, where this real-valued random function of $k$ arguments is assumed to be continuous with…

统计理论 · 数学 2023-07-04 Yu. Yu. Linke , I. S. Borisov , P. S. Ruzankin

Kernel-based models such as kernel ridge regression and Gaussian processes are ubiquitous in machine learning applications for regression and optimization. It is well known that a major downside for kernel-based models is the high…

机器学习 · 计算机科学 2022-06-22 Sattar Vakili , Jonathan Scarlett , Da-shan Shiu , Alberto Bernacchia

Gaussian process regression (GPR) is a popular nonparametric Bayesian method that provides predictive uncertainty estimates and is widely used in safety-critical applications. While prior research has introduced various uncertainty bounds,…

机器学习 · 计算机科学 2025-12-05 Junyi Liu , Stanley Kok

This paper concerns the estimation of the regression function at a given point in nonparametric heteroscedastic models with Gaussian noise or with noise having unknown distribution. In the two cases an asymptotically efficient kernel…

统计理论 · 数学 2007-11-30 Jean-Yves Brua

In various applications of regression analysis, in addition to errors in the dependent observations also errors in the predictor variables play a substantial role and need to be incorporated in the statistical modeling process. In this…

统计理论 · 数学 2020-09-03 Katharina Proksch , Nicolai Bissantz , Hajo Holzmann

In this PhD thesis, we propose a novel framework for uncertainty quantification in machine learning, which is based on proper scores. Uncertainty quantification is an important cornerstone for trustworthy and reliable machine learning…

机器学习 · 计算机科学 2025-08-26 Sebastian G. Gruber

In this paper, we derive a novel procedure for set-membership estimation of dynamical systems affected by stochastic noise with unbounded support. Employing a bound on the sample covariance matrix, we are able to provide a finite- sample…

系统与控制 · 电气工程与系统科学 2026-05-20 Felix Brändle , Nicolas Chatzikiriakos , Andrea Iannelli , Frank Allgöwer

In this paper, we investigate the supremum-norm generalization error and the uniform inference for a specific class of kernel regression methods, namely the kernel gradient flows. Under the widely adopted capacity-source condition framework…

统计理论 · 数学 2026-05-08 Yuqian Cheng , Zhuo Chen , Qian Lin

Many algorithms have been recently proposed for causal machine learning. Yet, there is little to no theory on their quality, especially considering finite samples. In this work, we propose a theory based on generalization bounds that…

机器学习 · 统计学 2024-05-16 Daniel Csillag , Claudio José Struchiner , Guilherme Tegoni Goedert

Many algorithms in computer vision and robotics make strong assumptions about uncertainty, and rely on the validity of these assumptions to produce accurate and consistent state estimates. In practice, dynamic environments may degrade…

机器人学 · 计算机科学 2017-08-04 Valentin Peretroukhin , William Vega-Brown , Nicholas Roy , Jonathan Kelly

In this paper, we develop a general machinery for finding explicit uniform probability and moment bounds on sub-additive positive functionals of random processes. Using the developed general technique, we derive uniform bounds on the…

概率论 · 数学 2012-02-09 Alexander Goldenshluger , Oleg Lepski

We provide here a universal approximation theorem with precise quantitative error bounds for noisy quantum neural networks. We focus on applications to Quantitative Finance, where target functions are often given as expectations. We further…

量子物理 · 物理学 2026-05-20 Lukas Gonon , Antoine Jacquier , Marcel Mordarski

We derive new bounds for the condition number of kernel matrices, which we then use to enhance existing non-asymptotic test error bounds for kernel ridgeless regression (KRR) in the over-parameterized regime for a fixed input dimension. For…

机器学习 · 计算机科学 2024-05-31 Tin Sum Cheng , Aurelien Lucchi , Anastasis Kratsios , David Belius

We propose a probabilistic enhancement of standard kernel Support Vector Machines for binary classification, in order to address the case when, along with given data sets, a description of uncertainty (e.g., error bounds) may be available…

机器学习 · 计算机科学 2020-03-19 Yongxin Chen , Tryphon T. Georgiou , Allen R. Tannenbaum

Generalization error (also known as the out-of-sample error) measures how well the hypothesis learned from training data generalizes to previously unseen data. Proving tight generalization error bounds is a central question in statistical…

机器学习 · 计算机科学 2020-03-03 Jian Li , Xuanyuan Luo , Mingda Qiao

Gaussian Processes (GPs) are a versatile method that enables different approaches towards learning for dynamics and control. Gaussianity assumptions appear in two dimensions in GPs: The positive semi-definite kernel of the underlying…

机器学习 · 统计学 2024-09-13 T. Faulwasser , O. Molodchyk

Generative models, like large language models, are becoming increasingly relevant in our daily lives, yet a theoretical framework to assess their generalization behavior and uncertainty does not exist. Particularly, the problem of…

机器学习 · 计算机科学 2024-07-11 Sebastian G. Gruber , Florian Buettner

Almost sure bounds are established on the uniform error of smoothing spline estimators in nonparametric regression with random designs. Some results of Einmahl and Mason (2005) are used to derive uniform error bounds for the approximation…

统计理论 · 数学 2007-06-13 P. P. B. Eggermont , V. N. LaRiccia