中文
相关论文

相关论文: Maxiset in sup-norm for kernel estimators

200 篇论文

Let $X=\{X_n: n\in \mathbb{N}\}$ be a linear process with bounded probability density function $f(x)$. Under certain conditions, we use the kernel estimator \[ \frac{2}{n(n-1)h_n} \sum_{1\le i<j\le n}K\Big(\frac{X_i-X_j}{h_n}\Big) \] to…

统计理论 · 数学 2024-03-29 Yudan Xiong , Fangjun Xu

We address the problem of learning an unknown smooth function and its derivatives from noisy pointwise evaluations under the supremum norm. While classical nonparametric regression provides a strong theoretical foundation, traditional…

机器学习 · 计算机科学 2026-03-10 Davide Maran , Marcello Restelli

In this paper, we consider the estimation of a change-point for possibly high-dimensional data in a Gaussian model, using a k-means method. We prove that, up to a logarithmic term, this change-point estimator has a minimax rate of…

统计理论 · 数学 2018-02-22 Aurélie Fischer , Dominique Picard

Given a set of points $P\subset \mathbb{R}^{d}$ and a kernel $k$, the Kernel Density Estimate at a point $x\in\mathbb{R}^{d}$ is defined as $\mathrm{KDE}_{P}(x)=\frac{1}{|P|}\sum_{y\in P} k(x,y)$. We study the problem of designing a data…

数据结构与算法 · 计算机科学 2018-09-03 Moses Charikar , Paris Siminelakis

Coresets have emerged as a powerful tool to summarize data by selecting a small subset of the original observations while retaining most of its information. This approach has led to significant computational speedups but the performance of…

统计理论 · 数学 2020-12-10 Paxton Turner , Jingbo Liu , Philippe Rigollet

Providing non-conservative uncertainty quantification for function estimates derived from noisy observations remains a fundamental challenge in statistical machine learning, particularly for applications in safety-critical domains. In this…

机器学习 · 计算机科学 2026-05-12 Johannes Teutsch , Oleksii Molodchyk , Marion Leibold , Timm Faulwasser , Armin Lederer

In the setting of supervised learning using reproducing kernel methods, we propose a data-dependent regularization parameter selection rule that is adaptive to the unknown regularity of the target function and is optimal both for the…

统计理论 · 数学 2019-05-28 Gilles Blanchard , Peter Mathé , Nicole Mücke

In the present paper, we consider the estimation of a periodic two-dimensional function $f(\cdot,\cdot)$ based on observations from its noisy convolution, and convolution kernel $g(\cdot,\cdot)$ unknown. We derive the minimax lower bounds…

统计理论 · 数学 2019-05-21 Rida Benhaddou , Qing Liu

Optimal estimation and inference for both the minimizer and minimum of a convex regression function under the white noise and nonparametric regression models are studied in a nonasymptotic local minimax framework, where the performance of a…

统计理论 · 数学 2024-03-12 T. Tony Cai , Ran Chen , Yuancheng Zhu

We study the estimation, in Lp-norm, of density functions defined on [0,1]^d. We construct a new family of kernel density estimators that do not suffer from the so-called boundary bias problem and we propose a data-driven procedure based on…

统计理论 · 数学 2018-10-29 Karine Bertin , Salima El Kolei , Nicolas Klutchnikoff

We investigate density estimation from a $n$-sample in the Euclidean space $\mathbb R^D$, when the data is supported by an unknown submanifold $M$ of possibly unknown dimension $d < D$ under a reach condition. We study nonparametric kernel…

统计理论 · 数学 2020-11-02 Clément Berenfeld , Marc Hoffmann

Non-conservative uncertainty bounds are key for both assessing an estimation algorithm's accuracy and in view of downstream tasks, such as its deployment in safety-critical contexts. In this paper, we derive a tight, non-asymptotic…

机器学习 · 计算机科学 2026-01-16 Amon Lahr , Johannes Köhler , Anna Scampicchio , Melanie N. Zeilinger

Given noisy data, function estimation is considered when the unknown function is known a priori to consist of a small number of regions where the function is either convex or concave. When the number of regions is unknown, the model…

统计方法学 · 统计学 2019-11-14 Kurt S. Riedel

We investigate Bernstein-von Mises theorems for adaptive nonparametric Bayesian procedures in the canonical Gaussian white noise model. We consider both a Hilbert space and multiscale setting with applications in $L^2$ and $L^\infty$…

统计理论 · 数学 2017-12-21 Kolyan Ray

The aim of this article is to propose a novel kernel estimator of the baseline function in a general high-dimensional Cox model, for which we derive non-asymptotic rates of convergence. To construct our estimator, we first estimate the…

应用统计 · 统计学 2015-07-07 Agathe Guilloux , Sarah Lemler , Marie-Luce Taupin

We propose a novel Bayesian approach to solve stochastic optimization problems that involve finding extrema of noisy, nonlinear functions. Previous work has focused on representing possible functions explicitly, which leads to a two-step…

机器学习 · 统计学 2012-11-13 Pedro A. Ortega , Jordi Grau-Moya , Tim Genewein , David Balduzzi , Daniel A. Braun

We provide a complete picture of asymptotically minimax estimation of $L_r$-norms (for any $r\ge 1$) of the mean in Gaussian white noise model over Nikolskii-Besov spaces. In this regard, we complement the work of Lepski, Nemirovski and…

统计理论 · 数学 2021-03-04 Yanjun Han , Jiantao Jiao , Rajarshi Mukherjee

We investigate the frequentist coverage properties of credible sets resulting in from Gaussian process priors with squared exponential covariance kernel. First we show that by selecting the scaling hyper-parameter using the maximum marginal…

统计理论 · 数学 2019-04-03 Amine Hadji , Botond Szábo

A fundamental problem in statistics and machine learning is to estimate a function $f$ from possibly noisy observations of its point samples. The goal is to design a numerical algorithm to construct an approximation $\hat f$ to $f$ in a…

We consider the problem of reconstructing a function from a finite set of noise-corrupted samples. Two kernel algorithms are analyzed, namely kernel ridge regression and $\varepsilon$-support vector regression. By assuming the ground-truth…

系统与控制 · 电气工程与系统科学 2021-08-03 Emilio T. Maddalena , Paul Scharnhorst , Colin N. Jones