中文
相关论文

相关论文: Speculate-Correct Error Bounds for k-Nearest Neigh…

200 篇论文

The method of regularized stokeslets is a powerful numerical method to solve the Stokes flow equations for problems in biological fluid mechanics. A recent variation of this method incorporates a nearest-neighbor discretization to improve…

流体动力学 · 物理学 2018-06-06 Meurig T. Gallagher , Debajyoti Choudhuri , David J. Smith

We show that a simple modification of the 1-nearest neighbor classifier yields a strongly Bayes consistent learner. Prior to this work, the only strongly Bayes consistent proximity-based method was the k-nearest neighbor classifier, for k…

机器学习 · 计算机科学 2018-08-20 Aryeh Kontorovich , Roi Weiss

We derive an asymptotic expansion for the excess risk (regret) of a weighted nearest-neighbour classifier. This allows us to find the asymptotically optimal vector of nonnegative weights, which has a rather simple form. We show that the…

统计理论 · 数学 2013-02-19 Richard J. Samworth

This paper proposes a spatial k-nearest neighbor method for nonparametric prediction of real-valued spatial data and supervised classification for categorical spatial data. The proposed method is based on a double nearest neighbor rule…

Convex sample approximations of chance-constrained optimization problems are considered, in which chance constraints are replaced by sets of sampled constraints. We propose a randomized sample selection strategy that allows tight bounds to…

最优化与控制 · 数学 2018-05-22 Mark Cannon

We design a new algorithm for the Euclidean $k$-means problem that operates in the local model of differential privacy. Unlike in the non-private literature, differentially private algorithms for the $k$-means objective incur both additive…

机器学习 · 计算机科学 2021-06-29 Uri Stemmer

We establish a tight characterization of the worst-case rates for the excess risk of agnostic learning with sample compression schemes and for uniform convergence for agnostic sample compression schemes. In particular, we find that the…

机器学习 · 计算机科学 2018-05-22 Steve Hanneke , Aryeh Kontorovich

This paper proposes a computable state-estimation error bound for learning-based Kazantzis--Kravaris/Luenberger (KKL) observers. Recent work learns the KKL transformation map with a physics-informed neural network (PINN) and a corresponding…

系统与控制 · 电气工程与系统科学 2026-03-24 Hannah Berin-Costain , Harry Wang , Kirsten Morris , Jun Liu

Abstract We present PAC-Bayesian bounds for the generalisation error of the K-nearest-neighbour classifier (K-NN). This is achieved by casting the K-NN classifier into a kernel space framework in the limit of vanishing kernel bandwidth. We…

机器学习 · 计算机科学 2021-09-29 Thore Graepel , Ralf Herbrich

A triplet comparison oracle on a set $S$ takes an object $x \in S$ and for any pair $\{y, z\} \subset S \setminus \{x\}$ declares which of $y$ and $z$ is more similar to $x$. Partitioned Local Depth (PaLD) supplies a principled…

数据结构与算法 · 计算机科学 2021-12-06 Jacob D. Baron , R. W. R. Darling , J. Laylon Davis , R. Pettit

The K Nearest Neighbors (KNN) classifier is widely used in many fields such as fingerprint-based localization or medicine. It determines the class membership of unlabelled sample based on the class memberships of the K labelled samples, the…

机器学习 · 计算机科学 2024-03-14 Philipp Müller

By probabilistic means, the concept of contextuality is extended so that it can be used in non-ideal situations. An inequality is presented, which at least in principle enables a test to discard non-contextual hidden-variable models at low…

量子物理 · 物理学 2022-03-16 Jan-Åke Larsson

The k-Nearest Neighbor (k-NN) classification algorithm is one of the most widely-used lazy classifiers because of its simplicity and ease of implementation. It is considered to be an effective classifier and has many applications. However,…

机器学习 · 计算机科学 2014-02-13 Stefanos Ougiaroglou , Georgios Evangelidis , Dimitris A. Dervos

We consider a class of random matching problems where the distance between two points has a probability law which, for a small distance l, goes like l^r. In the framework of the cavity method, in the limit of an infinite number of points,…

统计力学 · 物理学 2009-10-31 G. Parisi , M. Ratieville

Hyperparameter tuning is a common technique for improving the performance of neural networks. Most techniques for hyperparameter search involve an iterated process where the model is retrained at every iteration. However, the expected…

机器学习 · 计算机科学 2022-08-18 Dan Navon , Alex M. Bronstein

We consider the fundamental problem of estimating a discrete distribution on a domain of size $K$ with high probability in Kullback-Leibler divergence. We provide upper and lower bounds on the minimax estimation rate, which show that the…

机器学习 · 统计学 2026-02-23 Dirk van der Hoeven , Julia Olkhovskaia , Tim van Erven

In some recent work, fractal curvatures C^f_k(F) and fractal curvature measures C^f_k(F, .), k = 0, ..., d, have been determined for all self-similar sets F in R^d, for which the parallel neighborhoods satisfy a certain regularity condition…

度量几何 · 数学 2010-10-12 Steffen Winter

We consider a general linear parabolic problem with extended time boundary conditions (including initial value problems and periodic ones), and approximate it by the implicit Euler scheme in time and the Gradient Discretisation method in…

数值分析 · 数学 2023-08-22 J Droniou , R Eymard , T Gallouët , C Guichard , R Herbin

Estimating expected polynomials of density functions from samples is a basic problem with numerous applications in statistics and information theory. Although kernel density estimators are widely used in practice for such functional…

信息论 · 计算机科学 2017-02-13 Weihao Gao , Sewoong Oh , Pramod Viswanath

Bennett, Carbery and Tao considered the $k$-linear restriction estimate in $\mathbb{R}^{n+1}$ and established the near optimal $L^\frac2{k-1}$ estimate under transversality assumptions only. We have shown that the trilinear restriction…

经典分析与常微分方程 · 数学 2018-10-31 Ioan Bejenaru