English
Related papers

Related papers: An adaptive nearest neighbor rule for classificati…

200 papers

Data-driven neighborhood definitions and graph constructions are often used in machine learning and signal processing applications. k-nearest neighbor~(kNN) and $\epsilon$-neighborhood methods are among the most common methods used for…

Machine Learning · Computer Science 2023-04-18 Sarath Shekkizhar , Antonio Ortega

The article deals with the issue of modification of metric classification algorithms. In particular, it studies the algorithm k-Nearest Neighbours for its application to sequential data. A method of generalization of metric classification…

Machine Learning · Computer Science 2016-12-19 Roman Samarev , Andrey Vasnetsov , Elizaveta Smelkova

In the context of post-hoc interpretability, this paper addresses the task of explaining the prediction of a classifier, considering the case where no information is available, neither on the classifier itself, nor on the processed data…

Machine Learning · Statistics 2017-12-25 Thibault Laugel , Marie-Jeanne Lesot , Christophe Marsala , Xavier Renard , Marcin Detyniecki

Let $\Phi = (V, \mathcal{C})$ be a constraint satisfaction problem on variables $v_1,\dots, v_n$ such that each constraint depends on at most $k$ variables and such that each variable assumes values in an alphabet of size at most $[q]$.…

Data Structures and Algorithms · Computer Science 2020-11-25 Vishesh Jain , Huy Tuan Pham , Thuy Duong Vuong

We consider component-wise estimation of order restricted location/scale parameters of a general bivariate location/scale distribution under the generalized Pitman nearness criterion (GPN). We develop some general results that, in many…

Statistics Theory · Mathematics 2022-09-23 Naresh Garg , Neeraj Misra

Estimating some mathematical expectations from partially observed data and in particular missing outcomes is a central problem encountered in numerous fields such as transfer learning, counterfactual analysis or causal inference. Matching…

Statistics Theory · Mathematics 2025-05-01 Simon Viel , Lionel Truquet , Ikko Yamane

We introduce a new variant of the nearest neighbor search problem, which allows for some coordinates of the dataset to be arbitrarily corrupted or unknown. Formally, given a dataset of $n$ points $P=\{ x_1,\ldots, x_n\}$ in high-dimensions,…

Computational Geometry · Computer Science 2015-11-24 Sariel Har-Peled , Sepideh Mahabadi

The reverse $k$ nearest neighbor query finds all points that have the query point as one of their $k$ nearest neighbors, where the $k$NN query finds the $k$ closest points to its query point. Based on conics, we propose an efficent R$k$NN…

Databases · Computer Science 2023-09-01 Lixin Ye

We theoretically analyse the limits of robustness to test-time adversarial and noisy examples in classification. Our work focuses on deriving bounds which uniformly apply to all classifiers (i.e all measurable functions from features to…

Machine Learning · Statistics 2020-11-13 Elvis Dohmatob

Estimating the dependences between random variables, and ranking them accordingly, is a prevalent problem in machine learning. Pursuing frequentist and information-theoretic approaches, we first show that the p-value and the mutual…

Machine Learning · Computer Science 2012-07-02 Harald Steck

We prove that the Bounded Occurrence Ordering k-CSP Problem is not approximation resistant. We give a very simple local search algorithm that always performs better than the random assignment algorithm. Specifically, the expected value of…

Data Structures and Algorithms · Computer Science 2013-03-05 Konstantin Makarychev

"Reverse Nearest Neighbor" query finds applications in decision support systems, profile-based marketing, emergency services etc. In this paper, we point out a few flaws in the branch and bound algorithms proposed earlier for computing…

Data Structures and Algorithms · Computer Science 2015-06-17 Siddharth Dawar , Vikram Goyal , Debajyoti Bera

This paper is the first to construct and motivate a Machine Learning algorithm solely with Enriched Category Theory, supplementing evidence that Category Theory can provide valuable insights into the construction and explainability of…

Machine Learning · Computer Science 2025-01-28 Matthew Pugh , Jo Grundy , Corina Cirstea , Nick Harris

We consider the fundamental learning problem of estimating properties of distributions over large domains. Using a novel piecewise-polynomial approximation technique, we derive the first unified methodology for constructing sample- and…

Machine Learning · Computer Science 2020-03-18 Yi Hao , Alon Orlitsky

Both supervised and unsupervised machine learning algorithms have been used to learn partition-based index structures for approximate nearest neighbor (ANN) search. Existing supervised algorithms formulate the learning task as finding a…

Machine Learning · Computer Science 2022-10-14 Ville Hyvönen , Elias Jääsaari , Teemu Roos

In many scientific disciplines structures in high-dimensional data have to be found, e.g., in stellar spectra, in genome data, or in face recognition tasks. In this work we present a novel approach to non-linear dimensionality reduction. It…

Machine Learning · Statistics 2011-09-27 Oliver Kramer

We consider classification in the presence of class-dependent asymmetric label noise with unknown noise probabilities. In this setting, identifiability conditions are known, but additional assumptions were shown to be required for finite…

Machine Learning · Computer Science 2019-06-12 Henry W. J. Reeve , Ata Kaban

We prove a general structural theorem for a wide family of local algorithms, which includes property testers, local decoders, and PCPs of proximity. Namely, we show that the structure of every algorithm that makes $q$ adaptive queries and…

Computational Complexity · Computer Science 2023-12-13 Marcel Dall'Agnol , Tom Gur , Oded Lachish

Local model interpretation methods explain individual predictions by assigning an importance value to each input feature. This value is often determined by measuring the change in confidence when a feature is removed. However, the…

Computation and Language · Computer Science 2018-11-08 Eric Wallace , Shi Feng , Jordan Boyd-Graber

Selecting $k$ out of $m$ items based on the preferences of $n$ heterogeneous agents is a widely studied problem in algorithmic game theory. If agents have approval preferences over individual items and harmonic utility functions over…

Computer Science and Game Theory · Computer Science 2024-08-06 Sonja Kraiczy , Edith Elkind