English
Related papers

Related papers: A Nearest Neighbor Characterization of Lebesgue Po…

200 papers

$K$-NN classifier is one of the most famous classification algorithms, whose performance is crucially dependent on the distance metric. When we consider the distance metric as a parameter of $K$-NN, learning an appropriate distance metric…

Machine Learning · Computer Science 2019-11-26 Kun Song

Nearest neighbor search is a basic computational tool used extensively in almost research domains of computer science specially when dealing with large amount of data. However, the use of nearest neighbor search is restricted for the…

Social and Information Networks · Computer Science 2015-11-24 Suman Saha , S. P. Ghrera

We show that a simple modification of the 1-nearest neighbor classifier yields a strongly Bayes consistent learner. Prior to this work, the only strongly Bayes consistent proximity-based method was the k-nearest neighbor classifier, for k…

Machine Learning · Computer Science 2018-08-20 Aryeh Kontorovich , Roi Weiss

Given a training set $P \subset \mathbb{R}^d$, the nearest-neighbor classifier assigns any query point $q \in \mathbb{R}^d$ to the class of its closest point in $P$. To answer these classification queries, some training points are more…

Computational Geometry · Computer Science 2022-03-08 Alejandro Flores-Velazco

The weighted k-nearest neighbors algorithm is one of the most fundamental non-parametric methods in pattern recognition and machine learning. The question of setting the optimal number of neighbors as well as the optimal weights has…

Machine Learning · Statistics 2017-01-26 Oren Anava , Kfir Y. Levy

We study the interaction between polynomial space randomness and a fundamental result of analysis, the Lebesgue differentiation theorem. We generalize Ko's framework for polynomial space computability in $\mathbb{R}^n$ to define…

Computational Complexity · Computer Science 2016-04-27 Xiang Huang , D. M. Stull

Several researchers proposed using non-Euclidean metrics on point sets in Euclidean space for clustering noisy data. Almost always, a distance function is desired that recognizes the closeness of the points in the same cluster, even if the…

Computational Geometry · Computer Science 2015-03-02 Michael B. Cohen , Brittany Terese Fasy , Gary L. Miller , Amir Nayyeri , Donald R. Sheehy , Ameya Velingker

In pattern recognition or machine learning, it is a very fundamental task to find nearest neighbors of a given point. All the methods for the task work basically by comparing the given point to all the points in the data set. That is why…

Machine Learning · Computer Science 2019-12-10 Hayoung Um , Heeyoul Choi

Optimization problems, generalized equations, and the multitude of other variational problems invariably lead to the analysis of sets and set-valued mappings as well as their approximations. We review the central concept of set-convergence…

Optimization and Control · Mathematics 2020-02-25 Johannes O. Royset

In many high-impact applications, it is important to ensure the quality of output of a machine learning algorithm as well as its reliability in comparison with the complexity of the algorithm used. In this paper, we have initiated a…

Machine Learning · Computer Science 2023-03-03 Katarina Doctor , Tong Mao , Hrushikesh Mhaskar

Large margin nearest neighbor (LMNN) is a metric learner which optimizes the performance of the popular $k$NN classifier. However, its resulting metric relies on pre-selected target neighbors. In this paper, we address the feasibility of…

Data Structures and Algorithms · Computer Science 2018-05-03 Babak Hosseini , Barbara Hammer

Many distributed learning techniques have been motivated by the increasing size of datasets and their inability to fit into main memory on a single machine. We propose an algorithm that finds the nearest neighbor in a graph locally without…

Data Structures and Algorithms · Computer Science 2019-02-18 Abhinav Mishra

Nearest Neighbors Algorithm is a Lazy Learning Algorithm, in which the algorithm tries to approximate the predictions with the help of similar existing vectors in the training dataset. The predictions made by the K-Nearest Neighbors…

Machine Learning · Computer Science 2018-11-14 Chandrasekaran Anirudh Bhardwaj , Megha Mishra , Kalyani Desikan

In the regression framework, the empirical measure based on the responses resulting from the nearest neighbors, among the covariates, to a given point $x$ is introduced and studied as a central statistical quantity. First, the associated…

Statistics Theory · Mathematics 2024-04-11 François Portier

In this paper, we introduce the notion of a $\gamma$-density point for Lebesgue-measurable subsets of $\mathbb{R}$, where $\gamma$ is a modulus function, and study its basic measure-theoretic properties. We show that every $\gamma$-density…

General Topology · Mathematics 2026-04-16 H. S. Behmanush , M. Küçükaslan

In algorithms for finite metric spaces, it is common to assume that the distance between two points can be computed in constant time, and complexity bounds are expressed only in terms of the number of points of the metric space. We…

Computational Geometry · Computer Science 2019-01-28 Michael Kerber , Arnur Nigmetov

To better understand complexity in neural networks, we theoretically investigate the idealised phenomenon of lossless network compressibility, whereby an identical function can be implemented with fewer hidden units. In the setting of…

Machine Learning · Computer Science 2024-05-27 Matthew Farrugia-Roberts

We consider structured optimisation problems defined in terms of the sum of a smooth and convex function, and a proper, l.s.c., convex (typically non-smooth) one in reflexive variable exponent Lebesgue spaces $L_{p(\cdot)}(\Omega)$. Due to…

Optimization and Control · Mathematics 2022-11-10 Marta Lazzaretti , Luca Calatroni , Claudio Estatico

Distance metric learning can be viewed as one of the fundamental interests in pattern recognition and machine learning, which plays a pivotal role in the performance of many learning methods. One of the effective methods in learning such a…

Machine Learning · Computer Science 2020-02-21 Mostafa Razavi Ghods , Mohammad Hossein Moattar , Yahya Forghani

Vertex centrality measures are a multi-purpose analysis tool, commonly used in many application environments to retrieve information and unveil knowledge from the graphs and network structural properties. However, the algorithms of such…

Social and Information Networks · Computer Science 2018-12-03 Felipe Grando , Luis C. Lamb