English
Related papers

Related papers: A Fast and Easy Regression Technique for k-NN Clas…

200 papers

Multimodal models leverage large-scale pre-training to achieve strong but still imperfect performance on tasks such as image captioning, visual question answering, and cross-modal retrieval. In this paper, we present a simple and efficient…

Computer Vision and Pattern Recognition · Computer Science 2024-11-01 Neil Chowdhury , Franklin Wang , Sumedh Shenoy , Douwe Kiela , Sarah Schwettmann , Tristan Thrush

Despite advances in representation learning, high-dimensional classification remains challenging in low-sample-size regimes, where the dominant signal may vary across applications and labeled data are often limited. We propose a…

Methodology · Statistics 2026-05-18 Xiangbo Mo , Hao Chen

We propose a method for certifying the fairness of the classification result of a widely used supervised learning algorithm, the k-nearest neighbors (KNN), under the assumption that the training data may have historical bias caused by…

Machine Learning · Computer Science 2023-07-19 Yannan Li , Jingbo Wang , Chao Wang

In contrastive self-supervised learning, positive samples are typically drawn from the same image but in different augmented views, resulting in a relatively limited source of positive samples. An effective way to alleviate this problem is…

Computer Vision and Pattern Recognition · Computer Science 2023-11-14 Xianzhong Long , Chen Peng , Yun Li

Foundation models (FMs) pretrained on large datasets have become fundamental for various downstream machine learning tasks, in particular in scenarios where obtaining perfectly labeled data is prohibitively expensive. In this paper, we…

Machine Learning · Computer Science 2025-08-04 Ecem Bozkurt , Antonio Ortega

Nearest neighbor (kNN) methods have been gaining popularity in recent years in light of advances in hardware and efficiency of algorithms. There is a plethora of methods to choose from today, each with their own advantages and…

Machine Learning · Computer Science 2017-03-01 Daniel Zoran , Balaji Lakshminarayanan , Charles Blundell

Person re-identification aims to re-identify the probe image from a given set of images under different camera views. It is challenging due to large variations of pose, illumination, occlusion and camera view. Since the convolutional neural…

Computer Vision and Pattern Recognition · Computer Science 2015-11-25 Hailin Shi , Xiangyu Zhu , Shengcai Liao , Zhen Lei , Yang Yang , Stan Z. Li

Image retrieval methods rely on metric learning to train backbone feature extraction models that can extract discriminant queries and reference (gallery) feature representations for similarity matching. Although state-of-the-art accuracy…

Computer Vision and Pattern Recognition · Computer Science 2024-12-12 Madhu Kiran , Kartikey Vishnu , Rafael M. O. Cruz , Eric Granger

Nearest Neighbors Algorithm is a Lazy Learning Algorithm, in which the algorithm tries to approximate the predictions with the help of similar existing vectors in the training dataset. The predictions made by the K-Nearest Neighbors…

Machine Learning · Computer Science 2018-11-14 Chandrasekaran Anirudh Bhardwaj , Megha Mishra , Kalyani Desikan

KNN has the reputation to be the word simplest but efficient supervised learning algorithm used for either classification or regression. KNN prediction efficiency highly depends on the size of its training data but when this training data…

Machine Learning · Computer Science 2021-07-01 Jude Tchaye-Kondi , Yanlong Zhai , Liehuang Zhu

In this paper, we present a novel deep metric learning method to tackle the multi-label image classification problem. In order to better learn the correlations among images features, as well as labels, we attempt to explore a latent space,…

Computer Vision and Pattern Recognition · Computer Science 2020-07-28 Changsheng Li , Chong Liu , Lixin Duan , Peng Gao , Kai Zheng

Metric Learning for visual similarity has mostly adopted binary supervision indicating whether a pair of images are of the same class or not. Such a binary indicator covers only a limited subset of image relations, and is not sufficient to…

Computer Vision and Pattern Recognition · Computer Science 2019-04-23 Sungyeon Kim , Minkyo Seo , Ivan Laptev , Minsu Cho , Suha Kwak

Distance metric learning (DML) approaches learn a transformation to a representation space where distance is in correspondence with a predefined notion of similarity. While such models offer a number of compelling benefits, it has been…

Machine Learning · Statistics 2016-03-03 Oren Rippel , Manohar Paluri , Piotr Dollar , Lubomir Bourdev

The problem of finding K-nearest neighbors in the given dataset for a given query point has been worked upon since several years. In very high dimensional spaces the K-nearest neighbor search (KNNS) suffers in terms of complexity in…

Machine Learning · Computer Science 2021-02-15 Pramod Vadiraja , Christoph Peter Balada

Learning Mahalanobis metric spaces is an important problem that has found numerous applications. Several algorithms have been designed for this problem, including Information Theoretic Metric Learning (ITML) [Davis et al. 2007] and Large…

Machine Learning · Computer Science 2020-03-03 Diego Ihara , Neshat Mohammadi , Francesco Sgherzi , Anastasios Sidiropoulos

In many scientific disciplines structures in high-dimensional data have to be found, e.g., in stellar spectra, in genome data, or in face recognition tasks. In this work we present a novel approach to non-linear dimensionality reduction. It…

Machine Learning · Statistics 2011-09-27 Oliver Kramer

Local learning of sparse image models has proven to be very effective to solve inverse problems in many computer vision applications. To learn such models, the data samples are often clustered using the K-means algorithm with the Euclidean…

Computer Vision and Pattern Recognition · Computer Science 2016-04-20 Julio Cesar Ferreira , Elif Vural , Christine Guillemot

The modern image search system requires semantic understanding of image, and a key yet under-addressed problem is to learn a good metric for measuring the similarity between images. While deep metric learning has yielded impressive…

Computer Vision and Pattern Recognition · Computer Science 2017-08-08 Jian Wang , Feng Zhou , Shilei Wen , Xiao Liu , Yuanqing Lin

Metric learning from a set of triplet comparisons in the form of "Do you think item h is more similar to item i or item j?", indicating similarity and differences between items, plays a key role in various applications including image…

Machine Learning · Statistics 2025-08-07 Gokcan Tatli , Yi Chen , Blake Mason , Robert Nowak , Ramya Korlakai Vinayak

A $k$-nearest neighbor ($k$NN) query determines the $k$ nearest points, using distance metrics, from a specific location. An all $k$-nearest neighbor (A$k$NN) query constitutes a variation of a $k$NN query and retrieves the $k$ nearest…

Databases · Computer Science 2014-02-28 Nikolaos Nodarakis , Spyros Sioutas , Dimitrios Tsoumakos , Giannis Tzimas , Evaggelia Pitoura