English
Related papers

Related papers: Reducing Nearest Neighbor Training Sets Optimally …

200 papers

Recently, deep learning approaches have provided solutions to difficult problems in wireless positioning (WP). Although these WP algorithms have attained excellent and consistent performance against complex channel environments, the…

Signal Processing · Electrical Eng. & Systems 2025-10-01 Myeung Suk Oh , Anindya Bijoy Das , Taejoon Kim , David J. Love , Christopher G. Brinton

We develop a rigorous mathematical analysis of zero-shot learning with attributes. In this setting, the goal is to label novel classes with no training data, only detectors for attributes and a description of how those attributes are…

Machine Learning · Computer Science 2022-11-29 Alessio Mazzetto , Cristina Menghini , Andrew Yuan , Eli Upfal , Stephen H. Bach

Place recognition is one of the most challenging problems in computer vision, and has become a key part in mobile robotics and autonomous driving applications for performing loop closure in visual SLAM systems. Moreover, the difficulty of…

Computer Vision and Pattern Recognition · Computer Science 2015-05-28 Ruben Gomez-Ojeda , Manuel Lopez-Antequera , Nicolai Petkov , Javier Gonzalez-Jimenez

Learning with few labeled data is a key challenge for visual recognition, as deep neural networks tend to overfit using a few samples only. One of the Few-shot learning methods called metric learning addresses this challenge by first…

Computer Vision and Pattern Recognition · Computer Science 2022-03-28 Li Ke , Meng Pan , Weigao Wen , Dong Li

Image classification is a longstanding problem in computer vision and machine learning research. Most recent works (e.g. SupCon , Triplet, and max-margin) mainly focus on grouping the intra-class samples aggressively and compactly, with the…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Mingkai Zheng , Shan You , Lang Huang , Xiu Su , Fei Wang , Chen Qian , Xiaogang Wang , Chang Xu

The goal of clustering is to group similar objects into meaningful partitions. This process is well understood when an explicit similarity measure between the objects is given. However, far less is known when this information is not readily…

Machine Learning · Computer Science 2020-10-12 Michaël Perrot , Pascal Mattia Esser , Debarghya Ghoshdastidar

A critical piece of the modern information retrieval puzzle is approximate nearest neighbor search. Its objective is to return a set of $k$ data points that are closest to a query point, with its accuracy measured by the proportion of exact…

Information Retrieval · Computer Science 2024-07-15 Thomas Vecchiato , Claudio Lucchese , Franco Maria Nardini , Sebastian Bruch

Recently, finding the sparsest solution of an underdetermined linear system has become an important request in many areas such as compressed sensing, image processing, statistical learning, and data sparse approximation. In this paper, we…

Optimization and Control · Mathematics 2020-03-31 Jialiang Xu

Recent progress in few-shot learning promotes a more realistic cross-domain setting, where the source and target datasets are from different domains. Due to the domain gap and disjoint label spaces between source and target datasets, their…

Computer Vision and Pattern Recognition · Computer Science 2022-03-24 Pan Li , Shaogang Gong , Chengjie Wang , Yanwei Fu

k Nearest Neighbor (kNN) method is a simple and popular statistical method for classification and regression. For both classification and regression problems, existing works have shown that, if the distribution of the feature vector has…

Statistics Theory · Mathematics 2019-10-24 Puning Zhao , Lifeng Lai

This paper presents a new convergent Plug-and-Play (PnP) algorithm. PnP methods are efficient iterative algorithms for solving image inverse problems formulated as the minimization of the sum of a data-fidelity term and a regularization…

Machine Learning · Statistics 2023-04-06 Samuel Hurault , Antonin Chambolle , Arthur Leclaire , Nicolas Papadakis

We focus in this paper on dataset reduction techniques for use in k-nearest neighbor classification. In such a context, feature and prototype selections have always been independently treated by the standard storage reduction algorithms.…

Machine Learning · Computer Science 2013-01-18 Marc Sebban , Richard Nock

Nearest Neighbors Algorithm is a Lazy Learning Algorithm, in which the algorithm tries to approximate the predictions with the help of similar existing vectors in the training dataset. The predictions made by the K-Nearest Neighbors…

Machine Learning · Computer Science 2018-11-14 Chandrasekaran Anirudh Bhardwaj , Megha Mishra , Kalyani Desikan

We explore and expand the $\textit{Soft Nearest Neighbor Loss}$ to measure the $\textit{entanglement}$ of class manifolds in representation space: i.e., how close pairs of points from the same class are relative to pairs of points from…

Machine Learning · Statistics 2019-02-07 Nicholas Frosst , Nicolas Papernot , Geoffrey Hinton

The continuation method is a popular approach in non-convex optimization and computer vision. The main idea is to start from a simple function that can be minimized efficiently, and gradually transform it to the more complicated original…

Machine Learning · Computer Science 2018-02-13 Ali Shameli , Yasin Abbasi-Yadkori

The k-Nearest Neighbor (kNN) classification approach is conceptually simple - yet widely applied since it often performs well in practical applications. However, using a global constant k does not always provide an optimal solution, e.g.,…

Computer Vision and Pattern Recognition · Computer Science 2018-01-08 Mark Kibanov , Martin Becker , Juergen Mueller , Martin Atzmueller , Andreas Hotho , Gerd Stumme

We propose Narrowest Significance Pursuit (NSP), a general and flexible methodology for automatically detecting localised regions in data sequences which each must contain a change-point (understood as an abrupt change in the parameters of…

Methodology · Statistics 2023-05-05 Piotr Fryzlewicz

Neural networks are usually trained by some form of stochastic gradient descent (SGD)). A number of strategies are in common use intended to improve SGD optimization, such as learning rate schedules, momentum, and batching. These are…

Neural and Evolutionary Computing · Computer Science 2015-08-13 Thomas M. Breuel

Recently few-shot object detection is widely adopted to deal with data-limited situations. While most previous works merely focus on the performance on few-shot categories, we claim that detecting all classes is crucial as test samples may…

Computer Vision and Pattern Recognition · Computer Science 2021-05-21 Zhibo Fan , Yuchen Ma , Zeming Li , Jian Sun

Nearest neighbor (NN) matching as a tool to align data sampled from different groups is both conceptually natural and practically well-used. In a landmark paper, Abadie and Imbens (2006) provided the first large-sample analysis of NN…

Statistics Theory · Mathematics 2021-12-28 Zhexiao Lin , Peng Ding , Fang Han