English
Related papers

Related papers: Rethinking Nearest Neighbors for Visual Classifica…

200 papers

Purpose: We propose a novel method for continual learning based on the increasing depth of neural networks. This work explores whether extending neural network depth may be beneficial in a life-long learning setting. Methods: We propose a…

Machine Learning · Computer Science 2023-05-09 Jędrzej Kozal , Michał Woźniak

Modern vision-based reinforcement learning techniques often use convolutional neural networks (CNN) as universal function approximators to choose which action to take for a given visual input. Until recently, CNNs have been treated like…

Machine Learning · Computer Science 2018-09-28 Jieliang Luo , Sam Green , Peter Feghali , George Legrady , Çetin Kaya Koç

K Nearest Neighbor (KNN) joins are used in scientific domains for data analysis, and are building blocks of several well-known algorithms. KNN-joins find the KNN of all points in a dataset. This paper focuses on a hybrid CPU/GPU approach…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-11-19 Michael Gowanlock

In this paper, we address the problem of unsupervised video anomaly detection (UVAD). The task aims to detect abnormal events in test video using unlabeled videos as training data. The presence of anomalies in the training data poses a…

Computer Vision and Pattern Recognition · Computer Science 2024-08-07 Jihun Yi , Sungroh Yoon

The estimation of mutual information (MI) or conditional mutual information (CMI) from a set of samples is a long-standing problem. A recent line of work in this area has leveraged the approximation power of artificial neural networks and…

Information Theory · Computer Science 2021-10-27 Sina Molavipour , Germán Bassi , Mikael Skoglund

Function regression/approximation is a fundamental application of machine learning. Neural networks (NNs) can be easily trained for function regression using a sufficient number of neurons and epochs. The forward-forward learning algorithm…

Machine Learning · Computer Science 2025-10-16 Shivam Padmani , Akshay Joshi

Convolutional Neural Networks (CNNs) are a standard approach for visual recognition due to their capacity to learn hierarchical representations from raw pixels. In practice, practitioners often choose among (i) training a compact custom CNN…

Computer Vision and Pattern Recognition · Computer Science 2026-01-06 Annoor Sharara Akhand

Nearest neighbor is a popular nonparametric method for classification and regression with many appealing properties. In the big data era, the sheer volume and spatial/temporal disparity of big data may prohibit centrally processing and…

Statistics Theory · Mathematics 2018-12-13 Jiexin Duan , Xingye Qiao , Guang Cheng

A classification algorithm that combines the components of k-nearest neighbours and multilayer neural networks has been designed and tested. With this method the computational time required for training the dataset has been reduced…

Computer Vision and Pattern Recognition · Computer Science 2017-09-19 N. Joshi

Deep neural networks (DNNs) are successful in many computer vision tasks. However, the most accurate DNNs require millions of parameters and operations, making them energy, computation and memory intensive. This impedes the deployment of…

Computer Vision and Pattern Recognition · Computer Science 2020-03-26 Abhinav Goel , Caleb Tung , Yung-Hsiang Lu , George K. Thiruvathukal

This paper introduces a novel approach that integrates graph theory into self-supervised representation learning. Traditional methods focus on intra-instance variations generated by applying augmentations. However, they often overlook…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Ali Javidani , Babak Nadjar Araabi , Mohammad Amin Sadeghi

Re-ranking is the second stage of a visual place recognition task, in which the system chooses the best-matching images from a pre-selected subset of candidates. Model-free approaches compute the image pair similarity based on a spatial…

Computer Vision and Pattern Recognition · Computer Science 2024-10-28 Tomáš Pivoňka , Libor Přeučil

Large margin nearest neighbor (LMNN) is a metric learner which optimizes the performance of the popular $k$NN classifier. However, its resulting metric relies on pre-selected target neighbors. In this paper, we address the feasibility of…

Data Structures and Algorithms · Computer Science 2018-05-03 Babak Hosseini , Barbara Hammer

In recent years, deep learning poses a deep technical revolution in almost every field and attracts great attentions from industry and academia. Especially, the convolutional neural network (CNN), one representative model of deep learning,…

Human-Computer Interaction · Computer Science 2018-07-09 Mao Yang , Bo Li , Guanxiong Feng , Zhongjiang Yan

Motivated by safety-critical applications, test-time attacks on classifiers via adversarial examples has recently received a great deal of attention. However, there is a general lack of understanding on why adversarial examples arise;…

Machine Learning · Statistics 2019-06-20 Yizhen Wang , Somesh Jha , Kamalika Chaudhuri

Top-k Nearest Neighbors (kNN) problem on road network has numerous applications on location-based services. As direct search using the Dijkstra's algorithm results in a large search space, a plethora of complex-index-based approaches have…

Databases · Computer Science 2024-08-13 Yiqi Wang , Long Yuan , Wenjie Zhang , Xuemin Lin , Zi Chen , Qing Liu

Pre-training is crucial for learning deep neural networks. Most of existing pre-training methods train simple models (e.g., restricted Boltzmann machines) and then stack them layer by layer to form the deep structure. This layer-wise…

Machine Learning · Computer Science 2015-06-09 Zhiyuan Tang , Dong Wang , Yiqiao Pan , Zhiyong Zhang

Data-driven neighborhood definitions and graph constructions are often used in machine learning and signal processing applications. k-nearest neighbor~(kNN) and $\epsilon$-neighborhood methods are among the most common methods used for…

Machine Learning · Computer Science 2023-04-18 Sarath Shekkizhar , Antonio Ortega

Identifying sleep stages and patterns is an essential part of diagnosing and treating sleep disorders. With the advancement of smart technologies, sensor data related to sleeping patterns can be captured easily. In this paper, we propose a…

Signal Processing · Electrical Eng. & Systems 2022-04-29 Vidya Rohini Konanur Sathish , Wai Lok Woo , Edmond S. L. Ho

Over the past decade, machine learning revolutionized vision-based quality assessment for which convolutional neural networks (CNNs) have now become the standard. In this paper, we consider a potential next step in this development and…

Quantum Physics · Physics 2022-06-09 Barry D. Reese , Marek Kowalik , Christian Metzl , Christian Bauckhage , Eldar Sultanow