English
Related papers

Related papers: scikit-hubness: Hubness Reduction and Approximate …

200 papers

There is a strong recent emphasis on trustworthy AI. In particular, international regulations, such as the AI Act, demand that AI practitioners measure data quality on the input and estimate bias on the output of high-risk AI systems.…

Artificial Intelligence · Computer Science 2026-01-21 German M. Matilla , Jiri Nemecek , Illia Kryvoviaz , Jakub Marecek

We are surrounded by huge amounts of large-scale high dimensional data. It is desirable to reduce the dimensionality of data for many learning tasks due to the curse of dimensionality. Feature selection has shown its effectiveness in many…

Machine Learning · Computer Science 2016-11-08 Jundong Li , Huan Liu

We present a new regular grid search algorithm for quick fixed-radius nearest-neighbor lookup developed in Python. This module indexes a set of k-dimensional points in a regular grid, with optional periodic conditions, providing a fast…

Instrumentation and Methods for Astrophysics · Physics 2020-12-24 Martin Chalela , Emanuel Sillero , Luis Pereyra , Mario Alejandro García , Juan B. Cabral , Marcelo Lares , Manuel Merchán

Similarity search is a fundamental algorithmic primitive, widely used in many computer science disciplines. There are several variants of the similarity search problem, and one of the most relevant is the $r$-near neighbor ($r$-NN) problem:…

Data Structures and Algorithms · Computer Science 2020-06-16 Martin Aumüller , Rasmus Pagh , Francesco Silvestri

Existing methods for retrieving k-nearest neighbours suffer from the curse of dimensionality. We argue this is caused in part by inherent deficiencies of space partitioning, which is the underlying strategy used by most existing methods. We…

Data Structures and Algorithms · Computer Science 2017-04-07 Ke Li , Jitendra Malik

Hubness is a phenomenon in high-dimensional vector spaces where a point from the natural distribution is unusually close to many other points. This is a well-known problem in information retrieval that causes some items to accidentally (and…

Cryptography and Security · Computer Science 2026-05-15 Tingwei Zhang , Fnu Suya , Rishi Jha , Collin Zhang , Vitaly Shmatikov

Finding the set of the n items most dissimilar from each other out of a larger population becomes increasingly difficult and computationally expensive as either n or the population size grows large. Finding the set of the n most dissimilar…

Biomolecules · Quantitative Biology 2021-05-10 Felicity F. Nielson , Sean M. Colby , Ryan S. Renslow , Thomas O. Metz

The Scikit-HEP project is a community-driven and community-oriented effort with the aim of providing Particle Physics at large with a Python scientific toolset containing core and common tools. The project builds on five pillars that…

Computational Physics · Physics 2019-10-02 Eduardo Rodrigues

We introduce a new library named abess that implements a unified framework of best-subset selection for solving diverse machine learning problems, e.g., linear regression, classification, and principal component analysis. Particularly, the…

Machine Learning · Statistics 2024-04-02 Jin Zhu , Xueqin Wang , Liyuan Hu , Junhao Huang , Kangkang Jiang , Yanhang Zhang , Shiyun Lin , Junxian Zhu

scikit-image is an image processing library that implements algorithms and utilities for use in research, education and industry applications. It is released under the liberal "Modified BSD" open source license, provides a well-documented…

The main contribution of this dissertation is the introduction of new or improved approximation algorithms and data structures for several similarity search problems. We examine the furthest neighbor query, the annulus query, distance…

Data Structures and Algorithms · Computer Science 2019-06-13 Johan von Tangen Sivertsen

DeepXube is a free and open-source Python package and command-line tool that seeks to automate the solution of pathfinding problems by using machine learning to learn heuristic functions that guide heuristic search algorithms tailored to…

Artificial Intelligence · Computer Science 2026-03-26 Forest Agostinelli

Explicitly or implicitly, most of dimensionality reduction methods need to determine which samples are neighbors and the similarity between the neighbors in the original highdimensional space. The projection matrix is then learned on the…

Computer Vision and Pattern Recognition · Computer Science 2017-09-12 Yanwei Pang , Bo Zhou , Feiping Nie

scikit-multilearn is a Python library for performing multi-label classification. The library is compatible with the scikit/scipy ecosystem and uses sparse matrices for all internal operations. It provides native Python implementations of…

Machine Learning · Computer Science 2018-12-11 Piotr Szymański , Tomasz Kajdanowicz

This paper presents a novel clustering algorithm from the SPINEX (Similarity-based Predictions with Explainable Neighbors Exploration) algorithmic family. The newly proposed clustering variant leverages the concept of similarity and…

Machine Learning · Computer Science 2024-07-11 MZ Naser , Ahmed Naser

Approximate Nearest Neighbor Search (ANNS) on high-dimensional vectors has become a fundamental and essential component in various machine learning tasks. Recently, with the rapid development of deep learning models and the applications of…

Databases · Computer Science 2025-02-21 Zeyu Wang , Haoran Xiong , Qitong Wang , Zhenying He , Peng Wang , Themis Palpanas , Wei Wang

Nearest neighbor search aims to obtain the samples in the database with the smallest distances from them to the queries, which is a basic task in a range of fields, including computer vision and data mining. Hashing is one of the most…

Computer Vision and Pattern Recognition · Computer Science 2022-04-26 Xiao Luo , Haixin Wang , Daqing Wu , Chong Chen , Minghua Deng , Jianqiang Huang , Xian-Sheng Hua

The explosive growth in big data has attracted much attention in designing efficient indexing and search methods recently. In many critical applications such as large-scale search and pattern matching, finding the nearest neighbors to a…

Machine Learning · Computer Science 2015-09-21 Jun Wang , Wei Liu , Sanjiv Kumar , Shih-Fu Chang

Pyserini is an easy-to-use Python toolkit that supports replicable IR research by providing effective first-stage retrieval in a multi-stage ranking architecture. Our toolkit is self-contained as a standard Python package and comes with…

Information Retrieval · Computer Science 2021-02-22 Jimmy Lin , Xueguang Ma , Sheng-Chieh Lin , Jheng-Hong Yang , Ronak Pradeep , Rodrigo Nogueira

Fast approximate nearest neighbor (NN) search in large databases is becoming popular. Several powerful learning-based formulations have been proposed recently. However, not much attention has been paid to a more fundamental question: how…

Machine Learning · Computer Science 2012-07-03 Junfeng He , Sanjiv Kumar , Shih-Fu Chang