English
Related papers

Related papers: Faster Binary Embeddings for Preserving Euclidean …

200 papers

The Johnson-Lindenstrauss transform allows one to embed a dataset of $n$ points in $\mathbb{R}^d$ into $\mathbb{R}^m,$ while preserving the pairwise distance between any pair of points up to a factor $(1 \pm \varepsilon)$, provided that $m…

Data Structures and Algorithms · Computer Science 2022-07-08 Ora Nova Fandina , Mikael Møller Høgsgaard , Kasper Green Larsen

We study the Closest Pair Problem in Hamming metric, which asks to find the pair with the smallest Hamming distance in a collection of binary vectors. We give a new randomized algorithm for the problem on uniformly random input…

Data Structures and Algorithms · Computer Science 2021-12-08 Andre Esser , Robert Kübler , Floyd Zweydinger

We present a deep learning approach for learning the joint semantic embeddings of images and captions in a Euclidean space, such that the semantic similarity is approximated by the L2 distances in the embedding space. For that, we introduce…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Noam Malali , Yosi Keller

Binary codes can be used to speed up nearest neighbor search tasks in large scale data sets as they are efficient for both storage and retrieval. In this paper, we propose a robust auto-encoder model that preserves the geometric…

Computer Vision and Pattern Recognition · Computer Science 2016-03-02 Xiping Fu , Brendan McCane , Steven Mills , Michael Albert , Lech Szymanski

We study first-order optimization algorithms under the constraint that the descent direction is quantized using a pre-specified budget of $R$-bits per dimension, where $R \in (0 ,\infty)$. We propose computationally efficient optimization…

Machine Learning · Computer Science 2022-08-17 Rajarshi Saha , Mert Pilanci , Andrea J. Goldsmith

We present here new mechanisms for hashing data via binary embeddings. Contrary to most of the techniques presented before, the embedding matrix of our mechanism is highly structured. That enables us to perform hashing more efficiently and…

Data Structures and Algorithms · Computer Science 2015-05-14 Krzysztof Choromanski

Embedding models have become essential tools in both natural language processing and computer vision, enabling efficient semantic search, recommendation, clustering, and more. However, the high memory and computational demands of…

Computation and Language · Computer Science 2024-11-26 Jiayi Chen , Chen Wu , Shaoqun Zhang , Nan Li , Liangjie Zhang , Qi Zhang

Existing deep embedding methods in vision tasks are capable of learning a compact Euclidean space from images, where Euclidean distances correspond to a similarity metric. To make learning more effective and efficient, hard sample mining is…

Computer Vision and Pattern Recognition · Computer Science 2016-10-28 Chen Huang , Chen Change Loy , Xiaoou Tang

Stochastic Neighbor Embedding (SNE) algorithms like UMAP and tSNE often produce visualizations that do not preserve the geometry of noisy and high dimensional data. In particular, they can spuriously separate connected components of the…

Machine Learning · Computer Science 2025-09-05 Tristan Luca Saidi , Abigail Hickok , Bastian Rieck , Andrew J. Blumberg

In this paper we propose an approach to embed continuous and selector cues in binary feature descriptors used for visual place recognition. The embedding is achieved by extending each feature descriptor with a binary string that encodes a…

Robotics · Computer Science 2018-09-19 Dominik Schlegel , Giorgio Grisetti

Embeddings provide compact representations of signals in order to perform efficient inference in a wide variety of tasks. In particular, random projections are common tools to construct Euclidean distance-preserving embeddings, while…

Data Structures and Algorithms · Computer Science 2019-09-05 Diego Valsesia , Sophie Marie Fosson , Chiara Ravazzi , Tiziano Bianchi , Enrico Magli

Proximities are at the heart of almost all machine learning methods. If the input data are given as numerical vectors of equal lengths, euclidean distance, or a Hilbertian inner product is frequently used in modeling algorithms. In a more…

Machine Learning · Computer Science 2020-09-01 Maximilian Münch , Michiel Straat , Michael Biehl , Frank-Michael Schleif

This paper investigates theoretical properties of subsampling and hashing as tools for approximate Euclidean norm-preserving embeddings for vectors with (unknown) additive Gaussian noises. Such embeddings are sometimes called…

Data Structures and Algorithms · Computer Science 2022-09-05 Zhen Shao

We study the problem of recovering a globally consistent Euclidean embedding of data, given only a local distance graph and propose a method that optimally represents these distances. The method operates solely on a neighborhood graph…

Machine Learning · Computer Science 2026-05-20 Dimitris Arabadjis

Learning based hashing methods have attracted considerable attention due to their ability to greatly increase the scale at which existing algorithms may operate. Most of these methods are designed to generate binary codes preserving the…

Computer Vision and Pattern Recognition · Computer Science 2016-01-20 Fumin Shen , Chunhua Shen , Qinfeng Shi , Anton van den Hengel , Zhenmin Tang , Heng Tao Shen

The use of high-dimensional features has become a normal practice in many computer vision applications. The large dimension of these features is a limiting factor upon the number of data points which may be effectively stored and processed,…

Computer Vision and Pattern Recognition · Computer Science 2015-06-18 Sakrapee Paisitkriangkrai , Chunhua Shen , Anton van den Hengel

Stochastic Neighbor Embedding and its variants are widely used dimensionality reduction techniques -- despite their popularity, no theoretical results are known. We prove that the optimal SNE embedding of well-separated clusters from high…

Machine Learning · Statistics 2017-02-24 Uri Shaham , Stefan Steinerberger

This paper concerns the problem of 1-bit compressed sensing, where the goal is to estimate a sparse signal from a few of its binary measurements. We study a non-convex sparsity-constrained program and present a novel and concise analysis…

Machine Learning · Computer Science 2020-07-10 Jie Shen

The development of data-dependent heuristics and representations for biological sequences that reflect their evolutionary distance is critical for large-scale biological research. However, popular machine learning approaches, based on…

Quantitative Methods · Quantitative Biology 2021-10-13 Gabriele Corso , Rex Ying , Michal Pándy , Petar Veličković , Jure Leskovec , Pietro Liò

Learning based hashing methods have attracted considerable attention due to their ability to greatly increase the scale at which existing algorithms may operate. Most of these methods are designed to generate binary codes that preserve the…

Machine Learning · Computer Science 2016-11-17 Fumin Shen , Chunhua Shen , Qinfeng Shi , Anton van den Hengel , Zhenmin Tang