English
Related papers

Related papers: Binary Embedding: Fundamental Limits and Fast Algo…

200 papers

New lower bounds on the minimum average Hamming distance of binary codes are derived. The bounds are obtained using linear programming approach.

Information Theory · Computer Science 2007-07-13 Beniamin Mounits

Binary codes can be used to speed up nearest neighbor search tasks in large scale data sets as they are efficient for both storage and retrieval. In this paper, we propose a robust auto-encoder model that preserves the geometric…

Computer Vision and Pattern Recognition · Computer Science 2016-03-02 Xiping Fu , Brendan McCane , Steven Mills , Michael Albert , Lech Szymanski

Just as semantic hashing can accelerate information retrieval, binary valued embeddings can significantly reduce latency in the retrieval of graphical data. We introduce a simple but effective model for learning such binary vectors for…

Machine Learning · Computer Science 2018-03-28 Vinith Misra , Sumit Bhatia

There is growing interest in representing image data and feature descriptors using compact binary codes for fast near neighbor search. Although binary codes are motivated by their use as direct indices (addresses) into a hash table, codes…

Computer Vision and Pattern Recognition · Computer Science 2014-04-28 Mohammad Norouzi , Ali Punjani , David J. Fleet

In reversible data embedding, to avoid overflow and underflow problem, before data embedding, boundary pixels are recorded as side information, which may be losslessly compressed. The existing algorithms often assume that a natural image…

Multimedia · Computer Science 2021-10-08 Hanzhou Wu , Wei Wang , Jing Dong , Yanli Chen , Hongxia Wang

We consider the problem of encoding a finite set of vectors into a small number of bits while approximately retaining information on the angular distances between the vectors. By deriving improved variance bounds related to binary Gaussian…

Information Theory · Computer Science 2017-12-27 Sjoerd Dirksen , Alexander Stollenwerk

Persistence diagrams are important descriptors in Topological Data Analysis. Due to the nonlinearity of the space of persistence diagrams equipped with their {\em diagram distances}, most of the recent attempts at using persistence diagrams…

Machine Learning · Computer Science 2019-08-09 Mathieu Carriere , Ulrich Bauer

Learning based hashing methods have attracted considerable attention due to their ability to greatly increase the scale at which existing algorithms may operate. Most of these methods are designed to generate binary codes preserving the…

Computer Vision and Pattern Recognition · Computer Science 2016-01-20 Fumin Shen , Chunhua Shen , Qinfeng Shi , Anton van den Hengel , Zhenmin Tang , Heng Tao Shen

We prove that every $1$-error-correcting code over a finite field can be embedded in a $1$-perfect code of some larger length. Embedding in this context means that the original code is a subcode of the resulting $1$-perfect code and can be…

Combinatorics · Mathematics 2015-06-09 Denis S. Krotov , Evgeniya V. Sotnikova

For natural language understanding and generation, embedding concepts using an order-based representation is an essential task. Unlike traditional point vector based representation, an order-based representation imposes geometric…

Computation and Language · Computer Science 2024-04-18 Croix Gyurek , Niloy Talukder , Mohammad Al Hasan

We present MMbeddings, a probabilistic embedding approach that reinterprets categorical embeddings through the lens of nonlinear mixed models, effectively bridging classical statistical theory with modern deep learning. By treating…

Machine Learning · Statistics 2025-11-04 Giora Simchoni , Saharon Rosset

This paper proposes a generic formulation that significantly expedites the training and deployment of image classification models, particularly under the scenarios of many image categories and high feature dimensions. As a defining…

Computer Vision and Pattern Recognition · Computer Science 2016-03-15 Fumin Shen , Yadong Mu , Wei Liu , Yang Yang , Heng Tao Shen

We devise a new embedding technique, which we call measured descent, based on decomposing a metric space locally, at varying speeds, according to the density of some probability measure. This provides a refined and unified framework for the…

Data Structures and Algorithms · Computer Science 2007-05-23 Robert Krauthgamer , James R. Lee , Manor Mendel , Assaf Naor

Hashing is at the heart of large-scale image similarity search, and recent methods have been substantially improved through deep learning techniques. Such algorithms typically learn continuous embeddings of the data. To avoid a subsequent…

Computer Vision and Pattern Recognition · Computer Science 2024-01-17 Lucas R. Schwengber , Lucas Resende , Paulo Orenstein , Roberto I. Oliveira

We present here new mechanisms for hashing data via binary embeddings. Contrary to most of the techniques presented before, the embedding matrix of our mechanism is highly structured. That enables us to perform hashing more efficiently and…

Data Structures and Algorithms · Computer Science 2015-05-14 Krzysztof Choromanski

We consider the problem of encoding a set of vectors into a minimal number of bits while preserving information on their Euclidean geometry. We show that this task can be accomplished by applying a Johnson-Lindenstrauss embedding and…

Information Theory · Computer Science 2022-04-12 Sjoerd Dirksen , Alexander Stollenwerk

We use some of the largest order statistics of the random projections of a reference signal to construct a binary embedding that is adapted to signals correlated with such signal. The embedding is characterized from the analytical…

Machine Learning · Computer Science 2017-01-31 Diego Valsesia , Enrico Magli

Binary hashing is a well-known approach for fast approximate nearest-neighbor search in information retrieval. Much work has focused on affinity-based objective functions involving the hash functions or binary codes. These objective…

Machine Learning · Computer Science 2016-02-05 Miguel Á. Carreira-Perpiñán , Ramin Raziperchikolaei

Johnson-Lindenstrauss embeddings are widely used to reduce the dimension and thus the processing time of data. To reduce the total complexity, also fast algorithms for applying these embeddings are necessary. To date, such fast algorithms…

Data Structures and Algorithms · Computer Science 2020-04-30 Stefan Bamberger , Felix Krahmer

The Whitney embedding theorem gives an upper bound on the smallest embedding dimension of a manifold. If a data set lies on a manifold, a random projection into this reduced dimension will retain the manifold structure. Here we present an…

Machine Learning · Statistics 2017-11-06 David W. Dreisigmeyer