English
Related papers

Related papers: On the Needs for Rotations in Hypercubic Quantizat…

200 papers

Binary neural networks, i.e., neural networks whose parameters and activations are constrained to only two possible values, offer a compelling avenue for the deployment of deep learning models on energy- and memory-limited devices. However,…

Due to the impressive learning power, deep learning has achieved a remarkable performance in supervised hash function learning. In this paper, we propose a novel asymmetric supervised deep hashing method to preserve the semantic structure…

Computer Vision and Pattern Recognition · Computer Science 2018-01-26 Jinxing Li , Bob Zhang , Guangming Lu , David Zhang

We investigate iterative methods with randomized preconditioners for solving overdetermined least-squares problems, where the preconditioners are based on a random embedding of the data matrix. We consider two distinct approaches: the…

Numerical Analysis · Mathematics 2021-04-15 Jonathan Lacotte , Mert Pilanci

Similarity search retrieves the nearest neighbors of a query vector from a dataset of high-dimensional vectors. As the size of the dataset grows, the cost of performing the distance computations needed to implement a query can become…

Machine Learning · Computer Science 2019-12-20 Soroosh Khoram , Stephen J Wright , Jing Li

We present a powerful new loss function and training scheme for learning binary hash codes with any differentiable model and similarity function. Our loss function improves over prior methods by using log likelihood loss on top of an…

Machine Learning · Computer Science 2018-10-03 Martin Loncaric , Bowei Liu , Ryan Weber

We consider sketching algorithms which first compress data by multiplication with a random sketch matrix, and then apply the sketch to quickly solve an optimization problem, e.g., low-rank approximation and regression. In the learning-based…

Machine Learning · Computer Science 2024-04-12 Yi Li , Honghao Lin , Simin Liu , Ali Vakilian , David P. Woodruff

This technical note compares two coding (quantization) schemes for random projections in the context of sub-linear time approximate near neighbor search. The first scheme is based on uniform quantization while the second scheme utilizes a…

Machine Learning · Computer Science 2014-04-01 Ping Li , Michael Mitzenmacher , Anshumali Shrivastava

Convergence guarantees for optimization over bounded-rank matrices are delicate to obtain because the feasible set is a non-smooth and non-convex algebraic variety. Existing techniques include projected gradient descent, fixed-rank…

Optimization and Control · Mathematics 2024-06-21 Quentin Rebjock , Nicolas Boumal

Hash-based sampling and estimation are common themes in computing. Using hashing for sampling gives us the coordination needed to compare samples from different sets. Hashing is also used when we want to count distinct elements. The quality…

Data Structures and Algorithms · Computer Science 2024-12-02 Anders Aamand , Ioana O. Bercea , Jakob Bæk Tejs Houen , Jonas Klausen , Mikkel Thorup

Pairwise alignment of DNA sequencing data is a ubiquitous task in bioinformatics and typically represents a heavy computational burden. A standard approach to speed up this task is to compute "sketches" of the DNA reads (typically via…

Information Theory · Computer Science 2021-07-12 Ilan Shomorony , Govinda M. Kamath

We present an efficient algorithm for the application of sequences of planar rotations to a matrix. Applying such sequences efficiently is important in many numerical linear algebra algorithms for eigenvalues. Our algorithm is novel in…

Performance · Computer Science 2024-12-04 Thijs Steel , Julien Langou

How data is represented and operationalized is critical for building computational solutions that are both effective and efficient. A common approach is to represent data objects as binary vectors, denoted \textit{hash codes}, which require…

Information Retrieval · Computer Science 2021-09-07 Casper Hansen

We investigate regularized algorithms combining with projection for least-squares regression problem over a Hilbert space, covering nonparametric regression over a reproducing kernel Hilbert space. We prove convergence results with respect…

Machine Learning · Statistics 2018-10-09 Junhong Lin , Volkan Cevher

This paper addresses the problem of learning binary hash codes for large scale image search by proposing a novel hashing method based on deep neural network. The advantage of our deep model over previous deep model used in hashing is that…

Computer Vision and Pattern Recognition · Computer Science 2015-08-31 Thanh-Toan Do , Anh-Zung Doan , Ngai-Man Cheung

Deep hashing has shown promising performance in large-scale image retrieval. However, latent codes extracted by Deep Neural Networks (DNNs) will inevitably lose semantic information during the binarization process, which damages the…

Computer Vision and Pattern Recognition · Computer Science 2022-01-13 Chengyin Xu , Zenghao Chai , Zhengzhuo Xu , Hongjia Li , Qiruyi Zuo , Lingyu Yang , Chun Yuan

Combinatorial problems are formulated to find optimal designs within a fixed set of constraints. They are commonly found across diverse engineering and scientific domains. Understanding how to best use quantum computers for combinatorial…

We present a new simple method for rounding a semidefinite programming relaxation of a constraint satisfaction problem. We apply it to the problem of approximate angular synchronization. Specifically, we are given directed distances on a…

Data Structures and Algorithms · Computer Science 2018-12-11 Kevin L. Chang , Alantha Newman

We consider the problem of solving a distributed optimization problem using a distributed computing platform, where the communication in the network is limited: each node can only communicate with its neighbours and the channel has a…

Systems and Control · Computer Science 2015-04-10 Ye Pu , Melanie N. Zeilinger , Colin N. Jones

Matrix sketching is a powerful tool for reducing the size of large data matrices. Yet there are fundamental limitations to this size reduction when we want to recover an accurate estimator for a task such as least square regression. We show…

Data Structures and Algorithms · Computer Science 2024-05-10 Sachin Garg , Kevin Tan , Michał Dereziński

Many clustering problems in computer vision and other contexts are also classification problems, where each cluster shares a meaningful label. Subspace clustering algorithms in particular are often applied to problems that fit this…

Machine Learning · Computer Science 2017-09-15 John Lipor , Laura Balzano