English
Related papers

Related papers: DxHash: A Scalable Consistent Hash Based on the Ps…

200 papers

Locality-sensitive hashing (LSH) is a fundamental technique for similarity search and similarity estimation in high-dimensional spaces. The basic idea is that similar objects should produce hash collisions with probability significantly…

Computational Geometry · Computer Science 2017-09-25 Joachim Gudmundsson , Rasmus Pagh

We introduce PaCHash, a hash table that stores its objects contiguously in an array without intervening space, even if the objects have variable size. In particular, each object can be compressed using standard compression techniques. A…

Data Structures and Algorithms · Computer Science 2022-11-09 Florian Kurpicz , Hans-Peter Lehmann , Peter Sanders

In this paper, we introduce DLB, a Deep Learning based load Balancing mechanism, to effectively address the data skew problem. The key idea of DLB is to replace hash functions in the load balancing mechanisms with deep learning models,…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-09-14 Xiaoke Zhu , Qi Zhang , Taining Cheng , Ling Liu , Wei Zhou , and Jing He

Hashing methods have made significant progress in cross-modal retrieval tasks with fast query speed and low storage cost. Among them, deep learning-based hashing achieves better performance on large-scale data due to its excellent…

Computer Vision and Pattern Recognition · Computer Science 2023-04-27 Liming Xu , Hanqi Li , Bochuan Zheng , Weisheng Li , Jiancheng Lv

In recent years, hashing methods have been proved to be effective and efficient for the large-scale Web media search. However, the existing general hashing methods have limited discriminative power for describing fine-grained objects that…

Computer Vision and Pattern Recognition · Computer Science 2019-02-04 Sheng Jin , Hongxun Yao , Xiaoshuai Sun , Shangchen Zhou , Lei Zhang , Xiansheng Hua

Unsupervised hashing can desirably support scalable content-based image retrieval (SCBIR) for its appealing advantages of semantic label independence, memory and search efficiency. However, the learned hash codes are embedded with limited…

Information Retrieval · Computer Science 2019-04-26 Lei Zhu , Zi Huang , Zhihui Li , Liang Xie , Heng Tao Shen

This paper presents an efficient wait-free resizable hash table. To achieve high throughput at large core counts, our algorithm is specifically designed to retain the natural parallelism of concurrent hashing, while providing wait-free…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-04-21 Panagiota Fatourou , Nikolaos D. Kallimanis , Thomas Ropars

Locality-sensitive hashing (LSH) based frameworks have been used efficiently to select weight vectors in a dense hidden layer with high cosine similarity to an input, enabling dynamic pruning. While this type of scheme has been shown to…

Machine Learning · Computer Science 2023-06-06 Tahseen Rabbani , Marco Bornstein , Furong Huang

The Min-Hashing approach to sketching has become an important tool in data analysis, information retrial, and classification. To apply it to real-valued datasets, the ICWS algorithm has become a seminal approach that is widely used, and…

Machine Learning · Statistics 2018-10-24 Edward Raff , Jared Sylvester , Charles Nicholas

Minimal perfect hash functions provide space-efficient and collision-free hashing on static sets. Existing algorithms and implementations that build such functions have practical limitations on the number of input elements they can process,…

Data Structures and Algorithms · Computer Science 2018-11-06 Antoine Limasset , Guillaume Rizk , Rayan Chikhi , Pierre Peterlongo

One of the basic tasks in bioinformatics is localizing a short subsequence $S$, read while sequencing, in a long reference sequence $R$, like the human geneome. A natural rapid approach would be finding a hash value for $S$ and compare it…

Data Structures and Algorithms · Computer Science 2016-02-19 Jarek Duda

Key-based workload partitioning is a common strategy used in parallel stream processing engines, enabling effective key-value tuple distribution over worker threads in a logical operator. While randomized hashing on the keys is capable of…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-12-14 Junhua Fang , Rong Zhang , Tom Z. J. Fu , Zhenjie Zhang , Aoying Zhou , Junhua Zhu

Deduplication has been largely employed in distributed storage systems to improve space efficiency. Traditional deduplication research ignores the design specifications of shared-nothing distributed storage systems such as no central…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-03-22 Awais Khan , Chang-Gyu Lee , Prince Hamandawana , Sungyong Park , Youngjae Kim

Data sharding, a technique for partitioning and distributing data among multiple servers or nodes, offers enhancements in the scalability, performance, and fault tolerance of extensive distributed systems. Nonetheless, this strategy…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-05-02 Ayush Thakur , Sanskar Chauhan , Ilisha Tomar , Vaibhavi Paul , Deepak Gupta

Distributed applications require novel solutions to tackle problems that arise due to the scarcity of resources such as bandwidth, memory and processing power. One of these challenges is seen in distributed data management. The challenge is…

Social and Information Networks · Computer Science 2020-04-16 Newton Masinde , Moritz Kanzler , Kalman Graffi

Code retrieval, which retrieves code snippets based on users' natural language descriptions, is widely used by developers and plays a pivotal role in real-world software development. The advent of deep learning has shifted the retrieval…

Software Engineering · Computer Science 2024-12-17 Wenchao Gu , Ensheng Shi , Yanlin Wang , Lun Du , Shi Han , Hongyu Zhang , Dongmei Zhang , Michael R. Lyu

Due to its low storage cost and fast query speed, cross-modal hashing (CMH) has been widely used for similarity search in multimedia retrieval applications. However, almost all existing CMH methods are based on hand-crafted features which…

Information Retrieval · Computer Science 2016-02-16 Qing-Yuan Jiang , Wu-Jun Li

Deep hashing has recently received attention in cross-modal retrieval for its impressive advantages. However, existing hashing methods for cross-modal retrieval cannot fully capture the heterogeneous multi-modal correlation and exploit the…

Information Retrieval · Computer Science 2020-04-02 Li Wang , Lei Zhu , En Yu , Jiande Sun , Huaxiang Zhang

With the rapid growth of multimedia data (e.g., image, audio and video etc.) on the web, learning-based hashing techniques such as Deep Supervised Hashing (DSH) have proven to be very efficient for large-scale multimedia search. The recent…

Information Retrieval · Computer Science 2019-01-09 Zhan Yang , Osolo Ian Raymond , Wuqing Sun , Jun Long

Addressing the challenge of balancing security and efficiency when deploying machine learning systems in untrusted environments, such as federated learning, remains a critical concern. A promising strategy to tackle this issue involves…

Cryptography and Security · Computer Science 2023-12-29 Dongfang Zhao