English
Related papers

Related papers: Scalable Blocking for Very Large Databases

200 papers

Dynamic program slicing can significantly reduce the code developers need to inspect by narrowing it down to only a subset of relevant program statements. However, despite an extensive body of research showing its usefulness, dynamic…

Software Engineering · Computer Science 2022-01-04 Bogdan Alexandru Stoica , Swarup K. Sahoo , James R. Larus , Vikram S. Adve

Hyperdimensional Computing (HDC) encodes information and data into high-dimensional distributed vectors that can be manipulated using simple bitwise operations and similarity searches, offering parallelism, low-precision hardware…

Hardware Architecture · Computer Science 2025-11-25 Quanling Zhao , Yanru Chen , Runyang Tian , Sumukh Pinge , Weihong Xu , Augusto Vega , Steven Holmes , Saransh Gupta , Tajana Rosing

Deoxyribonucleic acid (DNA) has shown great promise in enabling computational applications, most notably in the fields of DNA digital data storage and DNA computing. Information is encoded as DNA strands, which will naturally bind in…

Machine Learning · Computer Science 2021-10-22 David Buterez

Modern machine learning algorithms crucially rely on several design decisions to achieve strong performance, making the problem of Hyperparameter Optimization (HPO) more important than ever. Here, we combine the advantages of the popular…

Machine Learning · Computer Science 2021-10-22 Noor Awad , Neeratyoy Mallik , Frank Hutter

This paper presents DLHT, a concurrent in-memory hashtable. Despite efforts to optimize hashtables, that go as far as sacrificing core functionality, state-of-the-art designs still incur multiple memory accesses per request and block…

Databases · Computer Science 2024-06-17 Antonios Katsarakis , Vasilis Gavrielatos , Nikos Ntarmos

Hashing has been widely used for large-scale search due to its low storage cost and fast query speed. By using supervised information, supervised hashing can significantly outperform unsupervised hashing. Recently, discrete supervised…

Information Retrieval · Computer Science 2018-10-17 Qing-Yuan Jiang , Xue Cui , Wu-Jun Li

Training Long-Context Large Language Models (LLMs) is challenging, as hybrid training with long-context and short-context data often leads to workload imbalances. Existing works mainly use data packing to alleviate this issue, but fail to…

Machine Learning · Computer Science 2025-10-14 Yongqiang Yao , Jingru Tan , Kaihuan Liang , Feizhao Zhang , Jiahao Hu , Shuo Wu , Yazhe Niu , Ruihao Gong , Dahua Lin , Ningyi Xu

We develop a scalable algorithm to learn binary hash codes for indexing large-scale datasets. Near-isometric binary hashing (NIBH) is a data-dependent hashing scheme that quantizes the output of a learned low-dimensional embedding to obtain…

Data Structures and Algorithms · Computer Science 2016-03-15 Amirali Aghazadeh , Andrew Lan , Anshumali Shrivastava , Richard Baraniuk

Co-clustering simultaneously clusters rows and columns, revealing more fine-grained groups. However, existing co-clustering methods suffer from poor scalability and cannot handle large-scale data. This paper presents a novel and scalable…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-03-20 Zihan Wu , Zhaoke Huang , Hong Yan

Recently, hashing methods have been widely used in large-scale image retrieval. However, most existing hashing methods did not consider the hierarchical relation of labels, which means that they ignored the rich information stored in the…

Computer Vision and Pattern Recognition · Computer Science 2017-09-13 Dan Wang , Heyan Huang , Chi Lu , Bo-Si Feng , Liqiang Nie , Guihua Wen , Xian-Ling Mao

Large-scale, parallel clusters composed of commodity processors are increasingly available, enabling the use of vast processing capabilities and distributed RAM to solve hard search problems. We investigate Hash-Distributed A* (HDA*), a…

Artificial Intelligence · Computer Science 2015-03-20 Akihiro Kishimoto , Alex Fukunaga , Adi Botea

Deep learning is mainly based on utilizing gradient-based optimization for training Deep Neural Network (DNN) models. Although robust and widely used, gradient-based optimization algorithms are prone to getting stuck in local minima. In…

Neural and Evolutionary Computing · Computer Science 2024-08-15 Rasa Khosrowshahli , Shahryar Rahnamayan , Beatrice Ombuki-Berman

HDBSCAN is a density-based clustering algorithm that constructs a cluster hierarchy tree and then uses a specific stability measure to extract flat clusters from the tree. We show how the application of an additional threshold value can…

Databases · Computer Science 2021-01-22 Claudia Malzer , Marcus Baum

We propose a novel hashing-based matching scheme, called Locally Optimized Hashing (LOH), based on a state-of-the-art quantization algorithm that can be used for efficient, large-scale search, recommendation, clustering, and deduplication.…

Computer Vision and Pattern Recognition · Computer Science 2016-08-02 Yannis Kalantidis , Lyndon Kennedy , Huy Nguyen , Clayton Mellina , David A. Shamma

Consistent hashing (CH) has been pivotal as a data router and load balancer in diverse fields, including distributed databases, cloud infrastructure, and peer-to-peer networks. However, existing CH algorithms often fall short in…

Data Structures and Algorithms · Computer Science 2023-11-21 Chao Dong , Fang Wang , Dan Feng

Dataset condensation can be used to reduce the computational cost of training multiple models on a large dataset by condensing the training dataset into a small synthetic set. State-of-the-art approaches rely on matching the model gradients…

Machine Learning · Computer Science 2024-05-29 Mucong Ding , Yuancheng Xu , Tahseen Rabbani , Xiaoyu Liu , Brian Gravelle , Teresa Ranadive , Tai-Ching Tuan , Furong Huang

Record linkage seeks to merge databases and to remove duplicates when unique identifiers are not available. Most approaches use blocking techniques to reduce the computational complexity associated with record linkage. We review traditional…

Databases · Computer Science 2014-07-14 Rebecca C. Steorts , Samuel L. Ventura , Mauricio Sadinle , Stephen E. Fienberg

This paper focuses on density-based clustering, particularly the Density Peak (DP) algorithm and the one based on density-connectivity DBSCAN; and proposes a new method which takes advantage of the individual strengths of these two methods…

Machine Learning · Computer Science 2024-01-30 Ye Zhu , Kai Ming Ting , Yuan Jin , Maia Angelova

Timestamped relational datasets consisting of records between pairs of entities are ubiquitous in data and network science. For applications like peer-to-peer communication, email, social network interactions, and computer network security,…

Data Structures and Algorithms · Computer Science 2023-11-20 Michael Ostroski , Geoffrey Sanders , Trevor Steil , Roger Pearce

Pattern matching of streaming time series with lower latency under limited computing resource comes to a critical problem, especially as the growth of Industry 4.0 and Industry Internet of Things. However, against traditional single pattern…

Computer Vision and Pattern Recognition · Computer Science 2017-12-05 Rong Kang , Chen Wang , Peng Wang , Yuting Ding , Jianmin Wang