English
Related papers

Related papers: Scaling and Load-Balancing Equi-Joins

200 papers

This paper presents implementation details and empirical results for a hybrid message passing and shared memory paralleliziation of the adaptive integral method (AIM). AIM is implemented on a (near) petaflop supercomputing cluster of…

Computational Engineering, Finance, and Science · Computer Science 2010-10-08 Fangzhou Wei , Ali E. Yılmaz

The self-join finds all objects in a dataset that are within a search distance, epsilon, of each other; therefore, the self-join is a building block of many algorithms. We advance a GPU-accelerated self-join algorithm targeted towards high…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-09-27 Michael Gowanlock , Ben Karsin

We consider running-time optimization for band-joins in a distributed system, e.g., the cloud. To balance load across worker machines, input has to be partitioned, which causes duplication. We explore how to resolve this tension between…

Databases · Computer Science 2020-04-15 Rundong Li , Wolfgang Gatterbauer , Mirek Riedewald

Conjunctive queries are the most basic and central class of database queries. With the continued growth of demands to manage and process the massive volume of different types of data, there is little research to study the conjunctive…

Databases · Computer Science 2022-06-10 Yuxing Chen , Jiaheng Lu

In this paper we propose and prove that cyclic quorum sets can efficiently manage all-pairs computations and data replication. The quorums are O(N/sqrt(P)) in size, up to 50% smaller than the dual N/sqrt(P) array implementations, and…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-08-19 Cory J. Kleinheksel , Arun K. Somani

Top-k queries have been studied intensively in the database community and they are an important means to reduce query cost when only the "best" or "most interesting" results are needed instead of the full output. While some optimality…

Databases · Computer Science 2020-05-04 Nikolaos Tziavelis , Wolfgang Gatterbauer , Mirek Riedewald

As database query processing techniques are being used to handle diverse workloads, a key emerging challenge is how to efficiently handle multi-way join queries containing multiple many-to-many joins. While uncommon in traditional…

Databases · Computer Science 2025-05-20 Hasara Kalumin , Amol Deshpande

Indexing is a well-known database technique used to facilitate data access and speed up query processing. Nevertheless, the construction and modification of indexes are very expensive. In traditional approaches, all records in the database…

Databases · Computer Science 2023-06-22 Wojciech Macyna , Michal Kukowski

Computation methods for solving entropy-regularized reward optimization -- a class of problems widely used for fine-tuning generative models -- have advanced rapidly. Among those, Adjoint Matching (AM, Domingo-Enrich et al., 2025) has…

Machine Learning · Statistics 2026-02-17 Oswin So , Brian Karrer , Chuchu Fan , Ricky T. Q. Chen , Guan-Horng Liu

Uniform sampling and approximate counting are fundamental primitives for modern database applications, ranging from query optimization to approximate query processing. While recent breakthroughs have established optimal sampling and…

Databases · Computer Science 2026-05-13 Xiao Hu , Jinchao Huang

We study the problem of edit similarity joins, where given a set of strings and a threshold value $K$, we want to output all pairs of strings whose edit distances are at most $K$. Edit similarity join is a fundamental problem in data…

Databases · Computer Science 2017-10-10 Haoyu Zhang , Qin Zhang

Trusted execution environment (TEE) has provided an isolated and secure environment for building cloud-based analytic systems, but it still suffers from access pattern leakages caused by side-channel attacks. To better secure the data,…

Cryptography and Security · Computer Science 2025-01-17 Yilei Wang , Xiangdong Zeng , Sheng Wang , Feifei Li

Streaming data join is a critical process in the field of near-real-time data warehousing. For this purpose, an adaptive semi-stream join algorithm called CACHEJOIN (Cache Join) focusing non-uniform stream data is provided in the…

Databases · Computer Science 2019-11-11 M. Asif Naeem , Erum Mehmood , M G Abbas , Noreen Jamil

Database management systems (DBMSs) carefully optimize complex multi-join queries to avoid expensive disk I/O. As servers today feature tens or hundreds of gigabytes of RAM, a significant fraction of many analytic databases becomes…

Databases · Computer Science 2015-07-22 Feilong Liu , Spyros Blanas

This paper focuses on data structures for multi-core reachability, which is a key component in model checking algorithms and other verification methods. A cornerstone of an efficient solution is the storage of visited states. In related…

Distributed, Parallel, and Cluster Computing · Computer Science 2010-05-06 Alfons Laarman , Jaco van de Pol , Michael Weber

A fundamental challenge in large-scale cloud networks and data centers is to achieve highly efficient server utilization and limit energy consumption, while providing excellent user-perceived performance in the presence of uncertain and…

Probability · Mathematics 2017-06-23 Debankur Mukherjee , Souvik Dhara , Sem Borst , Johan S. H. van Leeuwaarden

The integration of Artificial Intelligence (AI) in education requires scalable and efficient frameworks that balance performance, adaptability, and cost. This paper addresses these needs by proposing a shared backbone model architecture…

Computation and Language · Computer Science 2025-06-24 Ehsan Latif , Xiaoming Zhai

State-of-the-art deep learning models have achieved significant performance levels on various benchmarks. However, the excellent performance comes at a cost of inefficient computational cost. Light-weight architectures, on the other hand,…

Computer Vision and Pattern Recognition · Computer Science 2021-10-22 Mohammad Akbari , Amin Banitalebi-Dehkordi , Yong Zhang

Recent development in computing, sensing and crowd-sourced data have resulted in an explosion in the availability of quantitative information. The possibilities of analyzing this so-called Big Data to inform research and the decision-making…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-07-09 Nguyen Ho , Huy Vo , Mai Vu , Torben Bach Pedersen

The Subgraph Matching (SM) problem consists of finding all the embeddings of a given small graph, called the query, into a large graph, called the target. The SM problem has been widely studied for simple graphs, i.e. graphs where there is…