English
Related papers

Related papers: A Universal Parallel Two-Pass MDL Context Tree Com…

200 papers

There has been a significant amount of work in the literature proposing semantic relaxation of concurrent data structures for improving scalability and performance. By relaxing the semantics of a data structure, a bigger design space, that…

Data Structures and Algorithms · Computer Science 2025-11-11 Adones Rukundo , Aras Atalar , Philippas Tsigas

Learning-based lossless compressors play a crucial role in large-scale genomic database backup, storage, transmission, and management. However, their 1) inadequate compression ratio, 2) low compression \& decompression throughput, and 3)…

Machine Learning · Computer Science 2025-07-18 Hui Sun , Yanfeng Ding , Liping Yi , Huidong Ma , Gang Wang , Xiaoguang Liu , Cheng Zhong , Wentong Cai

The rapid growth of digital data has heightened the demand for efficient lossless compression methods. However, existing algorithms exhibit trade-offs: some achieve high compression ratios, others excel in encoding or decoding speed, and…

Information Theory · Computer Science 2025-10-01 Md. Atiqur Rahman , MM Fazle Rabbi

We show fast deterministic algorithms for fundamental problems on forests in the challenging low-space regime of the well-known Massive Parallel Computation (MPC) model. A recent breakthrough result by Coy and Czumaj [STOC'22] shows that,…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-11-08 Alkida Balliu , Rustam Latypov , Yannic Maus , Dennis Olivetti , Jara Uitto

The paper introduces a new technique for compressing Binary Decision Diagrams in those cases where random access is not required. Using this technique, compression and decompression can be done in linear time in the size of the BDD and…

Artificial Intelligence · Computer Science 2008-12-18 Esben Rune Hansen , S. Srinivasa Rao , Peter Tiedemann

As nowadays Machine Learning (ML) techniques are generating huge data collections, the problem of how to efficiently engineer their storage and operations is becoming of paramount importance. In this article we propose a new lossless…

Data Structures and Algorithms · Computer Science 2022-03-31 Paolo Ferragina , Travis Gagie , Dominik Köppl , Giovanni Manzini , Gonzalo Navarro , Manuel Striani , Francesco Tosoni

Miller and Reif's FOCS'85 classic and fundamental tree contraction algorithm is a broadly applicable technique for the parallel solution of a large number of tree problems. Additionally it is also used as an algorithmic design technique for…

Data Structures and Algorithms · Computer Science 2021-11-04 MohammadTaghi Hajiaghayi , Marina Knittel , Hamed Saleh , Hsin-Hao Su

Computing a Single-Linkage Dendrogram (SLD) is a key step in the classic single-linkage hierarchical clustering algorithm. Given an input edge-weighted tree $T$, the SLD of $T$ is a binary dendrogram that summarizes the $n-1$ clusterings…

Data Structures and Algorithms · Computer Science 2024-05-14 Laxman Dhulipala , Xiaojun Dong , Kishen N Gowda , Yan Gu

In this paper, we introduce the first machine learning framework for predicting optimal processing times in Single-Level Tree Network (SLTN) architectures for the Divisible Load Theory (DLT) paradigm. Using a feedforward neural network(FNN)…

Machine Learning · Computer Science 2026-05-25 Bharadwaj Veeravalli

In the field of biological research, it is essential to comprehend the characteristics and functions of molecular sequences. The classification of molecular sequences has seen widespread use of neural network-based techniques. Despite their…

Machine Learning · Computer Science 2024-02-14 Sarwan Ali , Tamkanat E Ali , Prakash Chourasia , Murray Patterson

For over a decade now we have been witnessing the success of {\em massive parallel computation} (MPC) frameworks, such as MapReduce, Hadoop, Dryad, or Spark. One of the reasons for their success is the fact that these frameworks are able to…

Data Structures and Algorithms · Computer Science 2018-02-02 Artur Czumaj , Jakub Łącki , Aleksander Mądry , Slobodan Mitrović , Krzysztof Onak , Piotr Sankowski

We study the allocation problem in the Massively Parallel Computation (MPC) model. This problem is a special case of $b$-matching, in which the input is a bipartite graph with capacities greater than $1$ in only one part of the bipartition.…

Data Structures and Algorithms · Computer Science 2025-06-06 Jakub Łącki , Slobodan Mitrović , Srikkanth Ramachandran , Wen-Horng Sheu

It was estimated that the world produced $59 ZB$ ($5.9 \times 10^{13} GB$) of data in 2020, resulting in the enormous costs of both data storage and transmission. Fortunately, recent advances in deep generative models have spearheaded a new…

Machine Learning · Computer Science 2021-11-02 Shifeng Zhang , Ning Kang , Tom Ryder , Zhenguo Li

This paper presents new parallel algorithms for generating Euclidean minimum spanning trees and spatial clustering hierarchies (known as HDBSCAN$^*$). Our approach is based on generating a well-separated pair decomposition followed by using…

Data Structures and Algorithms · Computer Science 2021-04-05 Yiqiu Wang , Shangdi Yu , Yan Gu , Julian Shun

We study the minimum spanning tree (MST) problem in the massively parallel computation (MPC) model. Our focus is particularly on the *strictly sublinear* regime of MPC where the space per machine is $O(n^\delta)$. Here $n$ is the number of…

Data Structures and Algorithms · Computer Science 2025-10-10 Amir Azarmehr , Soheil Behnezhad , Rajesh Jayaram , Jakub Łącki , Vahab Mirrokni , Peilin Zhong

We study the classic Euclidean Minimum Spanning Tree (MST) problem in the Massively Parallel Computation (MPC) model. Given a set $X \subset \mathbb{R}^d$ of $n$ points, the goal is to produce a spanning tree for $X$ with weight within a…

Data Structures and Algorithms · Computer Science 2023-08-02 Rajesh Jayaram , Vahab Mirrokni , Shyam Narayanan , Peilin Zhong

This paper presents an $O(\log\log \bar{d})$ round massively parallel algorithm for $1+\epsilon$ approximation of maximum weighted $b$-matchings, using near-linear memory per machine. Here $\bar{d}$ denotes the average degree in the graph…

Data Structures and Algorithms · Computer Science 2022-11-16 Mohsen Ghaffari , Christoph Grunau , Slobodan Mitrović

Softwares source code is becoming large and complex. Compilation of large base code is a time consuming process. Parallel compilation of code will help in reducing the time complexity. Parsing is one of the phases in compiler in which…

Programming Languages · Computer Science 2015-09-29 Abhinav Jangda

Split computing has emerged as a recent paradigm for implementation of DNN-based AI workloads, wherein a DNN model is split into two parts, one of which is executed on a mobile/client device and the other on an edge-server (or cloud). Data…

Machine Learning · Computer Science 2022-08-25 Parual Datta , Nilesh Ahuja , V. Srinivasa Somayazulu , Omesh Tickoo

Scaling long-context ability is essential for Large Language Models (LLMs). To amortize the memory consumption across multiple devices in long-context training, inter-data partitioning (a.k.a. Data Parallelism) and intra-data partitioning…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-09-01 Hao Ge , Junda Feng , Qi Huang , Fangcheng Fu , Xiaonan Nie , Lei Zuo , Haibin Lin , Bin Cui , Xin Liu