English
Related papers

Related papers: Adaptive Parallel Downloader for Large Genomic Dat…

200 papers

DNA is a promising medium for digital information storage for its exceptional density and durability. While prior studies advanced coding theory, workflow design, and simulation tools, challenges such as synthesis costs, sequencing errors,…

Emerging Technologies · Computer Science 2025-10-06 Rakesh Thakur , Lavanya Singh , Yashika , Manomay Bundawala , Aruna Kumar

The Grid Datafarm architecture is designed for global petascale data-intensive computing. It provides a global parallel filesystem with online petascale storage, scalable I/O bandwidth, and scalable parallel processing, and it can exploit…

Performance · Computer Science 2007-05-23 Osamu Tatebe , Satoshi Sekiguchi , Youhei Morita , Satoshi Matsuoka , Noriyuki Soda

$k$d-trees are widely used in parallel databases to support efficient neighborhood/similarity queries. Supporting parallel updates to $k$d-trees is therefore an important operation. In this paper, we present BDL-tree, a parallel,…

Data Structures and Algorithms · Computer Science 2021-12-14 Rahul Yesantharao , Yiqiu Wang , Laxman Dhulipala , Julian Shun

The exponential growth of DNA sequencing data has outpaced traditional heuristic-based methods, which struggle to scale effectively. Efficient computational approaches are urgently needed to support large-scale similarity search, a…

Due to the continuously improving capabilities of mobile edges, recommender systems start to deploy models on edges to alleviate network congestion caused by frequent mobile requests. Several studies have leveraged the proximity of…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-06-18 Kairui Fu , Shengyu Zhang , Zheqi Lv , Jingyuan Chen , Jiwei Li

Many scientific computations need multi-node parallelism for matching up both space (memory) and time (speed) ever-increasing requirements. The use of GPUs as accelerators introduces yet another level of complexity for the programmer and…

Shared memory multiprocessors come back to popularity thanks to rapid spreading of commodity multi-core architectures. As ever, shared memory programs are fairly easy to write and quite hard to optimise; providing multi-core programmers…

Distributed, Parallel, and Cluster Computing · Computer Science 2009-09-10 Marco Aldinucci , Massimo Torquati , Massimiliano Meneghin

Recent work showed that compiling functional programs to use dense, serialized memory representations for recursive algebraic datatypes can yield significant constant-factor speedups for sequential programs. But serializing data in a…

Programming Languages · Computer Science 2021-07-02 Chaitanya Koparkar , Mike Rainey , Michael Vollmer , Milind Kulkarni , Ryan R. Newton

Beam selection for millimeter-wave links in a vehicular scenario is a challenging problem, as an exhaustive search among all candidate beam pairs cannot be assuredly completed within short contact times. We solve this problem via a novel…

The advancement of high-performance computing has enabled the generation of large direct numerical simulation (DNS) datasets of turbulent flows, driving the need for efficient compression/decompression techniques that reduce storage demands…

Asynchronous learning protocols have regained attention lately, especially in the Federated Learning (FL) setup, where slower clients can severely impede the learning process. Herein, we propose \texttt{AsyncDrop}, a novel asynchronous FL…

Machine Learning · Computer Science 2022-10-31 Chen Dun , Mirian Hipolito , Chris Jermaine , Dimitrios Dimitriadis , Anastasios Kyrillidis

Following AI scaling trends, frontier models continue to grow in size and continue to be trained on larger datasets. Training these models requires huge investments in exascale computational resources, which has in turn driven developtment…

Machine Learning · Computer Science 2025-09-18 Hiroki Naganuma , Xinzhi Zhang , Man-Chung Yue , Ioannis Mitliagkas , Philipp A. Witte , Russell J. Hewett , Yin Tat Lee

Emerging Deep Learning (DL) applications introduce heavy I/O workloads on computer clusters. The inherent long lasting, repeated, and random file access pattern can easily saturate the metadata and data service and negatively impact other…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-10-01 Zhao Zhang , Lei Huang , Uri Manor , Linjing Fang , Gabriele Merlo , Craig Michoski , John Cazes , Niall Gaffney

Hybrid parallelism techniques are essential for efficiently training large language models (LLMs). Nevertheless, current automatic parallel planning frameworks often overlook the simultaneous consideration of node heterogeneity and dynamic…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-06-04 Ruilong Wu , Xinjiao Li , Yisu Wang , Xinyu Chen , Dirk Kutscher

Histograms are widely used in medical imaging, network intrusion detection, packet analysis and other stream-based high throughput applications. However, while porting such software stacks to the GPU, the computation of the histogram is a…

Distributed, Parallel, and Cluster Computing · Computer Science 2010-11-02 Sisir Koppaka , Dheevatsa Mudigere , Srihari Narasimhan , Babu Narayanan

In many scenarios, 1) data streams are generated in real time; 2) labeled data are expensive and only limited labels are available in the beginning; 3) real-world data is not always i.i.d. and data drift over time gradually; 4) the storage…

Machine Learning · Computer Science 2022-05-27 Weijieying Ren , Pengyang Wang , Xiaolin Li , Charles E. Hughes , Yanjie Fu

As the journey of 5G standardization is coming to an end, academia and industry have already begun to consider the sixth-generation (6G) wireless networks, with an aim to meet the service demands for the next decade. Deep learning-based RF…

Machine Learning · Computer Science 2023-01-31 Abdurrahman Elmaghbub , Bechir Hamdaoui , Weng-Keen Wong

Spiking Neural Networks (SNNs) have gained significant research attention in the last decade due to their potential to drive resource-constrained edge devices. Though existing SNN accelerators offer high efficiency in processing sparse…

Hardware Architecture · Computer Science 2024-09-04 Ruokai Yin , Youngeun Kim , Di Wu , Priyadarshini Panda

Motivated by the observation that FIFO-based push-relabel algorithms are able to outperform highest label-based variants on modern, large maximum flow problem instances, we introduce an efficient implementation of the algorithm that uses…

Data Structures and Algorithms · Computer Science 2015-07-27 Niklas Baumstark , Guy Blelloch , Julian Shun

The problem of approximating smooth, multivariate functions from sample points arises in many applications in scientific computing, e.g., in computational Uncertainty Quantification (UQ) for science and engineering. In these applications,…

Machine Learning · Computer Science 2022-08-26 Ben Adcock , Juan M. Cardenas , Nick Dexter