English
Related papers

Related papers: Accelerating Cloud-Based Transcriptomics: Performa…

200 papers

Despite the popularity of homogeneous GPU-based deep learning (DL) training, the prevalence, causes and impact of stragglers and the effectiveness of existing straggler mitigation approaches are still not well understood in this scenario…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-12-11 Zeyu Zhang , Haiying Shen

This paper presents a stream-oriented architecture for structuring cluster applications. Clusters that run applications based on this architecture can scale to tenths of thousands of nodes with significantly less performance loss or…

Distributed, Parallel, and Cluster Computing · Computer Science 2007-05-23 Tassos S. Argyros , David R. Cheriton

Conventional Neural Architecture Search (NAS) aims at finding a single architecture that achieves the best performance, which usually optimizes task related learning objectives such as accuracy. However, a single architecture may not be…

Machine Learning · Computer Science 2019-05-24 An-Chieh Cheng , Chieh Hubert Lin , Da-Cheng Juan , Wei Wei , Min Sun

Stimela2 is a new-generation framework for developing data reduction workflows. It is designed for radio astronomy data but can be adapted for other data processing applications. Stimela2 aims at the middle ground between ease of…

Instrumentation and Methods for Astrophysics · Physics 2024-12-18 Oleg M. Smirnov , Sphesihle Makhathini , Jonathan S. Kenyon , Hertzog L. Bester , Simon J. Perkins , Athanaseus J. T. Ramaila , Benjamin V. Hugo

To enhance the efficiency, scalability, and cross-survey applicability of stellar parameter inference in large spectroscopic datasets, we present a modular, parallelized Python framework with automated error estimation, built on the LAMOST…

Resource-constrained edge deployments demand AI solutions that balance high performance with stringent compute, memory, and energy limitations. In this survey, we present a comprehensive overview of the primary strategies for accelerating…

Machine Learning · Computer Science 2025-01-30 Jacob Sander , Achraf Cohen , Venkat R. Dasari , Brent Venable , Brian Jalaian

We present the Scalable Nucleotide Alignment Program (SNAP), a new short and long read aligner that is both more accurate (i.e., aligns more reads with fewer errors) and 10-100x faster than state-of-the-art tools such as BWA. Unlike recent…

Data Structures and Algorithms · Computer Science 2011-11-24 Matei Zaharia , William J. Bolosky , Kristal Curtis , Armando Fox , David Patterson , Scott Shenker , Ion Stoica , Richard M. Karp , Taylor Sittler

Large scale cloud data analytics applications are often CPU bound. Most of these cycles are wasted: benchmarks written in C++ run 10-51 times faster than frameworks such as Naiad and Spark. However, calling faster implementations from those…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-06-08 Omid Mashayekhi , Hang Qu , Chinmayee Shah , Philip Levis

Graph-based ANNS algorithms have gained increasing research interest and market adoption due to their efficiency and accuracy in retrieval. Existing approaches primarily rely on CPUs for graph index construction and retrieval, but this…

Databases · Computer Science 2026-05-12 Lan Lu , Peiqi Yin , Isaac Yang , Tao Luo , Hua Fan , Wenchao Zhou , Feifei Li , Boon Thau Loo

Structural Health Monitoring (SHM) is crucial for the safety and maintenance of various infrastructures. Due to the large amount of data generated by numerous sensors and the high real-time requirements of many applications, SHM poses…

Networking and Internet Architecture · Computer Science 2023-10-12 Wenzhao Zhang , Cheng Guo , Yi Gao , Wei Dong

The surge in generative AI workloads has created a need for scalable inference systems that can flexibly harness both GPUs and specialized accelerators while containing operational costs. This paper proposes a hardware-agnostic control loop…

Performance · Computer Science 2025-03-28 Yahav Biran , Imry Kissos

In a cloud computing job with many parallel tasks, the tasks on the slowest machines (straggling tasks) become the bottleneck in the job completion. Computing frameworks such as MapReduce and Spark tackle this by replicating the straggling…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-09-14 Da Wang , Gauri Joshi , Gregory Wornell

Fully re-orientable small spacecraft are now supported by commercial technologies, allowing them to point their instruments in any direction and capture images, with short notice. When combined with improved onboard processing, and…

Robotics · Computer Science 2025-06-24 Sreeja Roy-Singh , Alan P. Li , Vinay Ravindra , Roderick Lammers , Marc Sanchez Net

The emerging edge-hub-cloud paradigm has enabled the development of innovative latency-critical cyber-physical applications in the edge-cloud continuum. However, this paradigm poses multiple challenges due to the heterogeneity of the…

Networking and Internet Architecture · Computer Science 2025-11-18 Andreas Kouloumpris , Georgios L. Stavrinides , Maria K. Michael , Theocharis Theocharides

High intensive computation applications can usually take days to months to finish an execution. During this time, it is common to have variations of the available resources when considering that such hardware is usually shared among a…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-01-27 Kiran Mantripragada , Alecio Binotto , Leonardo P. Tizzei

Convolutional neural networks (CNNs) often suffer from poor performance when tested on target data that differs from the training (source) data distribution, particularly in medical imaging applications where variations in imaging protocols…

Computer Vision and Pattern Recognition · Computer Science 2024-02-28 Jingjie Guo , Weitong Zhang , Matthew Sinclair , Daniel Rueckert , Chen Chen

We present a convex optimization framework for overcoming the limitations of Kubernetes Cluster Autoscaler by intelligently allocating diverse cloud resources while minimizing costs and fragmentation. Current Kubernetes scaling mechanisms…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-03-28 Shayan Boghani , Emin Kirimlioglu , Amrita Moturi , Hao-Ting Tso

Whilst computational resources at the cloud edge can be leveraged to improve latency and reduce the costs of cloud services for a wide variety mobile, web, and IoT applications; such resources are naturally constrained. For distributed…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-12-20 Ben Blamey , Ida-Maria Sintorn , Andreas Hellander , Salman Toor

Cloud computing has established itself as the support for the vast majority of emerging technologies, mainly due to the characteristic of elasticity it offers. Auto-scalers are the systems that enable this elasticity by acquiring and…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-10-24 Víctor Rampérez , Javier Soriano , David Lizcano , Juan A. Lara

Accurate semantic segmentation of terrestrial laser scanning (TLS) point clouds is limited by costly manual annotation. We propose a semi-automated, uncertainty-aware pipeline that integrates spherical projection, feature enrichment,…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Fei Zhang , Rob Chancia , Josie Clapp , Amirhossein Hassanzadeh , Dimah Dera , Richard MacKenzie , Jan van Aardt